Abstract
Inspired by convolutional neural networks on 1D and 2D data, graph convolutional neural networks (GCNNs) have been developed for various learning tasks on graph data, and have shown superior performance on real-world datasets. Despite their success, there is a dearth of theoretical explorations of GCNN models such as their generalization properties. In this paper, we take a first step towards developing a deeper theoretical understanding of GCNN models by analyzing the stability of single-layer GCNN models and deriving their generalization guarantees in a semi-supervised graph learning setting. In particular, we show that the algorithmic stability of a GCNN model depends upon the largest absolute eigenvalue of its graph convolution filter. Moreover, to ensure the uniform stability needed to provide strong generalization guarantees, the largest absolute eigenvalue must be independent of the graph size. Our results shed new insights on the design of new & improved graph convolution filters with guaranteed algorithmic stability. We evaluate the generalization gap and stability on various real-world graph datasets and show that the empirical results indeed support our theoretical findings. To the best of our knowledge, we are the first to study stability bounds on graph learning in a semi-supervised setting and derive generalization bounds for GCNN models.
Original language | English (US) |
---|---|
Title of host publication | KDD 2019 - Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining |
Publisher | Association for Computing Machinery |
Pages | 1539-1548 |
Number of pages | 10 |
ISBN (Electronic) | 9781450362016 |
DOIs | |
State | Published - Jul 25 2019 |
Event | 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2019 - Anchorage, United States Duration: Aug 4 2019 → Aug 8 2019 |
Publication series
Name | Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining |
---|
Conference
Conference | 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2019 |
---|---|
Country/Territory | United States |
City | Anchorage |
Period | 8/4/19 → 8/8/19 |
Bibliographical note
Funding Information:The research was supported in part by US DoD DTRA grant HDTRA1-14-1-0040, and NSF grants CNS 1618339, CNS 1617729, CNS 1814322 and CNS183677.
Publisher Copyright:
© 2019 Association for Computing Machinery.
Keywords
- Deep learning
- Generalization guarantees
- Graph convolutional neural networks
- Graph mining
- Stability