TY - JOUR
T1 - Prediction of partially observed dynamical processes over networks via dictionary learning
AU - Forero, Pedro A.
AU - Rajawat, Ketan
AU - Giannakis, Georgios B.
PY - 2014/7/1
Y1 - 2014/7/1
N2 - Prediction of dynamical processes evolving over network graphs is a basic task encountered in various areas of science and engineering. The prediction challenge is exacerbated when only partial network observations are available, that is when only measurements from a subset of nodes are available. To tackle this challenge, the present work introduces a joint topology-and data-driven approach for network-wide prediction able to handle partially observed network data. First, the known network structure and historical data are leveraged to design a dictionary for representing the network process. The novel approach draws from semi-supervised learning to enable learning the dictionary with only partial network observations. Once the dictionary is learned, network-wide prediction becomes possible via a regularized least-squares estimate which exploits the parsimony encapsulated in the design of the dictionary. Second, an online network-wide prediction algorithm is developed to jointly extrapolate the process over the network and update the dictionary accordingly. This algorithm is able to handle large training datasets at a fixed computational cost. More important, the online algorithm takes into account the temporal correlation of the underlying process, and thereby improves prediction accuracy. The performance of the novel algorithms is illustrated for prediction of real Internet traffic. There, the proposed approaches are shown to outperform competitive alternatives.
AB - Prediction of dynamical processes evolving over network graphs is a basic task encountered in various areas of science and engineering. The prediction challenge is exacerbated when only partial network observations are available, that is when only measurements from a subset of nodes are available. To tackle this challenge, the present work introduces a joint topology-and data-driven approach for network-wide prediction able to handle partially observed network data. First, the known network structure and historical data are leveraged to design a dictionary for representing the network process. The novel approach draws from semi-supervised learning to enable learning the dictionary with only partial network observations. Once the dictionary is learned, network-wide prediction becomes possible via a regularized least-squares estimate which exploits the parsimony encapsulated in the design of the dictionary. Second, an online network-wide prediction algorithm is developed to jointly extrapolate the process over the network and update the dictionary accordingly. This algorithm is able to handle large training datasets at a fixed computational cost. More important, the online algorithm takes into account the temporal correlation of the underlying process, and thereby improves prediction accuracy. The performance of the novel algorithms is illustrated for prediction of real Internet traffic. There, the proposed approaches are shown to outperform competitive alternatives.
KW - Dictionary learning
KW - estimation over networks
KW - online learning
KW - semi-supervised learning
UR - http://www.scopus.com/inward/record.url?scp=84902326242&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84902326242&partnerID=8YFLogxK
U2 - 10.1109/TSP.2014.2325798
DO - 10.1109/TSP.2014.2325798
M3 - Article
AN - SCOPUS:84902326242
SN - 1053-587X
VL - 62
SP - 3305
EP - 3320
JO - IEEE Transactions on Signal Processing
JF - IEEE Transactions on Signal Processing
IS - 13
M1 - 6819085
ER -