Abstract
The k-nearest neighbor graph is often used as a building block in information retrieval, clustering, online advertising, and recommender systems algorithms. The complexity of constructing the exact k-nearest neighbor graph is quadratic on the number of objects that are compared, and most existing methods solve the problem approximately. We present L2Knng, an efficient algorithm that finds the exact cosine similarity k-nearest neighbor graph for a set of sparse high-dimensional objects. Our algorithm quickly builds an approximate solution to the problem, identifying many of the most similar neighbors, and then uses theoretic bounds on the similarity of two vectors, based on the ℓ2-norm of part of the vectors, to find each object's exact k-neighborhood. We perform an extensive evaluation of our algorithm, comparing against both exact and approximate baselines, and demonstrate the efficiency of our method across a variety of real-world datasets and neighborhood sizes. Our approximate and exact L2Knng variants compute the k-nearest neighbor graph up to an order of magnitude faster than their respective baselines.
Original language | English (US) |
---|---|
Title of host publication | CIKM 2015 - Proceedings of the 24th ACM International Conference on Information and Knowledge Management |
Publisher | Association for Computing Machinery |
Pages | 791-800 |
Number of pages | 10 |
ISBN (Electronic) | 9781450337946 |
DOIs | |
State | Published - Oct 17 2015 |
Event | 24th ACM International Conference on Information and Knowledge Management, CIKM 2015 - Melbourne, Australia Duration: Oct 19 2015 → Oct 23 2015 |
Publication series
Name | International Conference on Information and Knowledge Management, Proceedings |
---|---|
Volume | 19-23-Oct-2015 |
Other
Other | 24th ACM International Conference on Information and Knowledge Management, CIKM 2015 |
---|---|
Country/Territory | Australia |
City | Melbourne |
Period | 10/19/15 → 10/23/15 |
Bibliographical note
Publisher Copyright:© 2015 ACM.
Keywords
- Cosine similarity
- K-nearest neighbor graph
- Similarity search
- Top-k