Abstract
This paper introduces the hash-merge join algorithm (HMJ, for short); a new non-blocking join algorithm that deals with data items from remote sources via unpredictable, slow, or bursty network traffic. The HMJ algorithm is designed with two goals in mind: (1) Minimize the time to produce the first few results, and (2) Produce join results even if the two sources of the join operator occasionally get blocked. The HMJ algorithm has two phases: The hashing phase and the merging phase. The hashing phase employs an in-memory hash-based join algorithm that produces join results as quickly as data arrives. The merging phase is responsible for producing join results if the two sources are blocked. Both phases of the HMJ algorithm are connected via a flushing policy that flushes in-memory parts into disk storage once the memory is exhausted. Experimental results show that HMJ combines the advantages of two state-of-the-art non-blocking join algorithms (XJoin and Progressive Merge Join) while avoiding their shortcomings.
Original language | English (US) |
---|---|
Title of host publication | Proceedings - 20th International Conference on Data Engineering - ICDE 2004 |
Pages | 251-262 |
Number of pages | 12 |
Volume | 20 |
DOIs | |
State | Published - Jun 1 2004 |
Event | Proceedings - 20th International Conference on Data Engineering - ICDE 2004 - Boston, MA., United States Duration: Mar 30 2004 → Apr 2 2004 |
Other
Other | Proceedings - 20th International Conference on Data Engineering - ICDE 2004 |
---|---|
Country/Territory | United States |
City | Boston, MA. |
Period | 3/30/04 → 4/2/04 |