TY - GEN
T1 - ScalParC
T2 - 1st Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing, IPPS/SPDP 1998
AU - Joshi, M. V.
AU - Karypis, George
AU - Kumar, Vipin
PY - 1998/1/1
Y1 - 1998/1/1
N2 - In this paper, we present ScalParC (Scalable Parallel Classifier), a new parallel formulation of a decision tree based classification process. Like other state-of-the-art decision tree classifiers such as SPRINT, ScalParC is suited for handling large datasets. We show that existing parallel formulation of SPRINT is unscalable, whereas ScalParC is shown to be scalable in both runtime and memory requirements. We present the experimental results of classifying up to 6.4 million records on up to 128 processors of Cray T3D, in order to demonstrate the scalable behavior of ScalParC. A key component of ScalParC is the parallel hash table. The proposed parallel hashing paradigm can be used to parallelize other algorithms that require many concurrent updates to a large hash table.
AB - In this paper, we present ScalParC (Scalable Parallel Classifier), a new parallel formulation of a decision tree based classification process. Like other state-of-the-art decision tree classifiers such as SPRINT, ScalParC is suited for handling large datasets. We show that existing parallel formulation of SPRINT is unscalable, whereas ScalParC is shown to be scalable in both runtime and memory requirements. We present the experimental results of classifying up to 6.4 million records on up to 128 processors of Cray T3D, in order to demonstrate the scalable behavior of ScalParC. A key component of ScalParC is the parallel hash table. The proposed parallel hashing paradigm can be used to parallelize other algorithms that require many concurrent updates to a large hash table.
UR - http://www.scopus.com/inward/record.url?scp=0031650729&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0031650729&partnerID=8YFLogxK
U2 - 10.1109/IPPS.1998.669983
DO - 10.1109/IPPS.1998.669983
M3 - Conference contribution
AN - SCOPUS:0031650729
VL - 1998-March
T3 - Proceedings of the International Parallel Processing Symposium, IPPS
SP - 573
EP - 579
BT - Proceedings of the 1st Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing, IPPS/SPDP 1998
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 30 March 1998 through 3 April 1998
ER -