TY - JOUR
T1 - Characterizing and comparing prevailing simulation techniques
AU - Yi, Joshua J.
AU - Kodakara, Sreekumar V.
AU - Sendag, Resit
AU - Lilja, David J.
AU - Hawkins, Douglas M.
PY - 2005/12/12
Y1 - 2005/12/12
N2 - Due to the simulation time of the reference input set, architects often use alternative simulation techniques. Although these alternatives reduce the simulation time, what has not been evaluated is their accuracy relative to the reference input set, and with respect to each other. To rectify this deficiency, this paper uses three methods to characterize the reduced input set, truncated execution, and sampling simulation techniques while also examining their speed versus accuracy trade-off and configuration dependence. Finally, to illustrate the effect that a technique could have on the apparent speedup results, we quantify the speedups obtained with two processor enhancements. The results show that: 1) The accuracy of the truncated execution techniques was poor for all three characterization methods and for both enhancements, 2) The characteristics of the reduced input sets are not reference-like, and 3) SimPoint and SMARTS, the two sampling techniques, are extremely accurate and have the best speed versus accuracy trade-offs. Finally, this paper presents a decision tree which can help architects choose the most appropriate technique for their simulations.
AB - Due to the simulation time of the reference input set, architects often use alternative simulation techniques. Although these alternatives reduce the simulation time, what has not been evaluated is their accuracy relative to the reference input set, and with respect to each other. To rectify this deficiency, this paper uses three methods to characterize the reduced input set, truncated execution, and sampling simulation techniques while also examining their speed versus accuracy trade-off and configuration dependence. Finally, to illustrate the effect that a technique could have on the apparent speedup results, we quantify the speedups obtained with two processor enhancements. The results show that: 1) The accuracy of the truncated execution techniques was poor for all three characterization methods and for both enhancements, 2) The characteristics of the reduced input sets are not reference-like, and 3) SimPoint and SMARTS, the two sampling techniques, are extremely accurate and have the best speed versus accuracy trade-offs. Finally, this paper presents a decision tree which can help architects choose the most appropriate technique for their simulations.
UR - http://www.scopus.com/inward/record.url?scp=28444474809&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=28444474809&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:28444474809
SN - 1530-0897
SP - 266
EP - 277
JO - Proceedings - International Symposium on High-Performance Computer Architecture
JF - Proceedings - International Symposium on High-Performance Computer Architecture
T2 - 11th International Symposium on High-Performance Computer Architecture, HPCA-11 2005
Y2 - 12 February 2005 through 16 February 2005
ER -