TY - GEN
T1 - JaConTeBe
T2 - 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015
AU - Lin, Ziyi
AU - Marinov, Darko
AU - Zhong, Hao
AU - Chen, Yuting
AU - Zhao, Jianjun
N1 - Funding Information:
This research was sponsored in part by 973 Program in China (Grant No. 2015CB352203), the National Nature Science Foundation of China (Grant Nos. 9111800420 and 612721020), and the US NSF (Grant Nos. CCF-1012759 and CCF-1438982). Ziyi Lin and Yuting Chen are supported by China Scholarship Council and partially supported by NSFC (Grant Nos. 61472242 and 61572312), and Hao Zhong is partially supported by NSFC (Grant No. 61572313)
PY - 2016/1/4
Y1 - 2016/1/4
N2 - Researchers have proposed various approaches to detect concurrency bugs and improve multi-threaded programs, but performing evaluations of the effectiveness of these approaches still remains a substantial challenge. We survey the existing evaluations and find out that they often use code or bugs not representative of real world. To improve representativeness, we have prepared JaConTeBe, a benchmark suite of 47 confirmed concurrency bugs from 8 popular open-source projects, supplemented with test cases for reproducing buggy behaviors. Running three approaches on JaConTeBe shows that our benchmark suite confirms some limitations of the three approaches. We submitted JaConTeBe to the SIR repository (a software-artifact repository for rigorous controlled experiments), and it was included as a part of SIR.
AB - Researchers have proposed various approaches to detect concurrency bugs and improve multi-threaded programs, but performing evaluations of the effectiveness of these approaches still remains a substantial challenge. We survey the existing evaluations and find out that they often use code or bugs not representative of real world. To improve representativeness, we have prepared JaConTeBe, a benchmark suite of 47 confirmed concurrency bugs from 8 popular open-source projects, supplemented with test cases for reproducing buggy behaviors. Running three approaches on JaConTeBe shows that our benchmark suite confirms some limitations of the three approaches. We submitted JaConTeBe to the SIR repository (a software-artifact repository for rigorous controlled experiments), and it was included as a part of SIR.
UR - http://www.scopus.com/inward/record.url?scp=84963808718&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84963808718&partnerID=8YFLogxK
U2 - 10.1109/ASE.2015.87
DO - 10.1109/ASE.2015.87
M3 - Conference contribution
AN - SCOPUS:84963808718
T3 - Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015
SP - 178
EP - 189
BT - Proceedings - 2015 30th IEEE/ACM International Conference on Automated Software Engineering, ASE 2015
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 9 November 2015 through 13 November 2015
ER -