(27]N.Mittas and L.Angelis.Ranking and Clustering Vulnerabilities.IEEE Transactions on Software Software Cost Estimation Models through a Multiple Engineering,37(6):772-787,Nov.2011 Comparisons Algorithm.IEEE Transactions on [37 J.Sliwerski,T.Zimmermann,and A.Zeller.When do Software Engineering,39(4):537-551,Apr.2013. changes induce fixes?In Proceedings of the 2005 [28]A.Mockus and D.M.Weiss.Predicting risk of software International Workshop on Mining Software changes.Bell Labs Technical Journal,5(2):169-180, Repositories,MSR 2005,Saint Louis,Missouri,USA, Apr.2000. May17,2005.ACM,2005. [29]A.Monden,T.Hayashi,S.Shinoda,K.Shirai, [38]R.Wu,H.Zhang,S.Kim,and S.-C.Cheung.ReLink: J.Yoshida,M.Barker,and K.Matsumoto.Assessing Recovering Links Between Bugs and Changes.In the Cost Effectiveness of Fault Prediction in Proceedings of the 19th ACM SIGSOFT Symposium Acceptance Testing.IEEE Transactions on Software and the 13th European Conference on Foundations of Engineering,39(10):1345-1357,Oct.2013. Software Engineering,ESEC/FSE'11,pages 15-25, [30]N.Nagappan and T.Ball.Use of relative code churn New York.NY.USA.2011.ACM. measures to predict system defect density.In [39]Y.Yang,Y.Zhou,H.Lu,L.Chen,Z.Chen,B.Xu, Proceedings of the 27th International Conference on H.Leung,and Z.Zhang.Are Slice-Based Cohesion Software Engineering,ICSE'05,pages 284-292,New Metrics Actually Useful in Effort-Aware Post-Release York,NY.USA.2005.ACM. Fault-Proneness Prediction?An Empirical Study. (31]A.T.Nguyen,T.T.Nguyen,H.A.Nguyen,and T.N. IEEE Transactions on Software Engineering, Nguyen.Multi-layered Approach for Recovering Links 41(4):331-357,Apr.2015. Between Bug Reports and Fixes.In Proceedings of the [40Z.Yin,D.Yuan,Y.Zhou,S.Pasupathy,and ACM SIGSOFT 20th International Symposium on the L.Bairavasundaram.How Do Fixes Become Bugs?In Foundations of Software Engineering,FSE12,pages Proceedings of the 19th ACM SIGSOFT Symposium 63:1-63:11,New York,NY,USA,2012.ACM. and the 13th European Conference on Foundations of 32 F.Rahman and P.Devanbu.How,and why,process Software Engineering,ESEC/FSE'11,pages 26-36, metrics are better.In Proceedings of the 2013 New York,NY,USA,2011.ACM. International Conference on Software Engineering, [41 S.Zhong,T.M.Khoshgoftaar,and N.Seliya ICSE'13,pages 432-441,Piscataway,NJ,USA,2013. Unsupervised learning for expert-based software quality IEEE Press. estimation.In Proceedings of the Eighth IEEE 33 F.Rahman,D.Posnett,and P.Devanbu.Recalling the International Conference on High Assurance Systems "imprecision"of cross-project defect prediction.In Engineering,HASE'04,pages 149-155,Washington, Proceedings of the ACM SIGSOFT 20th International DC.USA.2004.IEEE Computer Society. Symposium on the Foundations of Software [42]Y.Zhou,B.Xu,H.Leung,and L.Chen.An in-depth Engineering,FSE'12,pages 61:1-61:11,New York,NY, study of the potentially confounding effect of class size USA.2012.ACM. in fault prediction.ACM Trans.Softw.Eng.Methodol.. 34 F.Rahman,D.Posnett,A.Hindle,E.Barr,and 23(1):10:1-10:51,Feb.2014. P.Devanbu.BugCache for Inspections:Hit or Miss?In [43]T.Zimmermann,N.Nagappan,H.Gall,E.Giger,and Proceedings of the 19th ACM SIGSOFT Symposium B.Murphy.Cross-project Defect Prediction:A Large and the 13th European Conference on Foundations of Scale Experiment on Data vs.Domain vs.Process.In Software Engineering,ESEC/FSE'11,pages 322-331, Proceedings of thethe 7th Joint Meeting of the New York.NY.USA.2011.ACM. European Software Engineering Conference and the [35]J.Romano,J.D.Kromrey,J.Coraggio,and ACM SIGSOFT Symposium on The Foundations of J.Skowronek.Appropriate statistics for ordinal level Software Engineering,ESEC/FSE'09,pages 91-100, data:Should we really be using t-test and cohen's d for New York,NY,USA,2009.ACM. evaluating group differences on the nsse and other [44]T.Zimmermann,R.Premraj,and A.Zeller.Predicting surveys.In annual meeting of the Florida Association defects for eclipse.In Proceedings of the Third of Institutional Research,pages 1-33,2006. International Workshop on Predictor Models in [36]Y.Shin,A.Meneely,L.Williams,and J.Osborne. Software Engineering,PROMISE '07,pages 9-, Evaluating Complexity,Code Churn,and Developer Washington,DC,USA,2007.IEEE Computer Society. Activity Metrics as Indicators of Software 168[27] N. Mittas and L. Angelis. Ranking and Clustering Software Cost Estimation Models through a Multiple Comparisons Algorithm. IEEE Transactions on Software Engineering, 39(4):537–551, Apr. 2013. [28] A. Mockus and D. M. Weiss. Predicting risk of software changes. Bell Labs Technical Journal, 5(2):169–180, Apr. 2000. [29] A. Monden, T. Hayashi, S. Shinoda, K. Shirai, J. Yoshida, M. Barker, and K. Matsumoto. Assessing the Cost Effectiveness of Fault Prediction in Acceptance Testing. IEEE Transactions on Software Engineering, 39(10):1345–1357, Oct. 2013. [30] N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In Proceedings of the 27th International Conference on Software Engineering, ICSE ’05, pages 284–292, New York, NY, USA, 2005. ACM. [31] A. T. Nguyen, T. T. Nguyen, H. A. Nguyen, and T. N. Nguyen. Multi-layered Approach for Recovering Links Between Bug Reports and Fixes. In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, FSE ’12, pages 63:1–63:11, New York, NY, USA, 2012. ACM. [32] F. Rahman and P. Devanbu. How, and why, process metrics are better. In Proceedings of the 2013 International Conference on Software Engineering, ICSE ’13, pages 432–441, Piscataway, NJ, USA, 2013. IEEE Press. [33] F. Rahman, D. Posnett, and P. Devanbu. Recalling the ”imprecision” of cross-project defect prediction. In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, FSE ’12, pages 61:1–61:11, New York, NY, USA, 2012. ACM. [34] F. Rahman, D. Posnett, A. Hindle, E. Barr, and P. Devanbu. BugCache for Inspections: Hit or Miss? In Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ESEC/FSE ’11, pages 322–331, New York, NY, USA, 2011. ACM. [35] J. Romano, J. D. Kromrey, J. Coraggio, and J. Skowronek. Appropriate statistics for ordinal level data: Should we really be using t-test and cohen’s d for evaluating group differences on the nsse and other surveys. In annual meeting of the Florida Association of Institutional Research, pages 1–33, 2006. [36] Y. Shin, A. Meneely, L. Williams, and J. Osborne. Evaluating Complexity, Code Churn, and Developer Activity Metrics as Indicators of Software Vulnerabilities. IEEE Transactions on Software Engineering, 37(6):772–787, Nov. 2011. [37] J. Sliwerski, T. Zimmermann, and A. Zeller. When do changes induce fixes? In Proceedings of the 2005 International Workshop on Mining Software Repositories, MSR 2005, Saint Louis, Missouri, USA, May 17, 2005. ACM, 2005. [38] R. Wu, H. Zhang, S. Kim, and S.-C. Cheung. ReLink: Recovering Links Between Bugs and Changes. In Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ESEC/FSE ’11, pages 15–25, New York, NY, USA, 2011. ACM. [39] Y. Yang, Y. Zhou, H. Lu, L. Chen, Z. Chen, B. Xu, H. Leung, and Z. Zhang. Are Slice-Based Cohesion Metrics Actually Useful in Effort-Aware Post-Release Fault-Proneness Prediction? An Empirical Study. IEEE Transactions on Software Engineering, 41(4):331–357, Apr. 2015. [40] Z. Yin, D. Yuan, Y. Zhou, S. Pasupathy, and L. Bairavasundaram. How Do Fixes Become Bugs? In Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, ESEC/FSE ’11, pages 26–36, New York, NY, USA, 2011. ACM. [41] S. Zhong, T. M. Khoshgoftaar, and N. Seliya. Unsupervised learning for expert-based software quality estimation. In Proceedings of the Eighth IEEE International Conference on High Assurance Systems Engineering, HASE’04, pages 149–155, Washington, DC, USA, 2004. IEEE Computer Society. [42] Y. Zhou, B. Xu, H. Leung, and L. Chen. An in-depth study of the potentially confounding effect of class size in fault prediction. ACM Trans. Softw. Eng. Methodol., 23(1):10:1–10:51, Feb. 2014. [43] T. Zimmermann, N. Nagappan, H. Gall, E. Giger, and B. Murphy. Cross-project Defect Prediction: A Large Scale Experiment on Data vs. Domain vs. Process. In Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering, ESEC/FSE ’09, pages 91–100, New York, NY, USA, 2009. ACM. [44] T. Zimmermann, R. Premraj, and A. Zeller. Predicting defects for eclipse. In Proceedings of the Third International Workshop on Predictor Models in Software Engineering, PROMISE ’07, pages 9–, Washington, DC, USA, 2007. IEEE Computer Society. 168