The Effectiveness of an Enhanced Weighted Method with a Unique Priority Value for Test Case Prioritization in Regression Testing
About this article
DOI:
https://doi.org/10.14419/ijet.v7i4.31.23335Keywords:
Regression testing, Software testing, Statistical test, Test case prioritization, Unique priority value.Abstract
Regression testing is an important and costly strategy in software testing. To decrease its cost, many methods have been proposed including the test case prioritization methods. The aim of the prioritization methods is to define an ideal order of test cases that allows for higher coverage and early fault detection with minimal number of executed test cases. However, the problem with most of the existing test case prioritization methods is the random sorting of test cases when two or more test cases record equal priority values. In this paper, the effectiveness of an enhanced weighted method using a unique priority value, UniVal, is proposed. Unival prioritizes test cases based on code coverage criteria with information from history of previous executions. In addition, a controlled experiment was executed, and the results were statistically analyzed to assess the effectiveness of the proposed method. The results indicates better performance with regard to prioritize test cases and achieve higher APFD values.
References
Beizer, B. (1990). Software Testing Techniques (2Nd Ed.). New York, NY, USA: Van Nostrand Reinhold Co.
Chaudhary, N., Sangwan, O. P., & Singth, Y. (2012). Test Case PrioritizationUsing Fuzzy Logic for GUI based Software. Interna-tional Journal of Advanced Computer Science and Applica-tions(IJACSA), 3(12), 222–227. Retrieved from http://ijacsa.thesai.org/
Cho, Y., Kim, J., & Lee, E. (2016). History-Based Test Case Priori-tization for Failure Information. In 2016 23rd Asia-Pacific Software Engineering Conference (APSEC) (pp. 385–388). IEEE. https://doi.org/10.1109/APSEC.2016.066
Collis, J., & Hussy, R. (2003). Business research: a practical guide for undergraduate and postgraduate students / Jill Collis and Roger Hussey. - Version details - Trove. Retrieved from http://trove.nla.gov.au/work/13991820?q&sort=holdings+desc&_=1494530661049&versionId=220777880
Elbaum, S., Rothermel, G., Kanduri, S., & Malishevsky, A. G. (2004). Selecting a cost-effective test case prioritization technique. Software Quality Journal, 12, 185–210. https://doi.org/10.1023/B:SQJO.0000034708.84524.22
View more references (33)
Fazlalizadeh, Y., Khalilian, A., Abdollahi Azgomi, M., & Parsa, S. (2009). Incorporating historical test case performance data and re-source constraints into test case prioritization. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5668 LNCS, 43–57. https://doi.org/10.1007/978-3-642-02949-3_5
Felderer, M., & Fourneret, E. (2015). A systematic classification of security regression testing approaches. International Journal on Software Tools for Technology Transfer. https://doi.org/10.1007/s10009-015-0365-2
Gupta, S., Raperia, H., Kapur, E., Singh, H., & Kumar, A. (2012). A Novel Approach for Test Case Prioritization. International Jour-nal of Computer Science, Engineering and Applications, 2(3), 53–60. https://doi.org/10.5121/ijcsea.2012.2305
Harikarthik, S. K., & Palanisamy, V. (2014). Improving Quality of Software Testing Process by Test Case Prioritization, 245–248.
Hashini, M., & Varun, B. (2014). Clustering Approach to Test Case Prioritization Using Code Coverage Metric, (May), 3–6.
Jorgensen, P. C. (2014). Software Testing A Craftsman’s Approach (4th ed.). crc press. Retrieved from http://202.191.120.147:8020/greenstone/collect/ebooks/index/assoc/HASH017c.dir/doc.pdf
Jyoti, & Solanki, K. (2014). A Comparative Study of Five Regres-sion Testing Techniques : A Survey. INTERNATIONAL JOURNAL OF SCIENTIFIC & TECHNOLOGY RESEARCH, 3(8). Retrieved from www.ijstr.org
Kaur, N., & Mahajan, M. (2014). Prioritization of Test Cases using Branch Coverage with Multiple criteria for Regression Testing, 5(2), 972–974.
Khalilian, A., Abdollahi Azgomi, M., & Fazlalizadeh, Y. (2012). An improved method for test case prioritization by incorporating histor-ical test case data. Science of Computer Programming, 78(1), 93–116. https://doi.org/10.1016/j.scico.2012.01.006
Khandelwal, E., & Bhadauria, M. (2013). Various Techniques Used For Prioritization of Test Cases, 3(6), 3–6.
Korel, B., Koutsogiannakis, G., & Tahat, L. H. (2007). Model-based test prioritization heuristic methods and their evaluation. Pro-ceedings of the 3rd International Workshop on Advances in Model-Based Testing - A-MOST ’07, 34–43. https://doi.org/10.1145/1291535.1291539
Kumar, A., & Singh, K. (2014). A Literature Survey on test case prioritization. COMPUSOFT, 3(5). Retrieved from https://ijact.in/index.php/ijact/article/viewFile/320/271
Lawanna, A. (2012). The Theory of Software Testing, 16(1), 35–40.
Mei, L., Zhang, Z., Chan, W. K., & Tse, T. H. (2009). Test case pri-oritization for regression testing of service-oriented business appli-cations. Proceedings of the 18th International Conference on World Wide Web - WWW ’09, 901. https://doi.org/10.1145/1526709.1526830
Muthusamy, T. (2014). A New Effective Test Case Prioritization for Regression Testing based on Prioritization Algorithm, 6(7), 21–26.
Muthusamy, T., & Seetharaman, K. (2013). A Test Case Prioritiza-tion Method with Weight Factors in Regression Testing Based on Measurement Metrics, (12), 390–396.
Muthusamy, T., & Seetharaman, K. (2014). Comparisons of Test t Case Prioritization Algorithm with Random Prioritization, 5(5), 6814–6818.
Orso, A., & Rothermel, G. (2014). Software testing: a research trav-elogue (2000–2014). Proceedings of the on Future of Software En-gineering - FOSE 2014, 117–132. https://doi.org/10.1145/2593882.2593885
Ponaraseri, S., Susi, A., & Tonella, P. (2008). Using the Planning Game for Test Case Prioritization. Test.
Prakash, N. (2013). Potentially Weighted Method for Test Case Prioritization, 18, 7147–7156. https://doi.org/10.12733/jcis5860
Prakash, N., & Rangaswamy, T. R. (2013). WEIGHTED METHOD FOR COVERAGE BASED TEST CASE PRIORITIZATION, 56(2), 235–243.
Roongruangsuwan, S., & Daengdej, J. (2010). Test case prioritiza-tion techniques. Journal of Theoretical and Applied Information Technology, 18, 45–60.
Rothermel, G., Untch, R. H., Chu, C., Harrold, M. J., & Society, I. C. (2001). Prioritizing Test Cases For Regression Testing Prioritiz-ing Test Cases For Regression Testing. IEEE Transactions on Soft-ware Engineering, 27(10), 929–948. https://doi.org/10.1145/347324.348910
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). EXPERI-MENTAL AND QUASI-EXPERIMENTAL DESIGNS FOR GEN-ERALIZED CAUSAL INFERENCE. Retrieved from http://impact.cgiar.org/pdf/147.pdf
Shelke, S., & Nagpure, S. (2014). The Study of Various Code Cov-erage Tools. International Journal of Computer Trends and Tech-nology (IJCTT)--Volume, 13(1), 46–49.
Srikanth, H., Banerjee, S., Williams, L., & Osborne, J. (2014). To-wards the prioritization of system test cases. Software Testing, Veri-fication and Reliability, 24(4), 320–337. https://doi.org/10.1002/stvr.1500
Tanwani, L., & Waghire, A. (2016). Test Case Prioritization for Re-gression Testing of GUI. International Acadmey of Engineering and Medical Research, (1). Retrieved from http://www.iaemr.com/wp-content/uploads/2016/11/test-case-prioritization-regression-testing-gui.pdf
Tonella, P., Avesani, P., & Susi, A. (2006). Using the case-based ranking methodology for test case prioritization. IEEE International Conference on Software Maintenance, ICSM, 123–132. https://doi.org/10.1109/ICSM.2006.74
Wang, X., & Zeng, H. (2014). Dynamic Test Case Prioritization based on Multi-objective, (61073050), 0–5.
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012). Experimentation in Software Engineering. Ber-lin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-29044-2
Yadav, D. K., & Dutta, S. (2017). Regression Test Case Prioritiza-tion Technique Using Genetic Algorithm (pp. 133–140). https://doi.org/10.1007/978-981-10-2525-9_13
Yoo, S., & Harman, M. (2007). Regression Testing Minimisation, Selection and Prioritisation : A Survey. Test. Verif. Reliab, 0, 1–7. https://doi.org/10.1002/000
Zou, Y., Chen, Z., Zheng, Y., Zhang, X., & Gao, Z. (2014). Virtual DOM Coverage : Drive an Effective Testing for Dynamic Web Ap-plications Categories and Subject Descriptors. Issta.