A Critical Review on Automated Test Case Generation for Conducting Combinatorial Testing Using Particle Swarm Optimization

  • Authors

    • Dr V. Chandra Prakash
    • Subhash Tatale
    • Vrushali Kondhalkar
    • Laxmi Bewoor
    https://doi.org/10.14419/ijet.v7i3.8.15212

    Received date: July 6, 2018

    Accepted date: July 6, 2018

    Published date: July 7, 2018

  • Particle Swarm Optimization (PSO), Software Testing, Combinatorial Testing, Pair-wise Testing, Automated Test Case Generation

  • Abstract

    In software development life cycle, testing plays the significant role to verify requirement specification, analysis, design, coding and to estimate the reliability of software system. A test manager can write a set of test cases manually for the smaller software systems. However, for the extensive software system, normally the size of test suite is large, and the test suite is prone to an error committed like omissions of important test cases, duplication of some test cases and contradicting test cases etc. When test cases are generated automatically by a tool in an intelligent way, test errors can be eliminated. In addition, it is even possible to reduce the size of test suite and thereby to decrease the cost & time of software testing.

    It is a challenging job to reduce test suite size. When there are interacting inputs of Software under Test (SUT), combinatorial testing is highly essential to ensure higher reliability from 72 % to 91 % or even more than that. A meta-heuristic algorithm like Particle Swarm Optimization (PSO) solves optimization problem of automated combinatorial test case generation. Many authors have contributed in the field of combinatorial test case generation using PSO algorithms.

    We have reviewed some important research papers on automated test case generation for combinatorial testing using PSO. This paper provides a critical review of use of PSO and its variants for solving the classical optimization problem of automatic test case generation for conducting combinatorial testing.

  • References

    1. Cohen, David M., Siddhartha R. Dalal, Michael L. Fredman, and Gardner C. Patton. "The AETG system: An approach to testing based on combinatorial design." IEEE Transactions on Software Engineering Vol.23, No. 7 (1997), pp. 437-444.
    2. Poli, Riccardo, James Kennedy, and Tim Blackwell. "Particle swarm optimization." Swarm intelligence, Springer, Vol. 1, No. 1 (2007), pp. 33-57.
    3. R. Kuhn, Yu Lei and Raghu Kacker, “Practical Combinatorial Test-ing: beyond Pair wise”, IEEE Computer Society - IT Professional, Vol. 10, No. 3 (2008).
    4. D. Richard Kuhn, Raghu N. Kacker and Yu Lei, “Practical combi-natorial testing”, NIST Special Publication, (2010).
    5. Chen, Xiang, Qing Gu, Jingxian Qi, and Daoxu Chen. "Applying particle swarm optimization to pairwise testing." Conference In Computer Software and Applications (COMPSAC), IEEE (2010), pp. 107-116.
    6. Ahmed, Bestoun S., and Kamal Z. Zamli. "PSTG: a t-way strategy adopting particle swarm optimization." 4th Asia International Con-ference In Mathematical/Analytical Modelling and Computer Simu-lation (AMS), IEEE (2010), pp. 1-5.
    7. Zha, Ri-Jun, De-Ping Zhang, Chang-Hai Nie, and Bao-Wen Xu. "Test data generation algorithms of combinatorial testing and com-parison based on cross-entropy and particle swarm optimization method." Jisuanji Xuebao (Chinese Journal of Computers) Vol.33, No. 10 (2010), pp.1896-1908.
    8. Ahmed, Bestoun S., and Kamal Z. Zamli. "T-way test data genera-tion strategy based on particle swarm optimization." 2nd Internation-al Conference In Computer Research and Development, IEEE (2010), pp. 93-97.
    9. Vudatha, Chandra Prakash, Sateesh Nalliboena, Sastry Kr Jammal-amadaka, Bala Krishna Kamesh Duvvuri, and L. S. S. Reddy. "Au-tomated generation of test cases from output domain of an embed-ded system using Genetic algorithms." 3rd International In Elec-tronics Computer Technology (ICECT), IEEE (2011), vol. 5, pp. 216-220.
    10. Pan, Xiaoying, and Hao Chen. "Using organizational evolutionary particle swarm techniques to generate test cases for combinatorial testing." 7th International Conference In Computational Intelligence and Security (CIS), IEEE (2011), pp. 1580-1583.
    11. Ahmed, Bestoun S., and Kamal Z. Zamli. "A variable strength in-teraction test suites generation strategy using Particle Swarm Opti-mization." Journal of Systems and Software Vol.84, No. 12 (2011), pp. 2171-2185.
    12. Ahmed, Bestoun S., Kamal Z. Zamli, and C. Lim. "The develop-ment of a particle swarm based optimization strategy for pairwise testing." Journal of Artificial Intelligence Vol.4, No. 2 (2011), pp. 156-165.
    13. Ahmed, Bestoun S., Kamal Z. Zamli, and Chee Peng Lim. "Con-structing a t-way interaction test suite using the particle swarm op-timization approach." International Journal of Innovative Compu-ting, Information and Control Vol.8, No. 1 (2012),pp. 431-452.
    14. Ahmed, Bestoun S., Kamal Z. Zamli, and Chee Peng Lim. "Appli-cation of particle swarm optimization to uniform and variable strength covering array construction." Applied Soft Computing Vol. 12, No. 4 (2012), pp. 1330-1347.
    15. Ahmed, Bestoun S., and Kamal Z. Zamli. "A greedy particle swarm optimization strategy for t-way software testing." Journal of Artifi-cial Intelligence Vol.5, No. 2 (2012), pp. 85-90.
    16. Chana, Inderveer, and Ajay Rana. "An Effective Approach to Build Optimal T-way Interaction Test Suites over Cloud Using Particle Swarm Optimization." In International Conference on Advances in Communication, Network, and Computing, Springer (2012), pp. 193-198.
    17. Wang, Jianfeng, Chao Sun, and Shouda Jiang "Improved algorithm for combinatorial test data generation based on particle swarm op-timization." Journal of Harbin Engineering University Vol.4 (2013).
    18. Ahmed, Bestoun S., Mouayad A. Sahib, and Moayad Y. Potrus. "Generating combinatorial test cases using Simplified Swarm Opti-mization (SSO) algorithm for automated GUI functional testing." International Journal of Engineering Science and Technology, Vol. 17, No. 4 (2014), pp.218-226.
    19. Wu, Huayao, Changhai Nie, Fei-Ching Kuo, Hareton Leung, and Charles J. Colbourn. "A discrete particle swarm optimization for covering array generation." IEEE Transactions on Evolutionary Computation Vol.19, No. 4 (2013), pp. 575-591.
    20. Rabbi, Khandakar, Quazi Mamun, and MD Rafiqul Islam. "An effi-cient particle swarm intelligence based strategy to generate optimum test data in t-way testing." 10th Conference In Industrial Electron-ics and Applications (ICIEA), IEEE (2015), pp. 123-128.
    21. Mahmoud, Thair, and Bestoun S. Ahmed. "An efficient strategy for covering array construction with fuzzy logic-based adaptive swarm optimization for software testing use." Expert Systems with Appli-cations Vol.42, No. 22 (2015), pp. 8753-8765.
    22. V.Chandra Prakash and Kadiyala Priyanka, 2016. “Test Case Gen-eration for Pairwise + Testing.” Asian Journal of Information Tech-nology. Vol. 15 No.23 (2016), pp.4800-4805.
    23. Kalaee, Akram, and Vahid Rafe. "An Optimal Solution for Test Case Generation Using ROBDD Graph and PSO Algorithm." In-ternational Journal of Quality and Reliability Engineering Vol.32, No. 7 (2016), pp. 2263-2279
    24. Sahin, Omur, and Bahriye Akay. "Comparisons of metaheuristic algorithms and fitness functions on software test data generation." Applied Soft Computing Vol. 49 (2016), pp. 1202-1214.
    25. Bewoor, L., V. Chandra Prakash, and Sagar U. Sapkal. "Compara-tive analysis of metaheuristic approaches for m-machine no-wait flow shop scheduling for minimizing total flow time with stochastic input." International Journal of Engineering & Technology, Vol.8 (2016), pp. 3021-3026.
    26. Ahmed, Bestoun S., Luca M. Gambardella, Wasif Afzal, and Kamal Z. Zamli. "Handling constraints in combinatorial interaction testing in the presence of multi objective particle swarm and multi-threading." Journal of Information and Software Technology Vol.86 (2017), pp. 20-36
    27. Sheng, Yunlong, Changan Wei, and Shouda Jiang. "Constraint Test Cases Generation Based on Particle Swarm Optimization." Interna-tional Journal of Reliability, Quality and Safety Engineering Vol.24, No. 05 (2017).
    28. Bewoor, Laxmi A., V. Chandra Prakash, and Sagar U. Sapkal. "Comparative Analysis of Metaheuristic Approaches for Makespan Minimization for No Wait Flow Shop Scheduling Problem." Inter-national Journal of Electrical and Computer Engineering Vol.7, No. 1 (2017), pp. 417.
    29. Bewoor Laxmi A., V. Chandra Prakash, and Sagar U. Sapkal. "Evo-lutionary Hybrid Particle Swarm Optimization Algorithm for Solv-ing NP-Hard No-Wait Flow Shop Scheduling Problems." Algo-rithms Vol.10, No. 4 (2017), pp. 121.
    30. Vudatha Chandra Prakash, Sastry K R Jammalamadaka, and Bala Krishna Kamesh Duvvuri. "Automated generation of Test cases for testing critical regions of embedded systems through Adjacent Pair-wise Testing." International Journal of Mathematics and Computa-tional Methods in Science & Technology Vol.2, No.2, (2012), pp. 10-15.
    31. Dr. Chandra Prakash V, Dr. Sastry J K R, Sravani G, Manasa USL, Khyathi A, Harini A. "Testing Software Through Genetic Algo-rithms-A Survey" Journal of Advanced Research in Dynamical and Control Systems, Vol. 9 (2017).

  • Downloads

  • How to Cite

    V. Chandra Prakash, D., Tatale, S., Kondhalkar, V., & Bewoor, L. (2018). A Critical Review on Automated Test Case Generation for Conducting Combinatorial Testing Using Particle Swarm Optimization. International Journal of Engineering and Technology, 7(3.8), 22-28. https://doi.org/10.14419/ijet.v7i3.8.15212