Identifying the Effect of Model Modifications in State-Based Models and Systems
About this article
Abstract
System modeling is a widely used technique to model state-based systems. System models are often used during the development of a software system, e.g., in partial code generation and in test generation. Several modeling languages have been developed to model state-based software systems, e.g., EFSM, SDL, and State Charts. Although state-based modeling is very useful, system models are usually large and complex, and they are frequently modified because of specification changes. Identifying the effect of these changes on the model and consequently on the underlying system is usually challenging and time-consuming. In this paper, we present an approach to automatically identify the effect of modifications made to the model. The goal is to identify those parts of the model that may exhibit different behaviors because of the modification. These are usually critical parts of the system that should be carefully tested. In this approach, the difference between the original model and the modified model is identified, and then the affected parts of the model are computed based on model dependence analysis. An empirical study on different EFSM models is performed in order to identify the affected parts of the model after a modification. The results of the study suggest that our approach could considerably reduce the amount of time and efforts the spent to validate the model after a modification.References
[1] Lionel C. Briand, Yvan Labiche and G. Soccar. Automating impact analysis and regression test selection based on UML designs. International Conference on Software Maintenance (ICSM), Montréal, Canada, pages 252-261, 2002.
[2] Lionel C. Briand, Yvan Labiche and S. He. Automating regression test selection based on UML designs. Information and Software Technology. 51(1):16-30, 2009.
[3] Alessandro Orso, Hyunsook Do, Gregg Rothermel, Mary Jean Harrold, David S. Rosenblum. Using component metadata to regression test component-based software. Software Testing Verification and Reliability (STVR). 17(2):61-94, June 2007.
[4] Qurat-ul-ann Farooq, Muhammad Zohaib Z. Iqbal, Zafar I Malik andAamer Nadeem. An approach for selective state machine based regression testing. Proceedings of the 3rd International ACM Workshop on Advances in Model-Based Testing, London, United Kingdom, pages: 44 – 52, 2007.
[5] Ye Wu and Jeff. Offutt. Maintaining evolving component-based software with UML. Seventh European Conference on Software Maintenance and Reengineering(CSMR), pages 133- 142, 2003.
View more references (45)
[6] Orest Pilskalns, Gunay Uyan, Anneliese Andrews. Regression Testing UML Designs. 22nd IEEE International Conference on Software Maintenance, Philadelphia, Pennsylvania, USA, pages: 254 – 264, 2006.
[7] B. Korel, L. Tahat, M. Harman. Test Prioritization Using System Models. Proc. IEEE International Conference on Software Maintenance. Budapest, Hungary, pp. 559-568, 2005.
[8] B. Korel, G. Koutsogiannakis, L. Tahat. Model-Based Test Prioritization Heuristic Methods and Their Evaluation. IEEE International Conference on Software Maintenance. ICSM 2008, Beijing, China, September. 2008, pp: 247-256.
[9] B. Korel, G. Koutsogiannakis. Experimental Comparison of Code-Based and Model-Based Test Prioritization, 5th Workshop on Advances in Model Based Testing, A-MOST 2009, Denver, April 2009, IEEE digital library.”
[10] B. Korel, G. Koutsogiannakis, L. Tahat. Prioritization Algorithms for Regression Testing in Model Based Systems. Proc. the 3rd ACM Workshop on Advances in Model Based Testing (A-MOST), London, United Kingdom, pp. 34-43, 2007.
[11] Douglass B. P. "UML Statecharts", ESP Jan-1999. I-Logix.
[12] Harel D. "Statecharts: A Visual Formalism for Complex Systems”. Science of Computer Programming. Vol. 8 (1987), pp. 231-274.
[13] Harel D. “From Play-In Scenarios to Code: An Achievable Dream,” Proc. Fundamental Approaches to Software Engineering (FASE), Lecture Notes in Computer Science, Vol. 1783, 2000, pp. 22-34.
[14] Savage, P., Walters, S., Stephenson, M., “Automated Test Methodology for Operational Flight Programs,” Proceedings of IEEE Aerospace Conference, vol. 4, pp. 293 - 305, 1997.
[15] Dssouli, R., Saleh, K., Aboulhamid, E., En-Nouaary, A., Bourhfir, C., “Test Development For Communication Protocols: Towards Automation,” Computer Networks, 31, pp. 1835 – 1872, 1999.
[16] Bourhfir, C., Aboulhamid, E., Khendek, F., Dssouli, R., “Test Case Selection from SDL Specifications,” Computer Networks, 35(6), pp. 693 – 708, 2001.
[17] Holzman, G., Design and Validation of Protocols, Prentice-Hall, 1990.
[18] F. Wagner, “VFSM Executable Specification,” Proc. CompEuro, 1992, pp. 226-231.
[19] Lee, D., Lee, J., “A Well-Defined Estelle Specification for Automatic Test Generation,” IEEE Trans. on Communications, 40, pp. 526 - 542, 1991.
[20] K. Cheng, A. Krishnakumar, Automatic Functional Test Generation Using The Extended Finite State Machine Model, Proc. ACM/IEEE Design Automation Conf.,, Dallas, TX, USA, pp. 86-91, 1993.
[21] ITU-T. Recommendation Z.100 Specification and description language (SDL). International Telecommunications Union, Geneva, Switzerland, 1999.
[22] J. Dick, A. Faivre, Automating the Generation and Sequencing of Test Case from Model-Based Specification, Proc. International Symposium on Formal Methods, San Francisco, CA, USA, pp. 268-284, 1992.
[23] R. Dssouli, K. Saleh, E. Aboulhamid, A. En-Nouaary, C. Bourhfir, Test Development For Communication Protocols: Towards Automation, Computer Networks, 31, pp.1835-1872, 1999.
[24] H. Ural, K. Saleh, A.W. Williams. Test generation based on control and data dependencies within system specifications in SDL, Computer Communications 2000; 23(7): 609627.
[25] Y. Duale, M. U. Uyar. A method enabling feasible conformance test sequence generation for EFSM models. IEEE Transactions on Computers, 53(5):614–627, 2004.
[26] Vaysburg, L. Tahat, B. Korel, Dependence Analysis in Reduction of Requirement Based Test Suites, Proc. ACM International Symposium on Software Testing and Analysis, Rome, Italy, pp. 107-111, 2002.
[27] Friedman, G., Hartman, A., Nagin K., Shiran, T., “Projected State Machine Coverage for Software Testing,” Proc. of the ACM Intern. Symposium on Software Testing and Analysis, pp. 134 – 143, 2002.
[28] Heimdahl, M., Whalen, M., “Reduction and Slicing of Hierarchical State Machines,” ACM SIGSOFT Software Engineering Notes, 22(6), pp. 450 – 467, 1997.
[29] Heimdahl, M., Thompson, J., Whalen, M., “On Effectiveness of Slicing Hierarchical State Machines: A Case Study,” Proc. of the 24th Euromicro Conference, pp. 435 – 444, 1998.
[30] Oda, T., Araki, K., “Specification Slicing in Formal Methods of Software Engineering,” Proc. of the 7th Intern. Computer Software and Applications Conference, 1993.
[31] Tahat, L., Vaysburg, B., Korel, B., Bader, A., “Requirement-Based Automated Black-Box Test Generation,” Proc. of the 25th Annual IEEE Intern. Computer Software and Applications Conference (COMPSAC), pp. 489 - 495, 2001.
[32] Vaysburg, B., Tahat, L., Korel, B., Bader, A., “Automating Test Case Generation from SDL Specifications,” Proc. of 18th Intern. Conf. on Testing Computer Software, pp. 130 – 139, 2001.
[33] Vaysburg, B., Tahat, L., Korel, B., “Dependence Analysis in Reduction of Requirement Based Test Suites,” Proc. of the ACM Intern. Symposium on Software Testing and Analysis, pp. 107 – 111, 2002.
[34] Korel, B., Singh, I., Tahat, L., Vaysburg, B., "Slicing of State -Based Models," IEEE Intern. Conf. on Software Maintenance, pp. 34-43, 2003.
[35] Lyle, J., Weiser, M., “ Experiments on Slicing-based Debugging Tools,” 1st Conference on Empirical Studies of Programming, pp. 187 - 197, 1986.
[36] Korel, B., Tahat, L., Vaysburg, B., “Model Based Regression Test Reduction Using Dependence Analysis,” Proc. of the Intern. IEEE Conf. on Software Maintenance, 2002, pp. 214-223.
[37] Dick, J., Faivre, A., “Automating the Generation and Sequencing of Test Case from Model-Based Specification,” Proc. of the Industrial Strength Formal Methods, 5th Intern. Symposium on Formal Methods, pp. 268 – 284, 1992.
[38] Carver, R., H., Tai, K., C., “Use of Sequencing Constraints for Specification-Based Testing of Concurrent Programs,” IEEE Trans. on Software Engineering, 24(6), pp. 471 – 490, 1998.
[39] Apfelbaum, L., “Spec-based Tests Make Sure Telecom Software Works,” IEEE Spectrum Magazine, 34(11), pp. 77 – 83, 1997.
[40] Dalal, S., Jain, A., Karunanithi, N., Leaton, J., Lott, C., Patton, G., Horowitz, B., “Model-based Testing and Practice,” in Proc. of the Intern. Conference on Software Engineering (ICSE), pp. 185 – 194, 1999.
[41] Cheng, K., Krishnakumar, A., “Automatic Functional Test Generation Using The Extended Finite State Machine Model”, The 30th ACM/IEEE Design Automation Conf., pp. 86 – 91, 1993.
[42] Budkowski, T., Dembinski, P., “An Introduction to Estelle: A Specification Language for Distributed Systems,” Comp. Netw. & ISDN, 14(1), pp. 3-24, 1987.
[43] Luay Tahat, Bogdan Korel, Mark Harman, and Hasan Ural,"Regression test suite prioritization using system models", Journal of Software Testing, Verification, and Reliability, in press 2011.
[44] Bogdan Korel, Luay Tahat, “Understanding Modification in State-Based System”, Proceeding of the 12th IEEE International Conference on Program Comprehension (IWPC’04), London, UK, September 2004: pages:246-250.
[45] Ferrante K., Ottenstein K., Warren J., “The Program Dependence Graph and its Use in Optimization,” ACM Transactions on Programming Languages and Systems, 9(5), pp. 319 – 349, 1987.
[46] K. Androutsopoulos, et al. Control Dependence for Extended Finite State Machines. Proc. Fundamental Approaches to Soft. Eng. (FASE '09) , York, UK, 22nd-29th March, 2009. Springer LNCS volume 5503, pages 216-230.
[47] K. Androutsopoulos, N. Gold, M. Harman, Z. Li, and L. Tratt. A Theoretical and Empirical Study of EFSM Dependence. Proc. 25th IEEE International Conference on Software Maintenance (ICSM 2009), Edmonton, Alberta, Canada, 23rd-26th September 2009, pp.287-296.
[48] L. Lin, S. J. Prowell2, J. H. Poore1, "The impact of requirements changes on specifications and state machines ", Software: Practice and Experience Volume 39, Issue 6, pages 573–610, 25 April 2009.
[49] Tahat L, Korel B., Hartman M, Ural H., “Regression Test Suite Prioritization Using System Models”, Software Testing, Verification, and Reliability Journal (STRV), Wiley Inter science, special edition on Model-Based Testing, in press 2011, DOI: 10.1002/stvr.461
[50] Basili, V. R., “Viewing Maintenance as Reuse-Oriented Software Development”, IEEE Software, 7(1):19-25, 1990.