Computer Science ›› 2013, Vol. 40 ›› Issue (10): 1-9.

    Next Articles

Regression Testing Selection Techniques:A State-of-the-art Review

CHEN Xiang,GU Wei-jiang,XU Hui,GU Qing and CHEN Dao-xu   

  • Online:2018-11-16 Published:2018-11-16

Abstract: Regression test case selection(RTS)is a hot research topic in the study of regression testing.This technique aims to identify modification-revealing test cases from existing test suite.But to date,researchers in China do not systematically summarize and compare existing research work for RTS problem.This paper firstly formulated the RTS problem and its underlying assumptions based on the classification on regression testing activities and test cases.It se-condly classified existing RTS techniques into two categories:code-based RTS and model-based RTS. It further classified these code-based RTS techniques into subcategories,such as integer programming approach,data-flow analysis approach,graph-walk approach,program slicing approach,and firewall approach.It thirdly summarizd commonly-used experiment subjects and evaluation metrics.It finally suggested some potential future work of this topic.

Key words: Regression testing,Test case selection,Graph-walk approach,Program slicing,Integer programming

[1] Beizer B.Software Testing Techniques [M].New York:VanNostrand Reinhold,1990
[2] Leung H,White L.Insights into Regression Testing [C]∥Proceedings of the International Conference on Software Maintenance.1989:60-69
[3] Harrold M J,Orso A.Retesting Software during Development and Maintenance [C]∥Proceedings of Frontiers of Software Maintenance.2008:99-108
[4] Fischer K.A Test Case Selection Method for the Validation of Software Maintenance Modifications [C]∥Proceedings of International Computer Software and Applications Conference.1977:421-426
[5] Rothermel G,Harrold M J.A Framework for Evaluating Regression Test Selection Techniques [C]∥Proceedings of the International Conference on Software Engineering.1994:201-210
[6] Rothermel G,Harrold M J.Analyzing Regression Test Selection Techniques [J].IEEE Transactions on Software Engineering,1996,22(8):529-551
[7] Yoo S,Harman M.Regression Testing Minimization,Selectionand Prioritization:a Survey [J].Software Testing,Verification & Reliability,2012,22(2):67-120
[8] Fischer K,Raji F,Chruscicki A.A Methodology for RetestingModified Software [C]∥Proceedings of the National Telecommunications Conference.1981:1-6
[9] Hartmann J,Robson D J.Revalidation during the Software Maintenance Phase [C]∥Proceedings of the International Confe-rence on Software Maintenance.1989:70-80
[10] Hartmann J,Robson D J.Techniques for Selective Revalidation[J].IEEE Software,1990,7(1):31-36
[11] Harrold M J,Soffa ML.An Incremental Approach to Unit Testing during Maintenance [C]∥Proceedings of the International Conference on Software Maintenance.1988:362-367
[12] Taha A B,Thebaut S M,Liu S S.An Approach to SoftwareFault Localization and Revalidation based on Incremental Data Flow Analysis [C]∥Proceedings of the International Computer Software and Applications Conference.1989:527-534
[13] Harrold M J,Soffa M L.Interprocedual Data Flow Testing [C]∥Proceedings of the Symposium on Software Testing,Analysis,and Verification.1989:158-167
[14] Fisher M,Jin D,Rothermel G,et al.Test Reuse in the Spreadsheet Paradigm [C]∥Proceedings of the International Sympo-sium on Software Reliability Engineering.2002:257-268
[15] Rothermel G,Harrold M J.A Safe,Efficient Algorithm for Regression Test Selection [C]∥Proceedings of International Conference on Software Maintenance.1993:358-367
[16] Rothermel G,Harrold M J.Selecting Tests and Identifying Test Coverage Requirements for Modified Software [C]∥Procee-dings of International Symposium on Software Testing and Ana-lysis.1994:169-184
[17] Rothermel G,Harrold M J.A Safe,Efficient Regression TestSelection Technique [J].ACM Transactions on Software Engineering and Methodology,1997,6(2):173-210
[18] Rothermel G,Harrold M J.Experience with Regression Test Selection [J].Empirical Software Engineering:Empirical Software Engineering,1997,2(2):178-188
[19] Rothermel G,Harrold M J.Empirical Studies of a Safe Regression Test Selection Technique [J].IEEE Transactions on Software Engineering,1998,24(6):401-419
[20] Ball T.On the Limit of Control Flow Analysis for Regression Test Selection [C]∥Proceedings of the International Sympo-sium on Software Testing and Analysis.1998:134-142
[21] Rothermel G,Harrold M J,Dedhia J.Regression Test Selection for C++ Software [J].Software Testing,Verification and Reliability,2000,10(2):77-109
[22] Harrold M J,Jones J A,Li T,et al.Regression Test Selection for Java Software [C]∥Proceedings of the Conference on Object-Oriented Programming,Systems,Languages,and Applications.2001:312-326
[23] Beydeda S,Gruhn V.Integrating White- and Black-box Tech-niques for Class-level Regression Testing [C]∥Proceedings of the International Computer Software and Applications Confe-rence.2001:357-362
[24] Orso A,Shi N,Harrold M J.Scaling Regression Testing toLarge Software Systems [C]∥Proceedings of the International Symposium on Foundations of Software Engineering.2004:241-251
[25] Xu G,Rountev A.Regression Test Selection for AspectJ Software [C]∥Proceedings of the International Conference on Software Engineering.2007:65-74
[26] Zhao J,Xie T,Li N.Towards Regression Test Selection for Aspect-oriented Programs [C]∥Proceedings of the Workshop on Testing Aspect-Oriented Programs.2006:21-26
[27] Orso A,Harrold M J,Rosenblum D S,et al.Using Component Metadata to Support the Regression Testing of Component-based Software [C]∥Proceedings of the International Confe-rence on Software Maintenance.2001
[28] Orso A,Do H,Rothermel G,et al.Using Component Metadata to Regression Test Component-based Software:Research articles [J].Software Testing,Verification,and Reliability,2007,17(2):61-94
[29] Lin F,Ruth M,Tu S.Applying Safe Regression Test Selection Techniques to JAVA Web Services [C]∥Proceedings of the International Conference on Next Generation Web Services.2006:133-142
[30] Ruth M,Tu S.A Safe Regression Test Selection Technique for Web Services [C]∥Proceedings of the International Conference on Internet and Web Applications and Services.2007:47-47
[31] Ruth M,Tu S.Concurrency Issues in Automating RTS for Web Services [C]∥Proceedings of the International Conference on Web Services.2007:1142-1143
[32] Ruth M,Oh S,Loup A,et al.Towards Automatic RegressionTest Selection for Web Services [C]∥Proceedings of the International Computer Software and Applications Conference.2007:729-736
[33] Tarhini A,Fouchal H,Mansour N.Regression Testing WebServices-based Applications [C]∥Proceedings of International Conference on Computer Systems and Applications.2006:163-170
[34] Li BX,Qiu D,Leung H,et al.Automatic Test Case Selection for Regression Testing of Composite Service based on Extensible BPEL Flow Graph [J].Journal of Systems and Software,2012,85(6):1300-1324
[35] Gupta R,Harrold M J,Soffa M L.An Approach to Regression Testing using Slicing [C]∥Proceedings of the International Confe-rence on Software Maintenance.1992:299-308
[36] Gupta R,Harrold M J,Soffa M L.Program Slicing-Based Re-gression Testing Techniques [J].Software:Testing,Verification and Reliability,1996,6(2):83-111
[37] Agrawal H,Horgan J R,Krauser E W,et al.Incremental Re-gression Testing [C]∥Proceedings of the International Confe-rence on Software Maintenance.1993:348-357
[38] Bates S,Horwitz S.Incremental Program Testing using Program Dependence Graphs [C]∥Proceedings of the Symposium on Principles of Programming Languages.1993:384-396
[39] Binkley D.Reducing the Cost of Regression Testing by Semantics Guided Test Case Selection [C]∥Proceedings of the International Conference on Software Maintenance.1995:251-260
[40] Binkley D.Semantics Guided Regression Test Cost Reduction[J].IEEE Transactions on Software Engineering,1997,23(8):498-516
[41] Leung H K N,White L.A Study of Integration Testing andSoftware Regression at the Integration Level [C]∥Proceedings of the International Conference on Software Maintenance.1990:290-301
[42] White L J,Leung H K N.A Firewall Concept for both Control-flow and Data-flow in Regression Integration Testing [C]∥Proceedings of International Conference on Software Maintenance.1992:262-271
[43] White L J,Narayanswamy V,Friedman T,et al.Test Manager:A Regression Testing Tool [C]∥Proceedings of International Conference on Software Maintenance.1993:338-347
[44] Kung D C,Gao J,Hsia P,et al.Class Firewall,Test Order,and Regression Testing of Object-oriented Programs [J].Journal of Object-Oriented Programming,1995,8(2):51-65
[45] White L,Robinson B.Industrial Real-time Regression Testing and Analysis using Firewalls [C]∥Proceedings of the International Conference on Software Maintenance.2004:18-27
[46] White L,Jaber K,Robinson B,et al.Extended Firewall for Regression Testing:an Experience Report [J].Journal of Software Maintenance and Evolution,2008,20(6):419-433
[47] White L,Almezen H,Sastry S.Firewall Regression Testing of GUI Sequences and their Interactions [C]∥Proceedings of the International Conference on Software Maintenance.2003:398-409
[48] Zheng J,Robinson B,Williams L,et al.A Lightweight Process for Change Identification and Regression Test Selection in Using COTS Components [C]∥Proceedings of the International Conference on Commercial off-the-Shelf(COTS)-Based Software Systems.2006:137-146
[49] Zheng J,Robinson B,Williams L,et al.Applying RegressionTest Selection for COTS-based Applications [C]∥Proceedings of the International Conference on Software Engineering.2006:512-522
[50] Zheng J,Williams L,Robinson B.Pallino:Automation to Support Regression Test Selection for COTS-based Applications [C]∥Proceedings of the International Conference on Automated Software Engineering.2007:224-233
[51] Zheng J,Williams L,Robinson B,et al.Regression Test Selection for Black-box Dynamic Link Library Components [C]∥Proceedings of the International Workshop on Incorporating COTS Software into Software Systems:Tools and Techniques.2007:9-14
[52] Yau S S,Kishimoto Z.A Method for Revalidating Modified Programs in the Maintenance Phase [C]∥Proceedings of International Computer Software and Applications Conference.1987:272-277
[53] Benedusi P,Cmitile A,De Carlini U.Post-maintenance Testingbased on Path Change Analysis [C]∥Proceedings of the International Conference on Software Maintenance.1988:352-361
[54] Laski J,Szermer W.Identification of Program Modifications and its Applications in Software Maintenance [C]∥Proceedings of the International Conference on Software Maintenance.1992:282-290
[55] Chen Y F,Rosenblum D,Vo K P.Testtube:A System for Selective Regression Testing [C]∥Proceedings of the International Conference on Software Engineering.1994:211-220
[56] Vokolos F,Frankl P.Empirical Evaluation of the TextualDifferencing Regression Testing Technique [C]∥Proceedings of the International Conference on Software Maintenance.1998:44-53
[57] Yan S L,Chen Z Y,Zhao Z H,et al.A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information [C]∥Proceedings of the International Conference on Software Testing,Verification and Validation.2010:147-154
[58] Chen S Y,Chen Z Y,Zhao Z H,et al.Using Semi-supervised Clustering to Improve Regression Test Selection Techniques [C]∥Proceedings of the International Conference on Software Testing,Verification and Validation.2011:1-10
[59] Yoo S,Harman M.Pareto Efficient Multi-objective Test Case Selection [C]∥Proceedings of the International Symposium on Software Testing and Analysis.2007:140-150
[60] Briand L C,Labiche Y,Buist K,et al.Automating Impact Analy-sis and Regression Test Selection based on UML Designs [C]∥Proceedings of the International Conference on Software Maintenance.2002:252-261
[61] Briand L C,Labiche Y,He S.Automating Regression Test Selection based on UML Designs [J].Journal of Information and Software Technology,2009,51(1):16-30
[62] Deng D,Sheu P Y,Wang T.Model-based Testing and Maintenance [C]∥Proceedings of the International Symposium on Multimedia Software Engineering.2004:278-285
[63] Pilskalns O,Uyan G,Andrews A.Regression Testing UML Designs [C]∥Proceedings of the International Conference on Software Maintenance.2006:254-264
[64] Farooq Q,Iqbal M Z Z,Malik Z I,et al.An Approach for Selective State Machine based Regression Testing [C]∥Proceedings of the International Workshop on Advances in Model-based Testing.2007:44-52
[65] Le Traon Y,Jeron T,Jezequel J M,et al.Efficient Object-oriented Integration and Regression Testing [J].IEEE Transactions on Reliability,2000,49(1):12-25
[66] Wu Y,Offutt J.Maintaining Evolving Component-based Soft-ware with UML [C]∥Proceedings of the European Conference on Software Maintenance and Reengineering.2003:133-142
[67] Cartaxo E G,Machado P L,Neto F O.On the Use of a Similarity Function for Test Case Selection in the Context of Model-based testing [J].Software Testing,Verification & Reliability,2011,21(2):75-100
[68] Hemmati H,Briand L,Arcuri A,et al.An Enhanced Test Case Selection Approach for Model-based Testing:an Industrial Case Study [C]∥Proceedings of the International Symposium on Foundations of Software Engineering.2010:267-276
[69] Hemmati H,Arcuri A,Briand L.Empirical Investigation of the Effects of Test Suite Properties on Similarity-Based Test Case Selection [C]∥Proceedings of the International Conference on Software Testing,Verification and Validation.2011:327-336
[70] Muccini H,Dias M,Richardson D J.Reasoning about Software Architecture-based Regression Testing through a Case Study [C]∥Proceedings of the International Computer Software and Applications Conference.2005:189-195
[71] Muccini H,Dias M,Richardson D J.Software-architecture based Regression Testing [J].Journal of Systems and Software,2006,79(10):1379-1396
[72] Do H,Elbaum S,Rothermel G.Supporting Controlled Experi-mentation with Testing Techniques:An Infrastructure and its Potential Impact [J].Empirical Software Engineering,2005,10(4):405-435

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!