计算机科学 ›› 2016, Vol. 43 ›› Issue (10): 57-62.doi: 10.11896/j.issn.1002-137X.2016.10.010

• 2015 第五届全国可信计算学术会议 • 上一篇    下一篇

一种基于蜕变关系的测试与失效测试用例定位模型

惠战伟,黄松,张婷婷,刘剑豪   

  1. 解放军理工大学指挥信息系统学院软件测评中心 南京210007,解放军理工大学指挥信息系统学院软件测评中心 南京210007;解放军军事训练软件测评中心 南京210007,解放军理工大学指挥信息系统学院软件测评中心 南京210007,空军预警学院 武汉430019
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家高技术研究发展计划“863”项目(2009AA01Z402),江苏省自然科学基金项目(BK20141072,BK2012059,BK2012060)资助

Testing and Invalid Testing Case Localization Model Based on Metamorphic Relation

HUI Zhan-wei, HUANG Song, ZHANG Ting-ting and LIU Jian-hao   

  • Online:2018-12-01 Published:2018-12-01

摘要: 针对传统的蜕变测试模型MTM存在的局限性,提出了一种基于蜕变关系的测试模型MRTM。首先通过对比分析,指出了MRTM的适用范围等特点;其次,针对MTM和MRTM都面临的失效测试用例难以确定的难题,提出了一种基于可疑度计算的蜕变测试失效测试用例定位方法FTCL-MT。FTCL-MT作为对已有测试模型的补充,能够在蜕变关系不满足的情况下实现精确定位失效测试用例,从而能够为现有的故障定位技术提供支持。最后,通过实验验证了FTCL-MT方法的有效性。

关键词: 蜕变关系,测试模型,蜕变测试,失效测试用例

Abstract: Aiming at the limitations of traditional metamorphic testing model MTM,this paper proposed a testing model MRTM based on metamorphic relation.Through comparative analysis,firstly,characteristics such as scope of its application are pointed out.Secondly,in view of the problem that the invalid testing case is hard to determine that both MTM and MRTM are facing,a failed test case localization method of metamorphic testing (FTCL-MT) based on dubiety computation was proposed.As a supplement to the existing testing model,FTCL-MT is helpful to achieve precise positioning of invalid test cases in the case that CMR is not satisfied,so that it can provide support for existing fault location technologies.Finally,experiments show the effectiveness of FTCL-MT.

Key words: Metamorphic relation,Test model,Metamorphic testing,Invalid testing case

[1] Feng Jian-qiang .On the Effectiveness of Metamorphic Testing for Numerical Programs[D].The University of Hong Kong,2003
[2] Weyuker E J.On testing non-testable programs[J].The Computer Journal,1982,25(4):465-470
[3] Baresi L,Young M.Test oracles[R].Technical Report CIS-TR01-02,Department of Computer and Information Science University of Oregon,Eugene,OR,2001:9
[4] Chen T Y,Kuo Fei-ching ,Tam W K,et al.Testing a software-based PID controller using metamorphic testing[C]∥Procee-dings of the 1st International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS 2011).Vilamoura,Algarve,Portugal,2011:387-396
[5] Zhan Wei-hui,Huang Song.Achievements and Challenges ofMetamorphic Testing[C]∥2013 Fourth World Congress on Software Engineering.Hong Kong,China,2013:73-77
[6] Chen T Y,Cheung S C,Yiu S M.Metamorphic testing:a new approach for generating next test cases[R].Department of Computer Science,Hong Kong University of Science and Technology,Tech.Rep.HKUST-CS98-01,1998
[7] Chen T Y,Yu Y T.On the relationship between partition and random testing[J].IEEE Transactions on Software Enginee-ring,1994,20(12):977-980
[8] DeMillio R A,Offutt A J.Constraint-based automatic test data generation[J].IEEE Transactions on Software Engineering,1991,17(9):900-910
[9] Offutt J,Liu Shao-ying,Abdurazik A,et al.Generating test data from state-based specifications[J].Software Testing,Verification and Reliability,2003,13(1):25-53
[10] Jia Yue,Harman M.An analysis and survey of the development of mutation testing[J].IEEE Transactions on Software Engineering,2011,37(5):649-678
[11] Jones J A,Harrold M J.Empirical Evaluation of the Tarantula Automatic Fault-Localization Technique[C]∥ASE 2005.2005:273-282
[12] Wong W E,Qi Yu,Zhao Lei,et al.Effective Fault Localization using Code Coverage[C]∥ International Computer Softwrae and Applications Conference.2007:449-456
[13] Weyuker E J.The Oracle Assumption of Program Testing[C]∥Proceedings of the 13th International Conference on System Scien-ces (ICSS).Honolulu,HI,1980
[14] Baker J,Thornton J.Software engineering challenges in bioinformatics[C]∥International Conference on Software Enginee-ring.2004:12-15
[15] Xie Xiao-yuan,Ho J,Murphy C,et al.Improving the quality of computational science software by using metamorphic relations to test machine learning applications[J].Department of Computer Science Columbia University,2009,12(1):1-80
[16] Ho J W K,Lin M W,Adelstein S,et al.Erratum:customising an antibody leukocyte capture microarray for systemic lupus erythematosus:beyond biomarker discovery[J].Proteomics-Clinical Applications,2010,4(6/7):679-679
[17] Ho J W K,Stefani M,Remedios C G,et al.Differential variability analysis of gene expression and its application to human di-seases[J].Bioinformatics,2008,24:390-398
[18] Xie Xiao-yuan,Ho J W K,Murphy C,et al.Testing and validating machine learning classifiers by metamorphic testing[J].Journal of Systems and Software,2011,84(4):544-558
[19] Xie Xiao-yuan,Ho J,Murphy C,et al.Application of metamorphic testing to supervised classifiers[C]∥ International Confe-rence on Quality Software.IEEE,2010:135-144
[20] Jones J A,Harrold M J,Stasko J.Visualization of test information to assist fault localization[C]∥ICSE 2002.2002:467-477
[21] Jia Y,Harman M.A Custimizable,Runtime-Optimized Higher Order Mutation Testing Tool for the Full C Language[C]∥ Practice and Research Techniques.2008:94-98
[22] Ma Y S,Offutt J,Kwon Y R.MuJava:An Automated Class Mutation System[J].Journal of Software Testing,Verification and Reliability,2005,15(2):97-133
[23] Chen T Y,Kuo F C,Liu Ying,et al.Metamorphic Testing and Testing with Special Values[C]∥ Acis International Conference on Software Engineering,Artificial Intelligence,Networking and Parallel/Distributed Computing.2004:128-134
[24] Dong Guo-wei.Metamorphic testing techniques for error detection efficiency[D].Southeast University,2009
[25] Chen T Y,Tse T H,Zhou Zhi-quan.Semi-proving:an integrated method based on global symbolic evaluation and metamorphic testing[C]∥ACM Sigsoft Software Engineering Notes,2002,7(4):191-195
[26] Hutchins M,Foster H,Goradia T,et al.Experiments of the effectiveness of dataflow-and controlflow-based test adequacy criteria[C]∥ International Conference on Software Engineering.IEEE Computer Society Press,1994:191-200

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!