Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 557-561.doi: 10.11896/jsjkx.200200015

• Software Engineering • Previous Articles     Next Articles

Hierarchical Classification Model for Metamorphic Relations of Scientific Computing Programs

YANG Xiao-hua, YAN Shi-yu, LIU Jie, LI Meng   

  1. 1 Computer School,University of South China,Hengyang,Hunan 421001,China
    2 Intelligent Equipment Software Evaluation Engineering Technology Research Center of Hunan,Hengyang,Hunan 421001,China
    3 CNNC Key Laboratory on High Trusted Computing,Hengyang,Hunan 421001,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:YANG Xiao-hua,born in 1963,Ph.D,professor,Ph.D supervisor.His main research interests include trusted computing and software quality.
    YAN Shi-yu,born in 1981,Ph.D,lectu-rer.His main research interests include numerical calculation and software testing.
  • Supported by:
    This work was supported by the National Science and Technology Major Special Subproject (2019ZX06005001) and Natural Science Foundation of Hunan Province (2020JJ4519).

Abstract: Metamorphic testing is an effective way to solve the Oracle test problem,the key of which is the discovery of metamorphic relations.By analyzing the research and development process of scientific computing programs,this paper puts forward the concepts of physical model metamorphic relations,computing model metamorphic relations and code model metamorphic relations,defines the hierarchical structure of three kinds of metamorphic relations,establishes the hierarchical classification model of metamorphic relations,and discusses its application prospect in the research of discovery method on metamorphic relations.

Key words: Classification model, Metamorphic relations, Metamorphic test, Scientific computing program

CLC Number: 

  • TP311
[1] WANG R L,LIN Z,YUAN G X.Verification and Validation in Scientific Computing Code [J].Transactions ofBeijing Institute of Technology,2010,30(3):353-356,360.
[2] DONG G W,XU B W,CHEN L,et al.Survey of Metamorphic testing[J].Journal of Frontiers of Computer Science and Technology,2009,3(2):130-143.
[3] DING J,ZHANG D,HU X H.An application of metamorphic testing for testing scientific software[C]//Proceedings of the 1st International Workshop on Metamorphic Testing.ACM,2016:37-43.
[4] CHEN T Y,KUO F C,LIU H,et al.Metamorphic testing:A review of challenges and opportunities[J].ACM Computing Surveys (CSUR),2018,51(1):4.
[5] LIU H,KUO F C,TOWEY D,et al.How effectively does metamorphic testing alleviate the oracle problem?[J].IEEE Transactions on Software Engineering,2014,40(1):4-22.
[6] HUI Z W,HUANG S,LI H,et al.Measurable Metrics for Qualitative Guidelines of Metamorphic Relation[C]//IEEECompu-ter Software and Applications Conference.2015:417-422.
[7] CHEN T Y,KUO F C,LIU Y,et al.Metamorphic Testing and Testing with Special Values[C]//Acis International Conference on Software Engineering,Artificial Intelligence,Networking,and Parallel/distributed Computing.2004:128-134.
[8] MAYER J,GUDERLEI R.An Empirical Study on the Selection of Good Metamorphic Relations[C]//Computer Software and Applications Conference,2006(COMPSAC'06).International,2006:475-484.
[9] SRINIVASAN M,SHAHRI M P,KAHANDA I,et al.Quality assurance of bioinformatics software:a case study of testing a biomedical text processing tool using metamorphic testing[C]//Proceedings of the 3rd International Workshop on Metamorphic Testing.ACM,2018:26-33.
[10] ZHOU Z Q,XIANG S,CHEN T Y.Metamorphic testing for software quality assessment:A study of search engines[J].IEEE Transactions on Software Engineering,2016,42(3):264-284.
[11] CHEN S K,TODREAS N E,NGUYEN N T.Evaluation of existing correlations for the prediction of pressure drop in wire-wrapped hexagonal array pin bundles[J].Nuclear Engineering and Design,2014,267:109-131.
[12] KANEWALA U,BIEMAN J M,BEN-HUR A.Predicting metamorphic relations for testing scientific software:a machine learning approach using graph kernels[J].Software Testing Verification & Reliability,2016,26(3):245-269.
[13] LINDVALL M,GANESAN D,ÁRDAL R,et al.Metamorphicmodel-based testing applied on NASA DAT:an experience report[C]//Proceedings of the 37th International Conference on Software Engineering.IEEE Press,2015:129-138.
[14] CHEN T Y,CHEUNG S C,YIU S M.Metamorphic testing:a new approach for generating next test cases.Technical Report HKUST-CS98-01[R].Hong Kong:University of Science and Technology,1998.
[15] YANG X H,YAN S Y,LI M,et al.Verification method of metamorphic test on neutron diffusion program based on benchmark problem[J].Atomic Energy Science and Technology,2017,51(7):1239-1243.
[16] HUANG S,DING R H,LI H,et al.Research on metamorphic testing of slope and aspect calculating programs[J].Journal of Computer Applications,2013,33(6):1657-1745.
[17] QIU S T,ZHANG Z X.Metamorphic Testing of Ordinary Differential Equations Program[J].Ship Electronic Engineering,2016,36(12):29-33.
[18] SIM K Y,PAO W K S,LIN C.Metamorphic testing using geometric interrogation technique and its application[J].ECTI Transactions on Computer and Information Technology,2005,1(2):91-95.
[19] TROYA J,SEGURA S,RUIZ-CORTÉS A.Automated infer-ence of likely metamorphic relations for model transformations[J].Journal of Systems and Software,2018,136:188-208.
[20] LIU J L,YAO Y,HUANG S,et al.Metamorphic TestingFramework for Machine Learning Image Classification Program[J/OL].Computer Engineering and Applications.http://kns.cnki.net/kcms/detail/11.2127.TP.20190918.1146.015.html.
[21] DING J,WU T,WU D,et al.Metamorphic testing of a Monte Carlo modeling program[C]//International Workshop on Automation of Software Test.ACM,2011.
[22] YAN S Y,YANG X H,CHENG G D,et al.Richardson Extrapolation-Based Verification Method of Scientific Calculation Program without the Oracles:A Case Study[J].Mathematical Problems in Engineering,2019,2019(11):1-9.
[23] ZHANG X L,DING L,HOU X M,et al.Method of Metamorphic Relations Constructing for Object-oriented Software Testing [J].Computer Science,2017,44(S2):485-489,515.
[24] CHEN T Y,FENG J,TSE T H.Metamorphic testing of programs on partial differential equations:a case study[C]//Proceedings 26th Annual International Computer Software and Applications.IEEE,2002:327-333.
[25] CHEN T Y,KUO F C,TSE T H,et al.Metamorphic testing and beyond[C]//Eleventh Annual International Workshop on Software Technology and Engineering Practice.IEEE,2003:94-100.
[26] RAHMAN K,KANEWALA U.Predicting metamorphic rela-tions for matrix calculation programs[C]//Proceedings of the 3rd International Workshop on Metamorphic Testing.ACM,2018:10-13.
[27] OFFUTT J,MA Y S,KWON Y R.An experimental mutation system for Java[J].ACM SIGSOFT Software Engineering Notes,2004,29(5):1-4.
[28] ZHANG J,HU X G,ZHAGN B.Test approach for the program of clusters based on metamorphic relations[J].Journal of Electronic Measurement and Instrument,2011,25(8):688-694.
[29] MURPHY C,SHEN K,KAISER G.Automatic system testing of programs without test oracles[C]//Proceedings of the Eighteenth International Symposium on Software Testing and Analysis.ACM,2009:189-200.
[30] HUI Z,HUANG S,REN Z,et al.Metamorphic testing integer overflow faults of mission critical program:A case study[J].Mathematical Problems in Engineering,2013,2013(5):1-8.
[31] YANG X H,YAN S Y,WU Q J,et al.Dynamic discovery method for likely metamorphic relations[J].Application Research of Computers,2018,35(SP):258-259.
[32] ZHANG J,CHEN J,HAO D,et al.Search-based inference ofpolynomial metamorphic relations[C]//Proceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering.ACM,2014:701-712.
[33] SU F H,BELL J,MURPHY C,et al.Dynamic Inference ofLikely Metamorphic Properties to Support Differential Testing[C]//2015 IEEE/ACM 10th International Workshop on Automation of Software Test (AST).ACM,Piscataway,NJ,USA:IEEE Press,2015:55-59.
[34] FAN C,YANG X H,YAN S Y,et al.Design of a Dynamic Discovery Tool for Likely Metamorphic Relation[J].Journal of University of South China(Science and Technology),2018,32(2):81-86.
[1] GONG Kou-lin, ZHOU Yu, DING Li, WANG Yong-chao. Vulnerability Detection Using Bidirectional Long Short-term Memory Networks [J]. Computer Science, 2020, 47(5): 295-300.
[2] GAO Nan,LI Li-juan,Wei-william LEE,ZHU Jian-ming. Keywords Extraction Method Based on Semantic Feature Fusion [J]. Computer Science, 2020, 47(3): 110-115.
[3] LI Yun-chou,YIN Ping. Research of Model Checking Application on Aerospace TT&C Software [J]. Computer Science, 2018, 45(6A): 523-526.
[4] ZHANG Xing-long, YU Lei, HOU Xue-mei and HOU Shao-fan. Method of Metamorphic Relations Constructing for Object-oriented Software Testing [J]. Computer Science, 2017, 44(Z11): 485-489.
[5] ZHANG Jun and WANG Su-ge. Cross-domain Sentiment Classification Based on Optimizing Classification Model Progressively [J]. Computer Science, 2016, 43(7): 234-239.
[6] HUI Zhan-wei, HUANG Song, ZHANG Ting-ting and LIU Jian-hao. Testing and Invalid Testing Case Localization Model Based on Metamorphic Relation [J]. Computer Science, 2016, 43(10): 57-62.
[7] CUI Min-jun, DUAN Li-guo and LI Ai-ping. Research on Multi-features Hierarchical Answer Quality Evaluation Method [J]. Computer Science, 2016, 43(1): 94-97.
[8] WANG Feng-jiao, TIAN Mei, HUANG Ya-ping and AI Li-hua. Classification Model of Visual Attention Based on Eye Movement Data [J]. Computer Science, 2016, 43(1): 85-88.
[9] LI Wei-yin, SHI Yu-long, CHEN Jie and SHI Chong-yang. Query Expansion Based on Classification Model [J]. Computer Science, 2015, 42(6): 18-22.
[10] . Researches on Basic Criterion and Strategy of Constructing Metamorphic Relations [J]. Computer Science, 2012, 39(1): 115-119.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!