Combinatorial First Order Polynomial Coverage Based Test Suites Prioritization for Improving Software System Quality

Main Article Content

M.Bharathi Mathankumar

Abstract

Combinatorial Testing (CT) is performed to ensure the development of a software system quality. In CT, many research works has been designed for test suite minimization. But, existing test suite minimization techniques does not covers the more number of test cases for detecting the maximum faults in software programs. Therefore, there is a requirement for new test suite minimization technique for improving software system quality with higher number of test cases. To optimize the order of interactions being tested and to reduce the number of test suites generated best in terms of coverage, Combinatorial First Order Polynomial Coverage Based Prioritization (CFOP-CP) technique is proposed. For monitoring the order of interactions at time interval ‘ t ’ and time interval ‘ t-1 ’, First Order Polynomial (FOP) function is used. Therefore, FOP function predicts the faults interactions in software program efficiently which resulting in higher fault interaction prediction accuracy. After that, Coverage-based Test Suites Prioritization is performed to prioritize test suites best in terms of coverage and therefore provides global coverage for finding faults in software programs. Finally, Similarity-based Test Suite Selection is performed to reduce the number of test suites for detecting maximum number of faults in software programs which in turn helps for improving the software system quality. The CFOP-CP technique conducts the experimental works on parameters such as fault interaction prediction accuracy, testing cost and coverage rate. The experimental result shows that the CFOP-CP technique is able to improve the coverage rate for software fault detection and also reduces the testing cost for improving the software system quality when compared to state-of-the-art-works.

Keywords: Combinatorial Testing, Test Suite, Fault Interaction, Coverage, Test Cases, Prioritization

Downloads

Download data is not yet available.

Article Details

Section
Articles
Author Biography

M.Bharathi Mathankumar, Periyar University

computer science

References

Wei Zheng, Xiaoxue Wu, Desheng Hu, and Qihai Zhu, “Locating Minimal Fault Interaction in Combinatorial Testingâ€, Hindawi Publishing Corporation, Advances in Software Engineering, Volume 2016, Article ID 2409521, Pages 1-10, 2016

Bestoun S. Ahmed, “Test case minimization approach using fault detection and combinatorial optimization techniques for configuration-aware structural testingâ€, Engineering Science and Technology, an International Journal, Elsevier, Volume 19, Issue 2, Pages 737–753, June 2016

Bestoun S. Ahmed, Taib Sh. Abdulsamad and Moayad Y. Potrus, “Achievement of Minimized Combinatorial Test Suite for Configuration-Aware Software Functional Testing Using the Cuckoo Search Algorithmâ€, Information and Software Technology, Volume 66, Pages 13-29, Oct 2015

Sangeeta Sabharwal, Manuj Aggarwal, “A novel approach for deriving interactions for combinatorial testingâ€, Engineering Science and Technology, an International Journal, Elsevier, Volume 20, Pages 59–71, 2017

Ana Emilia Victor Barbosa Coutinho, Emanuela Gadelha Cartaxo, Patricia Duarte de Lima Machado, “Analysis of distance functions for similarity-based test suite reduction in the context of model-based testingâ€, Software Quality Journal, Volume 24, Issue 2, Pages 407–445, June 2016

T. Prem Jacob and T. Ravi, “Optimization of Test Cases by Prioritizationâ€, Journal of Computer Science, Volume 9, Issue 8, Pages 972-980, 2013

Chuanyang Ruan and Jianhui Yang, “Software Quality Evaluation Model Based on Weighted Mutation Rate Correction Incompletion G1 Combination Weightsâ€, Hindawi Publishing Corporation, Mathematical Problems in Engineering, Volume 2014, Article ID 541292, Pages 1-9, 2014

Renée C. Bryce, Sreedevi Sampath, Jan B. Pedersen, Schuyler Manchester, “Test suite prioritization by cost-based combinatorial interaction coverageâ€, International Journal of System Assurance Engineering and Management, Springer, June 2011, Volume 2, Issue 2, Pages 126–134

Chunrong Fang, Zhenyu Chen, Zhihong Zhao, “Similarity-based test case prioritization using ordered sequences of program entitiesâ€, Software Quality Control, Volume 22, Issue 2, Pages 335–361, June 2014

Hadi Hemmati, Andrea Arcuri, Lionel Briand, “Achieving Scalable Model-Based Testing Through Test Case Diversityâ€, ACM Transactions on Software Engineering and Methodology, Volume 22, Issue 1, Pages 1-42, February 2013

Shilpi Singh, Raj Shree, “An Analysis of Test Suite Minimization Techniquesâ€, international Journal of Engineering Sciences and Research Technology, Volume 5, Pages 252-260, 2016

Avinash Gupta, Nayneesh Mishra, Aprna Tripathi, Manu Vardhan, Dharmender Singh Kushwaha, “An Improved History-Based Test Prioritization Technique Using Code Coverageâ€, Advanced Computer and Communication Engineering Technology, Pages 437-448, 2014

Xiaofang QI , Junhe, Peng Wang, Huayang Zhou, “Variable strength combinatorial testing of concurrent programsâ€, Springer, Frontiers of Computer Science, Volume 10, Issue 4, Pages 631–643, August 2016

Sangeeta Sabharwal, Priti Bansal, Nitish Mittal, Shreya Malik, “Construction of Mixed Covering Arrays for Pair-wise Testing Using Probabilistic Approach in Genetic Algorithmâ€, Arabian Journal for Science and Engineering, Springer, Volume 41, Issue 8, Pages 2821–2835, August 2016

Justyna Petke, Myra B. Cohen, Mark Harman, and Shin Yoo, “Practical Combinatorial Interaction Testing: Empirical Findings on Efficiency and Early Fault Detectionâ€, IEEE Transactions on Software Engineering, Volume 41, Issue 9, Pages 901 – 924, 2015

Qiang He, Jun Yan, Hai Jin and Yun Yang, “Quality-Aware Service Selection for Service-Based Systems Based on Iterative Multi-Attribute Combinatorial Auctionâ€, IEEE Transactions On Software Engineering, Volume 40, Issue 2, Pages 192-215, February 2014

Beatriz Perez Lamancha, Macario Polo, Mario Piattini, “PROW: A Pairwise algorithm with constraints, Order and Weightâ€, The Journal of Systems and Software, Elsevier, Volume 99, Pages 1–19, 2015

Pragya Agarwal, Arun Prakash Agrawal, “Fault-Localization Techniques for Software Systems: A Literature Reviewâ€, ACM SIGSOFT Software Engineering, Volume 39, Issue 5, Pages 1-8, September 2014

Hui He, Lei Zhao, Qiao Li, Weizhe Zhang, Dongmin Gao and Yongtan Liu, “Fault Localization Method of Software Defects based on Dependencies Analysis of Program Structureâ€, International Journal of Security and Its Applications, Volume 7, Issue 3, Pages 413- 422, May 2013

Xiaobing Sun, Xin Peng Bin, LiBixin Li, Wanzhi Wen, “IPSETFUL: an iterative process of selecting test cases for effective fault localization by exploring concept lattice of program spectraâ€, Frontiers of Computer Science, Springer, Volume 10, Issue 5, Pages 812–831, October 2016