Skip to Main content Skip to Navigation
Journal articles

Automated metamorphic testing of variability analysis tools

Abstract : Variability determines the capability of software applications to be configured and customized. A common need during the development of variability-intensive systems is the automated analysis of their underlying variability models, for example, detecting contradictory configuration options. The analysis operations that are performed on variability models are often very complex, which hinders the testing of the corresponding analysis tools and makes difficult, often infeasible, to determine the correctness of their outputs, that is, the well-known oracle problem in software testing. In this article, we present a generic approach for the automated detection of faults in variability analysis tools overcoming the oracle problem. Our work enables the generation of random variability models together with the exact set of valid configurations represented by these models. These test data are generated from scratch using stepwise transformations and assuring that certain constraints (a.k.a. metamorphic relations) hold at each step. To show the feasibility and generalizability of our approach, it has been used to automatically test several analysis tools in three variability domains: feature models, common upgradeability description format documents and Boolean formulas. Among other results, we detected 19 real bugs in 7 out of the 15 tools under test
Document type :
Journal articles
Complete list of metadata

https://hal-univ-artois.archives-ouvertes.fr/hal-02380763
Contributor : Emmanuel Lonca Connect in order to contact the contributor
Submitted on : Tuesday, November 26, 2019 - 1:42:54 PM
Last modification on : Monday, March 14, 2022 - 3:14:59 PM

Links full text

Identifiers

Collections

Citation

Sergio Segura, Amador Durán, Ana B. Sánchez, Daniel Le Berre, Emmanuel Lonca, et al.. Automated metamorphic testing of variability analysis tools. Journal of : Software Testing, Verification and Reliability, Wiley, 2015, 25 (2), pp.138-163. ⟨10.1002/stvr.1566⟩. ⟨hal-02380763⟩

Share

Metrics

Record views

26