Abstract
Software Product Lines (SPLs) are families of software products that can be configured and managed through a combination of features. Such products are usually represented with a Feature Model (FM). Testing the entire SPL may not be conceivable due to economical or time constraints and, more simply, because of the large number of potential products. Thus, defining methods for generating test configurations is required, and is now a very active research topic for the testing community. In this context, mutation has recently being advertised as a promising technique. Mutation evaluates the ability of the test suite to detect defective versions of the FM, called mutants. In particular, it has been shown that existing test configurations achieving the mutation criterion correlate with fault detection. Despite the potential benefit of mutation, there is no approach which aims at generating test configurations for SPL with respect to the mutation criterion. In this direction, we introduce a search-based approach which explores the SPL product space to generate product test configurations with the aim of detecting mutants.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pohl, K., Böckle, G., van der Linden, F.: Software Product Line Engineering - Foundations, Principles, and Techniques. Springer (2005)
Benavides, D., Segura, S., Cortés, A.R.: Automated analysis of feature models 20 years later: A literature review. Inf. Syst. 35(6), 615–636 (2010)
Knauber, P., Bermejo, J., Böckle, G., Sampaio do Prado Leite, J.C., van der Linden, F., Northrop, L., Stark, M., Weiss, D.M.: Quantifying product line benefits. In: van der Linden, F.J. (ed.) PFE 2002. LNCS, vol. 2290, pp. 155–163. Springer, Heidelberg (2002)
Perrouin, G., Sen, S., Klein, J., Baudry, B., Traon, Y.L.: Automated and scalable t-wise test case generation strategies for software product lines (2010)
do Carmo Machado, I., McGregor, J.D., de Almeida, E.S.: Strategies for testing products in software product lines. ACM SIGSOFT Software Engineering Notes 37(6), 1–8 (2012)
Engström, E., Runeson, P.: Software product line testing - a systematic mapping study. Information & Software Technology 53(1), 2–13 (2011)
da Mota Silveira Neto, P.A., do Carmo Machado, I., McGregor, J.D., de Almeida, E.S., de Lemos Meira, S.R.: A systematic mapping study of software product lines testing. Information & Software Technology 53(5), 407–423 (2011)
Nie, C., Leung, H.: A survey of combinatorial testing. ACM Comput. Surv. 43(2), 11 (2011)
Kuhn, D.R., Wallace, D.R., Gallo, A.M.: Software fault interactions and implications for software testing. IEEE Trans. Software Eng. 30(6), 418–421 (2004)
Petke, J., Yoo, S., Cohen, M.B., Harman, M.: Efficiency and early fault detection with lower and higher strength combinatorial interaction testing. In: ESEC/SIGSOFT FSE, pp. 26–36 (2013)
Papadakis, M., Henard, C., Traon, Y.L.: Sampling program inputs with mutation analysis: Going beyond combinatorial interaction testing. ICST (2014)
Jia, Y., Harman, M.: An analysis and survey of the development of mutation testing. IEEE Trans. Software Eng. 37(5), 649–678 (2011)
Offutt, J.: A mutation carol: Past, present and future. Information & Software Technology 53(10), 1098–1107 (2011)
Papadakis, M., Malevris, N.: Mutation based test case generation via a path selection strategy. Information & Software Technology 54(9), 915–932 (2012)
Droste, S., Jansen, T., Wegener, I.: On the analysis of the (1+1) evolutionary algorithm. Theor. Comput. Sci. 276(1-2), 51–81 (2002)
Lehre, P.K., Yao, X.: Runtime analysis of the (1 + 1) ea on computing unique input output sequences. Inf. Sci. 259, 510–531 (2014)
Henard, C., Papadakis, M., Perrouin, G., Klein, J., Heymans, P., Le Traon, Y.: Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans. Software Eng. (2014)
Harman, M., McMinn, P.: A theoretical and empirical study of search-based testing: Local, global, and hybrid search. IEEE Trans. Software Eng. 36(2), 226–247 (2010)
Mendonça, M., Branco, M., Cowan, D.D.: S.P.L.O.T.: Software product lines online tools (2009)
Henard, C., Papadakis, M., Perrouin, G., Klein, J., Traon, Y.L.: Assessing software product line testing via model-based mutation: An application to similarity testing. In: ICST Workshops, pp. 188–197 (2013)
Kaminski, G.K., Praphamontripong, U., Ammann, P., Offutt, J.: A logic mutation approach to selective mutation for programs and queries. Information & Software Technology 53(10), 1137–1152 (2011)
Biere, A.: Picosat essentials. JSAT 4(2-4), 75–97 (2008)
McMinn, P.: Search-based software test data generation: A survey. Softw. Test., Verif. Reliab. 14(2), 105–156 (2004)
Ensan, F., Bagheri, E., Gašević, D.: Evolutionary search-based test generation for software product line feature models. In: Ralyté, J., Franch, X., Brinkkemper, S., Wrycza, S. (eds.) CAiSE 2012. LNCS, vol. 7328, pp. 613–628. Springer, Heidelberg (2012)
Cohen, M.B., Dwyer, M.B., Shi, J.: Constructing interaction test suites for highly-configurable systems in the presence of constraints: A greedy approach. IEEE Trans. Software Eng. 34(5), 633–650 (2008)
Garvin, B.J., Cohen, M.B., Dwyer, M.B.: Evaluating improvements to a meta-heuristic search for constrained interaction testing 16, 61–102 (2011)
Henard, C., Papadakis, M., Perrouin, G., Klein, J., Traon, Y.L.: Multi-objective test generation for software product lines. In: SPLC, pp. 62–71 (2013)
Lopez-Herrejon, R.E., Chicano, F., Ferrer, J., Egyed, A., Alba, E.: Multi-objective optimal test suite computation for software product line pairwise testing. In: ICSM, pp. 404–407 (2013)
Xu, Z., Cohen, M.B., Motycka, W., Rothermel, G.: Continuous test suite augmentation in software product lines. In: SPLC, pp. 52–61 (2013)
Harman, M., Jia, Y., Langdon, W.B.: Strong higher order mutation-based test data generation. In: SIGSOFT FSE, pp. 212–222 (2011)
Fraser, G., Zeller, A.: Mutation-driven generation of unit tests and oracles. IEEE Trans. Software Eng. 38(2), 278–292 (2012)
Gargantini, A., Fraser, G.: Generating minimal fault detecting test suites for general boolean specifications. Information & Software Technology 53(11), 1263–1273 (2011)
Kaminski, G., Ammann, P., Offutt, J.: Improving logic-based testing. Journal of Systems and Software 86(8), 2002–2012 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Henard, C., Papadakis, M., Le Traon, Y. (2014). Mutation-Based Generation of Software Product Line Test Configurations. In: Le Goues, C., Yoo, S. (eds) Search-Based Software Engineering. SSBSE 2014. Lecture Notes in Computer Science, vol 8636. Springer, Cham. https://doi.org/10.1007/978-3-319-09940-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-09940-8_7
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09939-2
Online ISBN: 978-3-319-09940-8
eBook Packages: Computer ScienceComputer Science (R0)