Abstract
Developing complex safety-critical systems usually involves developing models as abstractions in the upstream phases of design. It is still today often challenging to convince the industry that performing functional testing on models of systems may help reducing the cost of system testing. This article presents a new model-based testing process. Part of the “CONNEXION” French I&C methodology project, it combines a vast number of verification tools. In this article, we focus on the integration of a specification-based test generation tool, a model-checker and an environment for model test execution to enhance structural coverage rate. To this end, we define a novel process describing how to extend the functional test bed to enhance structural coverage by generating new test cases reaching so far uncovered branches using model-checking.
This work is founded by “CONNEXION” cluster (a project of French Investment in the Future Program) https://www.cluster-connexion.fr/.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Enoiu, E.P., Causevic, A., Ostrand, T.J., Weyuker, E.J., Sundmark, D., Pettersson, P.: Automated test generation using model-checking: an industrial evaluation. In: ICTSS 2013
Collective. Cluster CONNEXION: Spécification d’un environnement de verification de la partie contrôle-commande. Livrable 2.1.2 (2014)
Devic, C., Morilhat, P.: CONNEXION Contrôle Commande Nucléaire Numérique pour l’Export et la rénovatION—coupler génie logiciel et ingénierie système: source d’innovations. Génie Logiciel, 104:2–11, mars (2013)
Pretschner, A., Philipps, J.: 10 Methodological Issues in Model-Based Testing. In: Broy, M. et al. (eds.) Model-Based Testing of Reactive Systems, LNCS 3472, pp. 281–291 (2005)
Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing. Working Paper Series (2006)
IEC61804-2: Function blocks (FB) for process control—Part 2: Specification of FB concept, 2.0 edition (2006)
IEC61131-3: Programmable controllers—Part 3: Programming languages, 3.0 edition (2013)
IEC61513: Nuclear power plants—instrumentation and control important to safety—general requirements for systems (2011)
IEC60880: Nuclear power plants—instrumentation and control systems important to safety—software aspects for computer-based systems performing category A functions (2006)
INCOSE Systems Engineering Vision 2020. INCOSE (2007)
Fisher, A., Jacobson, C., Lee, E., Murray, R., Sangiovanni-Vincentelli, A., Scholte, E.: Industrial cyber-physical systems—icyphy. In: Proceedings of the Fourth International Conference on Complex Systems Design & Management, pp. 21–37 (2013)
Utting, M., Legeard, B.: Practical Model Based Testing: A Tools Approach. Morgan Kaufmann (2007)
Zhu, H., Hall, P.A., May, J.H.: Software unit test coverage and adequacy. ACM Comput. Surv. 29(4), 366–427 (1997)
Piwowarski, P., Ohba, M., Caruso, J.: Coverage Measurement Experience During Function Test. In: ICSE 93 Proceedings of the 15th International Conference on Software Engineering, pp. 287–301 (1993)
Geist, D., Farkas, M., Landver, A., Lichtenstein, Y., Ur, S., Wolfsthal, Y.: Coverage-directed test generation using symbolic techniques. Lect. Notes Comput. Sci. 1166, 143–158 (1996)
Ratzaby, G., Ur, S., Wolfsthal, Y.: Coverability Analysis Using Symbolic Model Checking, CHARME 2001. In: Lectured Notes in Computer Science, vol. 2144. Springer (2001)
Fantechi, A., Gnesi, S., Maggiore, A.: Enhancing Test Coverage by Back-tracking Model-checker Counterexamples. In: Electronic Notes in Theoretical Computer Science, vol. 116, pp. 199–211 (2004)
Memmi, G.: Integrated circuits analysis, system and method using model-checking. US Patent 7493247 (2009)
Rayadurgam, S., Heimdahl, M.P.: Coverage Based Test-Case Generation using Model Checkers. IEEE (2001)
Gallois, J., Pierron, J., Rapin, N.: Validation test production assistance. ICCSEA 2013
A practical guide to SysML: The Systems Modeling Language. Morgan Kaufmann/OMG Press (2011)
Gaudin, E.: Automatic test generation based on functional coverage. UCAAT (2014)
Chastrette, F., Vallee, F., Coyette, L.: Application of model-based testing to validation of new nuclear I&C architecture. ICCSEA 2013
Halbwachs, N., Caspi, P., Raymond, P., Pilaud, D.: The synchronous data-flow programming language LUSTRE. Proc. IEEE 79, 1305–1320 (1991)
Marre, B., Arnould, A.: Test Sequences generation from LUSTRE Descriptions: GATEL. In: 15th IEEE Conference on Automated SW Engineering, pp. 47–60 (2000)
LeGuen, H., Thelin, T.: Practical Experiences with Statistical Usage Testing. In: Proceedings of the Eleventh Annual International Workshop on Software Technology and Engineering Practice (STEP’04)
Neyret, M., Dormoy, F., Blanchon, J.: Méthodologie de validation des spécification fonctionnelles du contrôle-commande—Application au cas d’étude du Système de Réfrigération intermédiaire (SRI). Génie Logiciel, hors-séries:12–25, mai (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Sun, Y., Memmi, G., Vignes, S. (2016). A Model-Based Testing Process for Enhancing Structural Coverage in Functional Testing. In: Cardin, MA., Fong, S., Krob, D., Lui, P., Tan, Y. (eds) Complex Systems Design & Management Asia. Advances in Intelligent Systems and Computing, vol 426. Springer, Cham. https://doi.org/10.1007/978-3-319-29643-2_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-29643-2_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-29642-5
Online ISBN: 978-3-319-29643-2
eBook Packages: EngineeringEngineering (R0)