Abstract
Functional safety is becoming increasingly important in the automotive industry to deal with the growing reliance on the electrical and/or electronic (E/E) systems and the associated complexities. The introduction of ISO 26262, a new standard for functional safety in road vehicles, has made it even more important to adopt a systematic approach of evaluating functional safety. However, standard assessment methods of benchmarking functional safety of automotive systems are not available as of today. This is where the BeSafe (Benchmarking of Functional Safety) project comes into the picture. BeSafe project aims to lay the foundation for benchmarking functional safety of automotive E/E systems. In this paper, we present a brief overview of the project along with the benchmark targets that we have identified as relevant for the automotive industry, assuming three abstraction layers (model, software, hardware). We then define and discuss a set of benchmark measures. Next, we propose a benchmark framework encompassing fault/error models, methods and the required tool support. This paper primarily focuses on functional safety benchmarking from the Safety Element out of Context (SEooC) viewpoint. Finally, we present some preliminary results and highlight potential future works.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lemke, K., Paar, C., Wolf, M.: Embedded Security in Cars. Springer, Berlin (2006)
ISO Standard, http://www.iso.org/iso/catalogue_detail?csnumber=43464
Technical Safety Concept Status Report, http://www.autosar.org/download/R4.0/AUTOSAR_TR_SafetyConceptStatusReport.pdf
BeSafe Project, http://www.vinnova.se/sv/Resultat/Projekt/Effekta/BeSafe/
IEC 61508 Functional safety of electrical/electronic/programmable electronic safety-related systems, http://www.iec.ch/zone/fsafety
Kanoun, K., et al.: DBench Dependability Benchmarks. Final Project Report, Dependability Benchmarking Project (IST-2000-25425) (May 2004)
Miller, B.P., Fredriksen, L., So, B.: An empirical study of the reliability of UNIX utilities. Communications of the ACM 33(12), 32–44 (1990)
Koopman, P., Devale, K., Devale, J.: Interface Robustness Testing: Experience and Lessons Learned from the Ballista Project. In: Kanoun, K., Spainhower, L. (eds.) Dependability Benchmarking for Computer Systems, pp. 201–226. John Wiley & Sons (2008)
Mukherjee, A., Siewiorek, D.P.: Measuring software dependability by robustness benchmarking. IEEE Trans. on Software Engineering 23(6), 366–378 (1997)
Piper, T., Winter, S., Manns, P., Suri, N.: Instrumenting AUTOSAR for dependability assessment: A guidance framework. In: Proc. of the 42nd DSN 2012 (2012)
Euro NCAP, http://www.euroncap.com/home.aspx
eValue (Testing and Evaluation Methods for ICT-based Safety Systems), project ICT-2007-215607 in EU FP7, http://www.evalue-project.eu/
Explanation of Error Handling on Application Level, http://www.autosar.org/download/R4.0/AUTOSAR_EXP_ApplicationLevelError.pdf
MiBench Version 1.0, http://www.eecs.umich.edu/mibench/
Christmansson, J., Chillarege, R.: Generation of an Error Set that Emulates Software Faults – Based on Field Data. In: Proc. of the 26th Annual Int. Symposium on Fault-Tolerant Computing, FTCS 1996 (1996)
Johansson, A., Suri, N., Murphy, B.: On the Selection of Error Model(s) for OS Robustness Evaluation. In: Proc. of the 37th DSN 2007 (2007)
Skarin, D., Barbosa, R., Karlsson, J.: GOOFI-2: A tool for experimental dependability assessment. In: Proc. of the 40th DSN 2010 (2010)
Nexus 5001TM Forum, IEEE-ISTO (1999), http://www.nexus5001.org/
Barbosa, R., Vinter, J., Folkesson, P., Karlsson, J.M.: Assembly-level pre-injection analysis for improving fault injection efficiency. In: Dal Cin, M., Kaâniche, M., Pataricza, A. (eds.) EDCC 2005. LNCS, vol. 3463, pp. 246–262. Springer, Heidelberg (2005)
Svenningsson, R., Vinter, J., Eriksson, H., Törngren, M.: MODIFI: A MODel-Implemented Fault Injection Tool. In: Schoitsch, E. (ed.) SAFECOMP 2010. LNCS, vol. 6351, pp. 210–222. Springer, Heidelberg (2010)
Conrad, M.: Testing-based translation validation of generated code in the context of IEC 61508. Formal Methods in System Design 35(3), 389–401 (2009)
Conrad, M.: Verification and Validation According to ISO 26262: A Workflow to Facilitate the Development of High-Integrity Software, http://www.mathworks.com/tagteam/71300_1D-4.pdf
Di Leo, D., Ayatolahi, F., Sangchoolie, B., Karlsson, J., Johansson, R.: On the Impact of Hardware Faults - An Investigation of the Relationship between Workload Inputs and Failure Mode Distributions. In: Ortmeier, F., Daniel, P. (eds.) SAFECOMP 2012. LNCS, vol. 7612, pp. 198–209. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Islam, M.M. et al. (2013). Towards Benchmarking of Functional Safety in the Automotive Industry. In: Vieira, M., Cunha, J.C. (eds) Dependable Computing. EWDC 2013. Lecture Notes in Computer Science, vol 7869. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38789-0_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-38789-0_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38788-3
Online ISBN: 978-3-642-38789-0
eBook Packages: Computer ScienceComputer Science (R0)