Abstract
Risk-based testing has a high potential to improve the software test process as it helps to optimize the allocation of resources and provides decision support for the management. But for many organizations the integration of risk-based testing into an existing test process is a challenging task. In this paper we present a generic risk-based testing methodology and a procedure how it can be introduced in a test process. Based on this procedure we derive four stages of risk-based test integration, i.e., initial risk-based testing, risk-based test reporting, risk-based test planning, and optimization of risk-based testing. We then discuss how this procedure could be applied based on an industrial project and identify several challenges and lessons learned in introducing risk-based testing.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ISTQB: Standard glossary of terms used in software testing. Version 2.1 (2010)
Gerrard, P., Thompson, N.: Risk Based E-Business Testing. Artech House. Inc., Norwood (2002)
Felderer, M., Haisjackl, C., Breu, R., Motz, J.: Integrating Manual and Automatic Risk Assessment for Risk-Based Testing. Software Quality Days, 159–180 (2012)
Cavano, J.P., McCall, J.A.: A framework for the measurement of software quality. ACM SIGMETRICS Performance Evaluation Review 7(3-4), 133–139 (1978)
ISO: ISO/IEC 25000 Software and system engineering-Software product Quality Requirements and Evaluation (SQuaRE)-Guide to SQuaRE. International Organization for Standarization (2005)
van Veenendaal, E., Goslin, A., Olsen, K., O’Hara, F., Miller, M., Thompson, G., Wells, B.: Test Maturity Model integration (TMMi) Version 1.0, TMMi Foundation (2008)
van Veenendaal, E.: The PRISMA Approach, Uitgeverij Tutein Nolthenius (2012)
Ramler, R., Kopetzky, T., Platz, W.: Value-Based Coverage Measurement in Requirements-Based Testing: Lessons Learned from an Approach Implemented in the TOSCA Testsuite. In: 38th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2012 (2012)
Cangussu, J.W., Karcich, R.M., Mathur, A.P., DeCarlo, R.A.: Software release control using defect based quality estimation. In: 15th International Symposium on Software Reliability Engineering (2004)
Fenton, N.E., Ohlsson, N.: Quantitative analysis of faults and failures in a complex software system. IEEE Transactions on Software Engineering 26(8), 797–814 (2000)
Pfleeger, S.L.: Risky business: what we have yet to learn about risk management. Journal of Systems and Software 53(3), 265–273 (2000)
Karolak, D.W., Karolak, N.: Software Engineering Risk Management: A Just-in-Time Approach. Wiley-IEEE Computer Society Press (1995)
Amland, S.: Risk-based testing: Risk analysis fundamentals and metrics for software testing including a financial application case study. Journal of Systems and Software 53(3), 287–295 (2000)
Bach, J.: Heuristic risk-based testing. Software Testing and Quality Engineering Magazine 11, 99 (1999)
Redmill, F.: Exploring risk-based testing and its implications. Softw. Test. Verif. Reliab. 14(1), 3–15 (2004)
Redmill, F.: Theory and practice of risk-based testing: Research Articles. Softw. Test. Verif. Reliab. 15(1), 3–20 (2005)
Stallbaum, H., Metzger, A.: Employing Requirements Metrics for Automating Early Risk Assessment. In: Workshop on Measuring ss, pp. 1–12 (2007)
Ramler, R., Biffl, S., Grünbacher, P.: Value-based Management of Software Testing. In: Biffl, S., Aurum, A., Boehm, B., Erdogmus, H., Grünbacher, P. (eds.) Value-Based Software Engineering, pp. 225–244. Springer (2006)
Li, Q., Li, M., Yang, Y., Wang, Q., Tan, T., Boehm, B., Hu, C.: Bridge the Gap between Software Test Process and Business Value: A Case Study. In: Wang, Q., Garousi, V., Madachy, R., Pfahl, D. (eds.) ICSP 2009. LNCS, vol. 5543, pp. 212–223. Springer, Heidelberg (2009)
Li, Q., Yang, Y., Li, M., Wang, Q., Boehm, B., Hu, C.: Improving Software Testing Process: Feature Prioritization to Make Winners of Success-critical Stakeholders. J. Softw. Maint. Evol. Res. Pract. (2010)
Wiegers, K.E.: First things first: Prioritizing requirements. Software Development 7(10), 24–30 (1999)
Saaty, T.L.: The Analytic Hierarchy Process. McGraw-Hill (1980)
Spillner, A., Rossner, T., Winter, M., Linz, T.: Software Testing Practice: Test Management: A Study Guide for the Certified Tester Exam ISTQB Advanced Level, Rocky Nook (2007)
Black, R.: Advanced Software Testing. Guide to the ISTQB Advanced Certification as an Advanced Test Manager, vol. 2. Rocky Nook (2009)
Ahern, D., Clouse, A., Turner, R.: CMMI distilled: a practical introduction to integrated process improvement. Addison-Wesley Professional (2008)
Dorling, A.: SPICE: Software process improvement and capability determination. Software Quality Journal 2(4), 209–224 (1993)
Steiner, M., Blaschke, M., Philipp, M., Schweigert, T.: Make Test Process Assessment Similar to Software Process Assessment–the Test SPICE Approach. Journal of Software: Evolution and Process 24(5), 471–480 (2012)
Koomen, T., Pol, M.: Test process improvement: a practical step-by-step guide to structured testing. Addison-Wesley Professional (1999)
Koomen, T., van der Aalst, L., Broekman, B., Vroon, M.: TMap Next, For Result-driven Testing. UTN Publishers (2006)
Ramler, R., Larndorfer, S., Natschläger, T.: What Software Repositories Should Be Mined for Defect Predictors? In: 35th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2009 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Felderer, M., Ramler, R. (2013). Experiences and Challenges of Introducing Risk-Based Testing in an Industrial Project. In: Winkler, D., Biffl, S., Bergsmann, J. (eds) Software Quality. Increasing Value in Software and Systems Development. SWQD 2013. Lecture Notes in Business Information Processing, vol 133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35702-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-35702-2_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35701-5
Online ISBN: 978-3-642-35702-2
eBook Packages: Computer ScienceComputer Science (R0)