Skip to main content

Challenges in Evaluating SOA Test Processes

  • Conference paper
Software Process and Product Measurement (Mensura 2008, MetriKon 2008, IWSM 2008)

Abstract

Service-oriented architecture enables creation of enterprise-wide and cross-enterprise flexible, dynamic business processes and agile applications. The performance, reliability and other quality aspects of such systems, thus, become very important for the success of businesses. Testing is a way to evaluate these quality attributes. However, the new unique architecture style of SOA-based systems calls for reorienting testing procedures, methods, techniques, and tools etc. In this paper we discuss how we can evaluate efficiency and effectiveness of SOA test process. Considering an existing generic test process evaluation framework, we attempt to highlight areas where necessary adjustments to this framework are needed to care for the specialized testing perspectives of SOA-based systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Erl, T.: SOA Principles of Service Design. Prentice Hall PTR, Upper Saddle River (2007)

    Google Scholar 

  2. Stojanovic, Z., Dahanayake, A.: Service-oriented Software System Engineering Challenges and Practices. Idea Group Inc., Hershey (2005)

    Book  Google Scholar 

  3. Papazoglou, M.P., Traverso, P., Dustdar, S., Leymann, F.: Service-oriented computing: State of the art and research challenges. Computer 40(11), 38–45 (2007)

    Article  Google Scholar 

  4. Kontogiannis, K., Lewis, G.A., Smith, D.B.: A research agenda for service-oriented architecture. In: SDSOA 2008: Proceedings of the 2nd international workshop on Systems development in SOA environments, pp. 1–6. ACM, New York (2008)

    Google Scholar 

  5. Dustdar, S., Haslinger, S.: Testing of service-oriented architectures - a practical approach. In: Weske, M., Liggesmeyer, P. (eds.) NODe 2004. LNCS, vol. 3263, pp. 97–109. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  6. Ribarov, L., Manova, I., Ilieva, S.: Testing in a service-oriented world. In: InfoTech 2007: Proceedings of the International Conference on Information Technologies (2007)

    Google Scholar 

  7. Farooq, A., Schmietendorf, A., Dumke, R.R.: A quantitative evaluation framework for software test process. In: CONQUEST 2008: Proceedings of the International Conference on Quality Engineering in Software Technology, Aachen, Germany. Shaker Verlag GmbH (2008)

    Google Scholar 

  8. Canfora, G., Penta, M.D.: Testing services and service-centric systems: Challenges and opportunities. IT Professional 8(2), 10–17 (2006)

    Article  Google Scholar 

  9. Parveen, T., Tilley, S.: A research agenda for testing SOA-based systems. In: Proceeding of 2008 2nd Annual IEEE Systems Conference, pp. 1–6. IEEE Computer Society, Los Alamitos (2008)

    Chapter  Google Scholar 

  10. Lewis, G.A., Morris, E., Simanta, S., Wrage, L.: Effects of service-oriented architecture on software development lifecycle activities. Software Process: Improvement and Practice 13(2), 135–144 (2008)

    Article  Google Scholar 

  11. Linthicum, D.S., Murphy, J.: Key Strategies for SOA Testing. Mindreef Inc., Hollis (2007)

    Google Scholar 

  12. O’Brien, L., Merson, P., Bass, L.: Quality attributes for service-oriented architectures. In: SDSOA 2007: Proceedings of the International Workshop on Systems Development in SOA Environments, Washington, DC, USA, p. 3. IEEE Computer Society, Los Alamitos (2007)

    Google Scholar 

  13. Rud, D., Schmietendorf, A., Dumke, R.R.: Product metrics for service-oriented infrastructures. In: IWSM/MetriKon 2006: Proceedings of the International Workshop on Software Measurement and DASMA Software Metrik Kongress, Aachen, Germany, pp. 161–174. Shaker Verlag GmbH (2006)

    Google Scholar 

  14. Rud, D., Dumke, A.S.R.R.: Resource metrics for service-oriented infrastructures. In: SEMSOA 2007: Workshop on Software Engineering Methods for Service Oriented Architecture, pp. 90–98 (2007)

    Google Scholar 

  15. Rud, D., Mencke, S., Schmietendorf, A., Dumke, R.R.: Granularitätsmetriken für serviceorientierte architekturen. In: MetriKon 2007: Proceedings of the DASMA Software Metrik Kongress, Kaiserslautern, Germany, pp. 297–308. Shaker Verlag GmbH (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Farooq, A., Georgieva, K., Dumke, R.R. (2008). Challenges in Evaluating SOA Test Processes. In: Dumke, R.R., Braungarten, R., Büren, G., Abran, A., Cuadrado-Gallego, J.J. (eds) Software Process and Product Measurement. Mensura MetriKon IWSM 2008 2008 2008. Lecture Notes in Computer Science, vol 5338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89403-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89403-2_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89402-5

  • Online ISBN: 978-3-540-89403-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics