Skip to main content

Quality in Use Evaluation of a GraphQL Implementation

  • Conference paper
  • First Online:
Emerging Research in Intelligent Systems (CIT 2021)

Abstract

The software development trend uses service-oriented software architecture (SOA), which provides efficiency, agility, and ease of growth. The architectural design most commonly used in SOA application development is REST (Representational State Transfer); however, some data management problems have been identified in its Application Programming Interface called API-REST. Several technological options have emerged to appease these problems, such as SPARQL, Cypher, Gremlin, and the most popular GraphQL. GraphQL was developed by Facebook in 2012 and released in 2015 to the community as an open-source project, used by companies such as GitHub, Airbnb, Amazon, Apollo, IBM, and Facebook. The goal of this research is to demonstrate whether GraphQL implementations work. Therefore, we based the research design on Design Science Research (DSR) to evaluate the quality-in-use of a GraphQL implementation that automated the systematic mapping studies (SMS) process for technology researchers at Universidad Técnica del Norte - Ecuador. We used the ISO/IEC 25000 series of standards to evaluate the quality in use; the results showed that the implementation met 84.11% of the established quality model’s expected value. The detailed evaluation by quality characteristics was: Effectiveness 96.62%, Efficiency 78.90%, and Satisfaction 70.26%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A systematic literature review (SLR) is a means of identifying, analyzing, and interpreting reported evidence related to a set of specific research questions [12].

  2. 2.

    Cypher is Neo4j’s graph query language [22].

  3. 3.

    The System Usability Scale (SUS) provides a “quick and dirty", reliable tool for measuring the usability [26].

  4. 4.

    RStudio is an integrated development environment (IDE) for R, a programming language for statistical computing and graphics [27].

References

  1. Tsai, W.T., Bai, X.Y., Huang, Y.: Software-as-a-service (SaaS): perspectives and challenges. Sci. China Inf. Sci. 57(5), 1–15 (2014)

    Article  Google Scholar 

  2. Mell, P.M., Grance, T.: The NIST Definition of Cloud Computing. Technical report, National Institute of Standards and Technology, Gaithersburg (2011)

    Google Scholar 

  3. Marston, S., Li, Z., Bandyopadhyay, S., Zhang, J., Ghalsasi, A.: Cloud computing - the business perspective. Decis. Support Syst. 51(1), 176–189 (2011)

    Article  Google Scholar 

  4. Bogner, J., Zimmermann, A.: Towards integrating microservices with adaptable enterprise architecture. In: Proceedings - IEEE International Enterprise Distributed Object Computing Workshop, EDOCW, vol. 2016, September, pp. 158–163. Springer, Toronto (2016)

    Google Scholar 

  5. Han, H., et al.: A RESTful approach to the management of cloud infrastructure. In: CLOUD 2009 - 2009 IEEE International Conference on Cloud Computing, pp. 139–142 (2009)

    Google Scholar 

  6. Vogel, M., Weber, S., Zirpins, C.: Experiences on migrating RESTful web serVICES to GraphQL. In: Braubach, L., et al. (eds.) ICSOC 2017. LNCS, vol. 10797, pp. 283–295. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91764-1_23

  7. Seifer, P., Härtel, J., Leinberger, M., Lämmel, R., Staab, S.: Empirical study on the usage of graph query languages in open source Java projects. In: SLE 2019 - Proceedings of the 12th ACM SIGPLAN International Conference on Software Language Engineering, co-located with SPLASH 2019, pp. 152–166, Athens, October 2019. Association for Computing Machinery, Inc

    Google Scholar 

  8. The GraphQL Foundation. GraphQL (2018)

    Google Scholar 

  9. GraphQL Foundation. GraphQL Foundation (2019)

    Google Scholar 

  10. Maedche, A., Hevner, A., Hutchison, D.: Designing the digital transformation. International Conference on Design Science Research in Information System and Technology, vol. 10243, pp. 231–246. Springer, Kristiansand (2017). https://doi.org/10.1007/978-3-319-59144-5

  11. Hevner, A., Chatterjee, S.: Design science research in information systems. In: Design Research in Information Systems. Integrated Series in Information Systems, 39 edn., vol. 22, pp. 9–22. Springer, Boston (2010). https://doi.org/10.1007/978-1-4419-5653-8_2

  12. Kitchenham, B., Brereton, P.: A systematic review of systematic review process research in software engineering. Inf. Softw. Technol. 55(12), 2049–2075 (2013)

    Article  Google Scholar 

  13. Seda, P., Masek, P., Sedova, J., Seda, M., Krejci, J., Hosek, J.: Efficient architecture design for software as a service in cloud environments. In: 10th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops, ICUMT 2018, pp. 317–322, Moscow, November 2018. IEEE Computer Society

    Google Scholar 

  14. Klein, U., Namjoshi, K.S.: Formalization and automated verification of RESTful behavior. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 541–556 (2011). Springer, Heidelberg. https://doi.org/10.1007/978-3-642-22110-1_43

  15. Byron, L.: GraphQL: A data query language - Facebook Code (2015)

    Google Scholar 

  16. Bryant, M.: GraphQL for archival metadata: an overview of the EHRI GraphQL API. In: Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017, vol. 2018, January, pp. 2225–2230, Boston, December 2017. Institute of Electrical and Electronics Engineers Inc

    Google Scholar 

  17. Schwaber, K., Sutherland, J.: The Definitive Guide to Scrum: The Rules of the Game. Scrum.org (2020)

  18. Petersen, K., Vakkalanka, S., Kuzniarz, L.: Guidelines for conducting systematic mapping studies in software engineering: an update. Inf. Softw. Technol. 64, 1–18 (2015)

    Article  Google Scholar 

  19. Petersen, K., Feldt, R., Mujtaba, S., Mattsson, M.: Systematic mapping studies in software engineering. In: 12th International Conference on Evaluation and Assessment in Software Engineering, EASE 2008, p. 11, Bari. BCS Learning and Development Ltd. (2008)

    Google Scholar 

  20. Galindo, J.A., Benavides, D., Trinidad, P., Gutiérrez-Fernández, A.-M., Ruiz-Cortés, A.: Automated analysis of feature models: Quo vadis? Computing 101(5), 387–433 (2018). https://doi.org/10.1007/s00607-018-0646-1

    Article  MathSciNet  Google Scholar 

  21. ISO/IEC. NTE INEN-ISO/IEC 25000 ISO/IEC 25000: 2014 Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Guide to SQuaRE. International Organization for Standardization, 2 edn. (2014)

    Google Scholar 

  22. Neo4j. Cypher Query Language - Developer Guides (2020)

    Google Scholar 

  23. GRANDstack. neo4j-graphql.js. User Guide—GRANDstack (2021)

  24. ISO/IEC. NTE INEN-ISO/IEC 25010. International Organization for Standardization, 1 edn. (2015)

    Google Scholar 

  25. ISO/IEC. Systems and software engineering - Systems and software quality requirements and evaluation (SQuaRE) - Measurement of quality in use, vol. 1. International Organization for Standardization, 1 edn., Geneva (2016)

    Google Scholar 

  26. Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013)

    Google Scholar 

  27. Mhairi McNeill. About RStudio - RStudio (2020)

    Google Scholar 

  28. Sijtsma, K.: On the use, the misuse, and the very limited usefulness of cronbach’s alpha. Psychometrika 74(1), 107–120 (2009)

    Article  MathSciNet  Google Scholar 

  29. Juan Mendoza. RPubs - Alfa de Cronbach - Psicometría con R (2018)

    Google Scholar 

  30. Tóth-Király, I., Orosz, G., Dombi, E., Jagodics, B., Farkas, D., Amoura, C.: Cross-cultural comparative examination of the academic motivation Scale using exploratory structural equation modeling. Pers. Individ. Differ. 106, 130–135 (2017)

    Article  Google Scholar 

  31. Knutas, A., Hajikhani, A., Salminen, J., Ikonen, J., Porras, J.: Cloud-based bibliometric analysis service for systematic mapping studies. In: ACM International Conference Proceeding Series, vol. 1008, pp. 184–191 (2015)

    Google Scholar 

  32. Kohl, C., et al.: Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools. Environ. Evid. 7(1), 1–17 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antonio Quiña-Mera .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Quiña-Mera, A., Fernández-Montes, P., García, J.M., Bastidas, E., Ruiz-Cortés, A. (2022). Quality in Use Evaluation of a GraphQL Implementation. In: Botto-Tobar, M., Cruz, H., Díaz Cadena, A., Durakovic, B. (eds) Emerging Research in Intelligent Systems. CIT 2021. Lecture Notes in Networks and Systems, vol 405. Springer, Cham. https://doi.org/10.1007/978-3-030-96043-8_2

Download citation

Publish with us

Policies and ethics