Skip to main content

Increasing Precision of Automatically Generated Trace Links

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2019)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 11412))

Abstract

[Context and Motivation] In order to use automatically created trace links during a project directly, the precision of the links is essential. Our interaction-based trace link creation approach (IL) utilizes the interactions of developers recorded in an integrated development environment (IDE) while working on a requirement. For this, developers need to indicate the requirement they are going to work on before coding. This approach worked well in an open-source project with developers who were interested in the interaction logs, but did not work well with students who were not particularly motivated to trigger the interaction recording. [Question/problem] Developers often create trace links themselves by providing issue identifiers (IDs) in commit messages. This causes little effort and does not require the awareness for interaction recording. However, as confirmed by recent research, typically only 60% of the commits are linked. In this paper, we study whether and how IL can be improved by a combination with links created by issue IDs in commit messages. [Principal ideas/results] We changed our approach so that interaction logs are associated with requirements based on the IDs in the commit-messages. Thus, developers do not need to manually associate requirements and interaction logs. We performed a new student study with this approach. [Contribution] In this new study, we show that with this new approach and link improvement techniques precision is above 90% and recall is almost 80%. We also show that for our data this is better than using commit-messages only and better than the often used information retrieval-based approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://se.ifi.uni-heidelberg.de/il.html, tool and data download.

  2. 2.

    https://www.atlassian.com/software/jira.

  3. 3.

    https://www.jetbrains.com/webstorm/.

  4. 4.

    https://www.mongodb.com/.

  5. 5.

    https://reactjs.org/.

  6. 6.

    https://pypi.org/project/googletrans/.

References

  1. Baeza-Yates, R., de Ribeiro, B.A.N.: Modern Information Retrieval, 2nd edn. Pearson Addison-Wesley, Boston (2011)

    Google Scholar 

  2. Bird, C., Rigby, P.C., Barr, E.T., Hamilton, D.J., Germán, D.M., Devanbu, P.T.: The promises and perils of mining git. In: MSR (2009)

    Google Scholar 

  3. Borg, M., Runeson, P., Ardö, A.: Recovering from a decade: a systematic mapping of information retrieval approaches to software traceability. ESE 19(6), 1565–1616 (2013)

    Google Scholar 

  4. Briand, L., Falessi, D., Nejati, S., Sabetzadeh, M., Yue, T.: Traceability and SysML design slices to support safety inspections. ToSEM 23(1), 9 (2014)

    Article  Google Scholar 

  5. Cleland-Huang, J., Gotel, O.C.Z., Huffman Hayes, J., Mäder, P., Zisman, A.: Software traceability: trends and future directions. In: ICSE/FOSE. ACM (2014)

    Google Scholar 

  6. De Lucia, A., Fasano, F., Oliveto, R., Tortora, G.: Recovering traceability links in software artifact management systems using information retrieval methods. ToSEM 16(4), 13 (2007)

    Article  Google Scholar 

  7. Ebner, G., Kaindl, H.: Tracing all around in reengineering. IEEE Softw. 19(3), 70–77 (2002)

    Article  Google Scholar 

  8. Hayes, J., Dekhtyar, A., Sundaram, S.: Advancing candidate link generation for requirements tracing: the study of methods. TSE 32(1), 4–19 (2006)

    Google Scholar 

  9. Herzig, K., Zeller, A.: The impact of tangled code changes. In: MSR. IEEE (2013)

    Google Scholar 

  10. Hübner, P., Paech, B.: Using interaction data for continuous creation of trace links between source code and requirements in issue tracking systems. In: Grünbacher, P., Perini, A. (eds.) REFSQ 2017. LNCS, vol. 10153, pp. 291–307. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54045-0_21

    Chapter  Google Scholar 

  11. Hübner, P., Paech, B.: Evaluation of techniques to detect wrong interaction based trace links. In: Kamsties, E., Horkoff, J., Dalpiaz, F. (eds.) REFSQ 2018. LNCS, vol. 10753, pp. 75–91. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-77243-1_5

    Chapter  Google Scholar 

  12. Kersten, M., Murphy, G.C.: Using task context to improve programmer productivity. In: SIGSOFT/FSE. ACM (2006)

    Google Scholar 

  13. Kirinuki, H., Higo, Y., Hotta, K., Kusumoto, S.: Hey! Are you committing tangled changes? In: ICPC. ACM (2014)

    Google Scholar 

  14. Konopka, M., Navrat, P., Bielikova, M.: Poster: discovering code dependencies by harnessing developer’s activity. In: ICSE. ACM (2015)

    Google Scholar 

  15. Maalej, W., Kurtanovic, Z., Felfernig, A.: What stakeholders need to know about requirements. In: EmpiRE. IEEE (2014)

    Google Scholar 

  16. Mäder, P., Egyed, A.: Do developers benefit from requirements traceability when evolving and maintaining a software system? Empir. SE 20(2), 413–441 (2015)

    Article  Google Scholar 

  17. Maro, S., Anjorin, A., Wohlrab, R., Steghöfer, J.: Traceability maintenance: factors and guidelines. In: ASE (2016)

    Google Scholar 

  18. Merten, T., Falisy, M., Hübner, P., Quirchmayr, T., Bürsner, S., Paech, B.: Software feature request detection in issue tracking systems. In: IEEE RE Conference (2016)

    Google Scholar 

  19. Merten, T., Krämer, D., Mager, B., Schell, P., Bürsner, S., Paech, B.: Do information retrieval algorithms for automated traceability perform effectively on issue tracking system data? In: Daneva, M., Pastor, O. (eds.) REFSQ 2016. LNCS, vol. 9619, pp. 45–62. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-30282-9_4

    Chapter  Google Scholar 

  20. Omoronyia, I., Sindre, G., Roper, M., Ferguson, J., Wood, M.: Use case to source code traceability: the developer navigation view point. In: IEEE RE Conference (2009)

    Google Scholar 

  21. Omoronyia, I., Sindre, G., Stalhane, T.: Exploring a Bayesian and linear approach to requirements traceability. IST 53(8), 851–871 (2011)

    Google Scholar 

  22. Rath, M., Rempel, P., Mäder, P.: The IlmSeven dataset. In: RE Conference (2017)

    Google Scholar 

  23. Rath, M., Rendall, J., Guo, J.L.C., Cleland-Huang, J., Mäder, P.: Traceability in the wild: automatically augmenting incomplete trace links. In: ICSE (2018)

    Google Scholar 

  24. Soh, Z., Khomh, F., Guéhéneuc, Y.G., Antoniol, G.: Noise in Mylyn interaction traces and its impact on developers and recommendation systems. ESE 23(2), 645–692 (2018)

    Google Scholar 

Download references

Acknowledgment

We thank the students of the projects for their effort.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paul Hübner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hübner, P., Paech, B. (2019). Increasing Precision of Automatically Generated Trace Links. In: Knauss, E., Goedicke, M. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2019. Lecture Notes in Computer Science(), vol 11412. Springer, Cham. https://doi.org/10.1007/978-3-030-15538-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-15538-4_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-15537-7

  • Online ISBN: 978-3-030-15538-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics