Abstract
We have been concerned for some time with the lack of rigorous experimental evaluation of design options chosen for tools used by software engineers. In a series of studies using various evaluation techniques we built Keystroke-Level Models (KLM) and conducted an empirical usability study of a design issue (choice of editing paradigm for language-based editors) that has reached a ‘subjective stalemate’ in the research community. The KLM analysis enabled us to predict usage differences and while this was useful we also noticed several problems, in particular we were concerned about the estimated value and placement of the memory operator. By utilizing the same tasks in the usability study as in the KLM analysis, we were able to compare results from both evaluations and effectively validate the overall KLM estimates and the specific operator values involved.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Card, S. K., Moran, T. P. & Newell, A. (1980), “The Keystroke-level Model for User Performance Time with Interactive Systems”, Communications of the ACM 23 (7), 396–410.
Card, S. K., Moran, T. P. & Newell, A. (1983), The Psychology of Human–Computer Interaction,Lawrence Erlbaum Associates.
Gray, W. D., John, B. E. & Atwood, M. E. (1993), “Project Ernestine: Validating a GOMS Analysis for Predicting and Explaining Real-world Performance”, Human–Computer Interaction 8 (3), 237–309.
Khwaja, A. A. & Urban, J. E. (1993), Syntax-directed Editing Environments: Issues and Features, in E. Deaton, G. H. Berghel & G. Hedrick (eds.), “Applied Computing: States of the Art and Practice — 1993”, ACM Press, pp.230–237. Also in Proceedings of the 1993 ACM SIGAPP Symposium, Indianapolis, USA, 14–16th February.
Kieras, D. E. & Poison, P. G. (1985), “An approach to the formal analysis of user complexity”, International Journal of Man–Machine Studies 22 (4), 365–394.
Koester, H. H. & Levine, S. P. (1994), Validation of a Keystroke-level Model for a Text Entry System used by People with Disabilities, in E. P. Glinert (ed.), “ASSETS’94: Proceedings of The First Annual International ACM/SIGCAPH Conference on Assistive Technologies”. 31st October-1st November, Los Angles.
McFarlane, G. (1991), “Xmon UNIX Manual page”.
Minör, S. (1992), “Interacting with Structure-oriented Editors”, International Journal of Man–Machine Studies 37 (4), 399–418.
Neider, J. A. (1985), “Glim77 Reference Manual”, Royal Statistical Society.
Olson, J. R. & Olson, G. M. (1990), “The Growth of Cognitive Modeling in Human–Computer Interaction since GOMS”, Human–Computer Interaction 5 (2–3), 221–265.
Peck, V. A. & John, B. E. (1992), Browser-Soar: A Computational Model of a Highly Interactive Task, in P. Bauersfeld, J. Bennett & G. Lynch (eds.), “Proceedings of CHI’92: Human Factors in Computing Systems”, ACM Press, pp. 165–172.
Reps, T. W. & Teitelbaum, T. (1984), “The Synthesizer Generator”, ACM SIGPLAN Notices 19 (5), 42–48.
Also in P Henderson, editor, Proceedings of ACM SIGSOFT/SIGPLAN Software Engineering Symposium on Practical Software Development Environments, Pittsburg, USA, May 1984.
Reps, T. W. & Teitelbaum, T. (1989a), The Synthesizer Generator: A System for Constructing Language-Based Editors, Springer-Verlag.
Reps, T. W. & Teitelbaum, T. (1989b), The Synthesizer Generator Reference Manual,3rd edition, Springer-Verlag.
Toleman, M. A. & Welsh, J. (1994a), An Evaluation of Editing Paradigms, in S. Howard & Y. K. Leung (eds.), “Harmony Through Working Together — Proceedings of OZCHI’94”, Ergonomics Society of Australia ( Downer, ACT ), pp. 73–78.
Toleman, M. A. & Welsh, J. (1994b), A Keystroke Analysis of Language-based Editing Paradigms, Technical Report 94–5, Software Verification Research Centre, Department of Computer Science, The University of Queensland, Brisbane, Australia.
Toleman, M. A. & Welsh, J. (1995), An Empirical Investigation of Language-based Editing Paradigms, in H. Hasan & C. Nicastri (eds.), “HCI: A Light into the Future — Proceedings of OZCHI’95”, Ergonomics Society of Australia ( Downer, ACT ), pp. 163–168.
Welsh, J., Broom, B. & Kiong, D. (1991), “A Design Rationale for a Language-based Editor”, Software — Practice and Experience 21 (9), 923–948.
Welsh, J., Rose, G. A. & Lloyd, M. (1986), “An Adaptive Program Editor”, The Australian Computer Journal 18 (2), 67–74.
Whittle, B. R., Gautier, R. J. & Ratcliffe, M. (1994), “Trends in Structure-oriented Environments”, International Journal of Software Engineering and Knowledge Engineering 4 (1), 123–157.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Springer-Verlag London
About this paper
Cite this paper
Toleman, M.A., Welsh, J. (1996). Can Design Choices for Language-Based Editors be Analysed with Keystroke-Level Models?. In: Sasse, M.A., Cunningham, R.J., Winder, R.L. (eds) People and Computers XI. Springer, London. https://doi.org/10.1007/978-1-4471-3588-3_7
Download citation
DOI: https://doi.org/10.1007/978-1-4471-3588-3_7
Publisher Name: Springer, London
Print ISBN: 978-3-540-76069-6
Online ISBN: 978-1-4471-3588-3
eBook Packages: Springer Book Archive