Abstract
To inform, guide and optimize the design of cyber-physical systems (CPS), this study examined whether and how delayed visual feedback affects human fine-motor skills. Two experiments are presented, in which participants performed a complex motor task with their hands. During the task, visual feedback was provided on a display with varying delay lengths. Further, to investigate effects of adaptation and transfer, some participants were first exposed to a fixed delay before performing the task with varying delay lengths. Results show that independent of earlier delay exposure feedback delays had detrimental effects on performance, particularly when performance information was lacking and delay length variable. Hand kinematic indicate the use of a strategy geared to a slowing of the movement process. Implications and future research ideas like the application of augmented feedback on movement kinematic and the examination of different settings to promote adaptation effects are discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Choi, P.J., Oskouian, R.J., Tubbs, R.S.: Telesurgery: Past, Present, and Future. Cureus 10, e2716 (2018)
Bailey, R.E., Verly, J.G., Arthur Iii, J.J., Williams, S.P.: Latency requirements for head-worn display S/EVS applications, vol. 5424, p. 98 (2004)
Shadmehr, R., Smith, M.A., Krakauer, J.W.: Error correction, sensory prediction, and adaptation in motor control. Annu. Rev. Neurosci. 33, 89–108 (2010)
Luan, M., Maurer, H., Mirifar, A., Beckmann, J., Ehrlenspiel, F.: Multisensory action effects facilitate the performance of motor sequences. Atten. Percept. Psychophys. 83(1), 475–483 (2020). https://doi.org/10.3758/s13414-020-02179-9
Sarlegna, F.R., Sainburg, R.L.: The roles of vision and proprioception in the planning of reaching movements. Adv. Exp. Med. Biol. 629, 317–335 (2009)
Jörg, S., Normoyle, A., Safanova, A.: How responsiveness affects players’ perception in digital games. In: Proceedings of the ACM Symposium on Applied Perception, Los Angeles, California, pp. 33–38. Association for Computing Machinery (2012)
Waltemate, T., et al.: The impact of latency on perceptual judgments and motor performance in closed-loop interaction in virtual reality, pp. 27–35 (2016)
Honda, T., Hirashima, M., Nozaki, D.: Habituation to feedback delay restores degraded visuomotor adaptation by altering both sensory prediction error and the sensitivity of adaptation to the error. Front. Psychol. 3, 540 (2012)
Teather, R.J., Pavlovych, A., Stuerzlinger, W., MacKenzie, I.S.: Effectsof tracking technology, latency, and spatial jitter on object movement. In: 2009 IEEE Symposium on 3D User Interfaces, Lafayette, LA, USA, pp. 43–50 (2009)
Foulkes, A.J., Miall, R.C.: Adaptation to visual feedback delays in a human manual tracking task. Exp. Brain Res. 131, 101–110 (2000)
Miall, R.C., Weir, D.J., Stein, J.F.: Visuomotor tracking with delayed visual feedback. Neuroscience 16, 511–520 (1985)
Miall, R.C., Jackson, J.K.: Adaptation to visual feedback delays in manual tracking: evidence against the smith predictor model of human visually guided action. Exp. Brain Res. 172, 77–84 (2006)
Hosang, S., Chan, J., Davarpanah Jazi, S., Heath, M.: Grasping a 2D object: terminal haptic feedback supports an absolute visuo-haptic calibration. Exp. Brain Res. 234(4), 945–954 (2015). https://doi.org/10.1007/s00221-015-4521-4
Rab, G., Petuskey, K., Bagley, A.: A method for determination of upper extremity kinematics. Gait Posture 15, 113–119 (2002)
Sigrist, R., Rauter, G., Riener, R., Wolf, P.: Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon. Bull. Rev. 20, 21–53 (2013)
van Dam, L.C.J., Stephens, J.R.: Effects of prolonged exposure to feedback delay on the qualitative subjective experience of virtual reality. PLoS ONE 13, e0205145 (2018)
Storz, P., Buess, G.F., Kunert, W., Kirschniak, A.: 3D HD versus 2D HD: surgical task efficiency in standardised phantom tasks. Surg. Endosc. 26, 1454–1460 (2012)
Eversheim, U., Bock, O.: Evidence for processing stages in skill acquisition: a dual-task study. Learn. Mem. 8, 183–189 (2001)
Acknowledgements
We thank Anna Marie Kühn and Marlen Krüger for helping with the data acquisition. This work has been funded by the German Research Foundation (DFG, Deutsche Forschungsgemeinschaft) as part of Germany’s Excellence Strategy – EXC 2050/1 – Project ID 390696704 – Cluster of Excellence “Centre for Tactile Internet with Human-in-the-Loop” (CeTI) of Technische Universität Dresden.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dix, A., Helmert, J.R., Pannasch, S. (2022). Latency in Cyber-Physical Systems: The Role of Visual Feedback Delays on Manual Skill Learning. In: Ahram, T., Taiar, R. (eds) Human Interaction, Emerging Technologies and Future Systems V. IHIET 2021. Lecture Notes in Networks and Systems, vol 319. Springer, Cham. https://doi.org/10.1007/978-3-030-85540-6_146
Download citation
DOI: https://doi.org/10.1007/978-3-030-85540-6_146
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85539-0
Online ISBN: 978-3-030-85540-6
eBook Packages: EngineeringEngineering (R0)