Skip to main content

Making Gestural Interaction Accessible to Visually Impaired People

  • Conference paper
  • First Online:
Haptics: Neuroscience, Devices, Modeling, and Applications (EuroHaptics 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8619))

Abstract

As touch screens become widely spread, making them more accessible to visually impaired people is an important task. Touch displays possess a poor accessibility for visually impaired people. One possibility to make them more accessible without sight is through gestural interaction. Yet, there are still few studies on using gestural interaction for visually impaired people. In this paper we present a comprehensive summary of existing projects investigating accessible gestural interaction. We also highlight the limits of current approaches and propose future working directions. Then, we present the design of an interactive map prototype that includes both a raised-line map overlay and gestural interaction for accessing different types of information (e.g., opening hours, distances). Preliminary results of our project show that basic gestural interaction techniques can be successfully used in interactive maps for visually impaired people.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://inkscape.org/en [last accessed April 30th 2014].

  2. 2.

    http://users.polytech.unice.fr/~helen/SERVER_SI_VOX/pages/index.php?page=Accueil [last accessed April 30th 2014].

References

  1. Schöning, J.: Touch the future: the recent rise of multi-touch interaction. J. Eur. Comm. Futur. Emerg. Technol. Proactive Initiat. Pervasive Adapt. 5531, 1–2 (2010)

    Google Scholar 

  2. Buxton, W.: Multi-touch systems that i have known and loved (2007)

    Google Scholar 

  3. Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: ASSETS’08, New York, NY, USA, pp. 73–80. ACM Press (2008)

    Google Scholar 

  4. Kane, S.K., Morris, M.R., Wobbrock, J.O.: Touchplates: low-cost tactile overlays for visually impaired touch screen users. In: ASSETS’13, Bellevue, Washington, USA. ACM (2013)

    Google Scholar 

  5. Xu, S., Bailey, K.: Design touch feedback for blind users. In: Stephanidis, C. (ed.) HCII 2013, Part I. CCIS, vol. 373, pp. 281–285. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  6. Brock, A., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Design and user satisfaction of interactive maps for visually impaired people. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 544–551. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  7. Pavlovic, V.I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 677–695 (1997)

    Article  Google Scholar 

  8. Kamber, Y.: Empirical investigation of the memorability of gesture sets (2011)

    Google Scholar 

  9. Wolf, K., Dicke, C., Grasset, R.: Touching the void: gestures for auditory interfaces. In: TEI’11, New York, NY, USA, pp. 305–308. ACM Press (2011)

    Google Scholar 

  10. Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., Jorge, J.A.: From tapping to touching: making touch screens accessible to blind users. IEEE Multimed. 15, 48–50 (2008)

    Article  Google Scholar 

  11. Zeng, L., Weber, G.: Audio-haptic browser for a geographical information system. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 466–473. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  12. Yatani, K., Banovic, N., Truong, K.: SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback. In: CHI’12, New York, NY, USA, pp. 415–424. ACM Press (2012)

    Google Scholar 

  13. Carroll, D., Chakraborty, S., Lazar, J.: Designing accessible visualizations: the case of designing a weather map for blind users. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 436–445. Springer, Heidelberg (2013)

    Google Scholar 

  14. Apple: Apple - Accessibility - OS X - VoiceOver. http://www.apple.com/accessibility/osx/voiceover/

  15. McGookin, D., Brewster, S.A., Jiang, W.W.: Investigating touchscreen accessibility for people with visual impairments. In: NordiCHI, pp. 298–307. ACM (2008)

    Google Scholar 

  16. Kane, S.K., Wobbrock, J.O., Ladner, R.E.: Usable gestures for blind people. In: CHI’11, Vancouver, BC, Canada, pp. 413–422. ACM Press (2011)

    Google Scholar 

  17. El-Glaly, Y., Quek, F., Smith-Jackson, T., Dhillon, G.: Audible rendering of text documents controlled by multi-touch interaction. In: ICMI’12, New York, NY, USA, pp. 401–408. ACM Press (2012)

    Google Scholar 

  18. Brock, A.M., Oriola, B., Truillet, P., Jouffrais, C., Picard, D.: Map design for visually impaired people: past, present, and future research. Médiation Inf. - Handicap Commun. 36, 117–129 (2013)

    Google Scholar 

  19. Miele, J., Landau, S., Gilden, D.: Talking TMAP: automated generation of audio-tactile maps using Smith-Kettlewell’s TMAP software. Br. J. Vis. Impair. 24, 93–100 (2006)

    Article  Google Scholar 

  20. Lévesque, V., Petit, G., Dufresne, A., Hayward, V.: Adaptive level of detail in dynamic, refreshable tactile graphics. In: IEEE Haptics Symposium, pp. 1–5 (2012)

    Google Scholar 

  21. Brock, A.M., Vinot, J.-L., Oriola, B., Kammoun, S., Truillet, P., Jouffrais, C.: Méthodes et outils de conception participative avec des utilisateurs non-voyants. In: IHM’10, Luxembourg, NY, USA, pp. 65–72. ACM Press (2010)

    Google Scholar 

  22. Laufs, U., Ruff, C., Weisbecker, A.: MT4j - an open source platform for multi-touch software development. VIMation J. 1, 58–64 (2010)

    Google Scholar 

Download references

Acknowledgments

We thank Alexis Paoleschi who developed the prototype presented in this paper and our blind participants.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anke Brock .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brock, A., Truillet, P., Oriola, B., Jouffrais, C. (2014). Making Gestural Interaction Accessible to Visually Impaired People. In: Auvray, M., Duriez, C. (eds) Haptics: Neuroscience, Devices, Modeling, and Applications. EuroHaptics 2014. Lecture Notes in Computer Science(), vol 8619. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44196-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44196-1_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44195-4

  • Online ISBN: 978-3-662-44196-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics