Abstract
In this paper we present a framework for a multi-touch surface using multiple cameras. With an overhead camera and a side-mounted camera we determine the fingertip positions. After determining the fundamental matrix that relates the two cameras, we calculate the three dimensional coordinates of the fingertips. The intersection of the epipolar lines from the overhead camera with the fingertips detected in the side camera image provides the fingertip height. Touches are detected when the measured fingertip height from the touch surface is zero. We interpret touch events as hand gestures which can be generalized into commands for manipulating applications. We offer an example application of a multi-touch finger painting program.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Buxton, B.: Multi-Touch Systems That I Have Known And Loved (accessed March 21, 2007), http://billbuxton.com/multitouchOverview.html
Synaptics Technologies, Capacitive Position Sensing (visited March 21, 2007), http://www.synaptics.com/technology/cps.cfm
Mitsubishi DiamondTouch (visited March 21, 2007), http://www.merl.com/projects/DiamondTouch/
Levin, G.: Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers. AI & Society 20(4), 462–482 (2006)
Haller, M., Leithinger, D., Leitner, J., Seifried, T.: Coeno-Storyboard: An Augmented Surface for Storyboard Presentations. In: Mensch & Computer 2005, Linz, Austria (September 4-7, 2005)
Han, J.: Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection. In: ACM Symposium on User Interface Software and Technology (UIST), ACM, New York (2005)
Kjeldsen, R., Levas, A., Pinhanez, C.: Dynamically Reconfigurable Vision-Based User Interfaces. In: Crowley, J.L., Piater, J.H., Vincze, M., Paletta, L. (eds.) ICVS 2003. LNCS, vol. 2626, Springer, Heidelberg (2003)
Mo, Z., Lewis, J.P., Neumann, U.: SmartCanvas: A Gesture-Driven Intelligent Drawing Desk System. In: IUI 2005. Proceedings of Intelligent User Interfaces (January 9-12, 2005)
Malik, S., Laszlo, J.: Visual Touchpad: A Two-handed Gestural Input Device. In: ICMI 2004. International Conference on Multimodal Interfaces (October 13-15, 2004)
Wilson, A.: PlayAnywhere: A Compact Interactive Tabletop Projection-Vision System. In: ACM Symposium on User Interface Software and Technology (UIST), ACM, New York (2005)
Morris, T., Eshehry, H.: Real-Time Fingertip Detection for Hand Gesture Recognition. In: ACIVS 2004. Advanced Concepts for Intelligent Vision Systems, Ghent University, Belgium (September 9-11, 2002)
Toor, P.H.S., Murray, D.W.: The development and comparison of robust methods for estimating the fundamental matrix. Intl. J. of Computer Vision 24(3), 271–300 (1997)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Katz, I., Gabayan, K., Aghajan, H. (2007). A Multi-touch Surface Using Multiple Cameras. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2007. Lecture Notes in Computer Science, vol 4678. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74607-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-74607-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74606-5
Online ISBN: 978-3-540-74607-2
eBook Packages: Computer ScienceComputer Science (R0)