Abstract
This paper presents a realtime performance animation system that reproduces full-body character animation based on sparse 3D motion sensors on the performer. Producing faithful character animation from this setting is a mathematically ill-posed problem because input data from the sensors is not sufficient to determine the full degrees of freedom of a character. Given the input data from 3D motion sensors, we pick similar poses from the motion database and build an online local model that transforms the low-dimensional input signal into a high-dimensional character pose. Kernel CCA (Canonical Correlation Analysis)-based regression is employed as the model, which effectively covers a wide range of motion. Examples show that various human motions are naturally reproduced by our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ANN: Library for approximate nearest neighbor searching, http://www.cs.umd.edu/~mount/ANN/
Badler, N.I., Hollick, M.J., Granieri, J.P.: Real-time control of a virtual human using minimal sensors. Teleoperators and Virtual Environments 2, 82–86 (1993)
Brand, M., Hertzmann, A.: Style machines. ACM Transactions on Graphics (SIGGRAPH 2000), 183–192 (2000)
Chai, J., Hodgins, J.K.: Constraint-based motion optimization using a statistical dynamic model. ACM Transactions on Graphics (SIGGRAPH 2007) (2007)
Chai, J., Hodgins, J.K.: Performance animation from low-dimensional control signals. ACM Transactions on Graphics (SIGGRAPH 2005), 686–696 (2005)
Feng, W.W., Kim, B.U., Yu, Y.: Real-time data driven deformation using kernel canonical correlation analysis. ACM Transactions on Graphics (SIGGRAPH 2008) 27(3), 1–9 (2008)
Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. ACM Transactions on Graphics (SIGGRAPH 2004), 522–531 (2004)
Huang, H., Yin, K., Zhao, L., Qi, Y., Yu, Y., Tong, X.: Detail-preserving controllable deformation from sparse examples. IEEE Transactions on Visualization and Computer Graphics, 1215–1227 (2012)
InterSense: Is-900 system, http://www.intersense.com/pages/20/14
Lee, J.: Representing rotations and orientations in geometric computing. IEEE Comput. Graph. Appl. (2008)
Lee, J., Chai, J., Reitsma, P.S.A., Hodgins, J.K., Pollard, N.S.: Interactive control of avatars animated with human motion data. ACM Transactions on Graphics (SIGGRAPH 2002), 491–500 (2002)
Lee, Y., Kim, S., Lee, J.: Data-driven biped control. ACM Trans. Graph. 29, 129:1–129:8 (2010)
Liu, G., Zhang, J., Wang, W., McMillan, L.: Human motion estimation from a reduced marker set. In: Symposium on Interactive 3D Graphics and Games, pp. 35–42 (2006)
Liu, H., Wei, X., Chai, J., Ha, I., Rhee, T.: Realtime human motion control with a small number of inertial sensors. In: Symposium on Interactive 3D Graphics and Games, pp. 133–140 (2011)
Melzer, T., Reiter, M., Bischof, H.: Appearance models based on kernel canonical correlation analysis. Pattern Recognition 36(9), 1961–1971 (2003)
Shin, H.J., Lee, J.: Motion synthesis and editing in low-dimensional spaces: Research articles. Comput. Animat. Virtual Worlds (2006)
Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M.: Computer puppetry: An importance-based approach. ACM Transactions on Graphics, 67–94 (2001)
Slyper, R., Hodgins, J.: Action capture with accelerometers. In: ACM SIGGRAPH/Eurographics Symposium on Computer Animation (2008)
Tautges, J., Zinke, A., Krüger, B., Baumann, J., Weber, A., Helten, T., Müller, M., Seidel, H.P., Eberhardt, B.: Motion reconstruction using sparse accelerometer data. ACM Transactions on Graphics, 18:1–18:12 (2010)
UMFPACK: Library for solving unsymmetric sparse linear systems, http://www.cise.ufl.edu/research/sparse/umfpack/
Wei, X., Chai, J.: Intuitive interactive human character posing with millions of example poses. IEEE Computer Graphics and Applications (2009)
Yin, K., Pai, D.K.: Footsee: an interactive animation system. In: ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 329–338 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, J., Seol, Y., Lee, J. (2012). Realtime Performance Animation Using Sparse 3D Motion Sensors. In: Kallmann, M., Bekris, K. (eds) Motion in Games. MIG 2012. Lecture Notes in Computer Science, vol 7660. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34710-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-34710-8_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34709-2
Online ISBN: 978-3-642-34710-8
eBook Packages: Computer ScienceComputer Science (R0)