Abstract
We present a new approach for tracking both the human body shape and the whole body motion with complete six DOF of each body limb without imposing rotation or translation constraints. First, a surface mesh with highly improved quality is obtained by using our new silhouette-based visual hull reconstruction method for each frame of multi-view videos. Then, a skinned mesh model is fitted to the data using hierarchical weighted ICP (HWICP) algorithm, where an easy-to-adjust strategy for selecting the set of ICP registration points is given based on the weights of the skinned model and the Approximate Nearest Neighbors (ANN) method is applied for fast searching nearest neighbors. By comparing HWICP with the general hierarchical ICP (Iterative Closest Point) method based on synthetic data, we demonstrate the power of weighting corresponding point pairs in HWICP, especially when adjacent body segments of target are near ‘cylindrical-shaped’.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Akca, D.: Generalized procrustes analysis and its applications in photogrammetry. Tech. rep., ETHz (2004)
Ballan, L., Cortelazzo, G.: Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes. In: Proceedings of 3D Data Processing, Visualization and Transmission (3DPVT 2008), pp. 36–43 (2008)
Besl, P., McKay, H.: A method for registration of 3-d shapes. IEEE Trans. on PAMI 14(2), 239–256 (1992)
Corazza, S., Gambaretto, E., Andriacchi, T.: Automatic generation of a subject-specific model for accurate markerless motion capture and biomechanical applications. IEEE Trans. on Biomedical Engineering 57(4), 806–812 (2009)
Corazza, S., Mündermann, L., Andriacchi, T.P.: Markerless motion capture through visual hull, articulated icp and subject specific model generation. International Journal of Computer Vision (IJCV) 87, 156–169 (2010)
Gall, J., Rosenhahn, B., Brox, T., Seidel, H.: Optimization and filtering for human motion capture. Int. Journal of Computer Vision (IJCV) 87, 75–92 (2010)
Kehl, R., Bray, M., Van Gool, L.: Full body tracking from multiple views using stochastic sampling. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 129–136 (2005)
Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. on PAMI 16, 150–162 (1994)
Lewis, J.P., Cordner, M., Fong, N.: Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. In: Proceedings of the 27th SIGGRAPH, pp. 165–172 (2000)
Magnenat-Thalmann, N., Laperrire, R., Thalmann, D.: Joint-dependent local deformations for hand animation and object grasping. In: Proceedings of Graphics Interface 1988, pp. 26–33 (1988)
Ménier, C., Boyer, E., Raffin, B.: 3d skeleton-based body pose recovery. In: Proceedings of Third International Symposium on 3DPVT, pp. 389–396 (2007)
Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. CVIU 104, 90–126 (2006)
Moschini, D., Fusiello, A.: Tracking human motion with multiple cameras using an articulated model. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2009. LNCS, vol. 5496, pp. 1–12. Springer, Heidelberg (2009)
Mount, D.M., Arya, S.: Ann programming manual, version 1.1 (2010), http://www.cs.umd.edu/~mount/ANN/
Mundermann, L., Corazza, S., Chaudhari, A.M., Andriacchi, T.P.: Most favorable camera configuration for a shape-from-silhouette markerless motion capture system for biomechanical analysis, vol. 5665, pp. 278–287. SPIE, San Jose (2005)
Ogawara, K., Li, X.L., Ikeuchi, K.: Marker-less human motion estimation using articulated deformable model. In: Proceedings of the IEEE ICRA, pp. 46–51 (2007)
Poppe, R.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108, 4–18 (2007)
Sigal, L., Black, M.J.: Humaneva: Synchronized video and motion capture dataset for evaluation of articulated human motion. Tech. rep., Brown University (2006)
Song, P., Wu, X., Wang, M.Y.: A robust and accurate method for visual hull computation. In: Proc. of the IEEE ICIA, pp. 784–789 (2009)
Takahashi, K., Hashimoto, M.: Remarks on markerless human motion capture from voxel reconstruction with simple human model. In: Proc. of the IEEE/RSJ Int. Conference on IROS, pp. 755–760 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, J., Wu, X., Wang, M.Y., Deng, F. (2011). Human Body Shape and Motion Tracking by Hierarchical Weighted ICP. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2011. Lecture Notes in Computer Science, vol 6939. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24031-7_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-24031-7_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24030-0
Online ISBN: 978-3-642-24031-7
eBook Packages: Computer ScienceComputer Science (R0)