Abstract
Observation-based object modeling often requires integration of shape descriptions from different views. In current conventional methods, to sequentially merge multiple views, an accurate description of each surface patch has to be precisely known in each view, and the transformation between adjacent views needs to be accurately recovered. When noisy data and mismatches are present, the recovered transformation become erroneous, in addition, the transformation errors accumulate and propagate along the sequence, resulting in an inaccurate object model. To overcome these problems, we have developed a weighted least-squares (WLS) approach which simultaneously recovers object shape and transformation among different views without recovering interframe motion as an intermediate step.
We show that object modeling from a sequence of range images is a problem of principal component analysis with missing data (PCAMD), which can be generalized as a WLS minimization problem. An efficient algorithm is devised to solve the problem of PCAMD. After we have segmented planar surface regions in each view and tracked them over the image sequence, we construct a normal measurement matrix of surface normals, and a distance measurement matrix of normal distances to the origin for all visible regions appeared over the whole sequence of views, respectively. These two measurement matrices, which have many missing elements due to noise, occlusion, and mismatching, enable us to formulate multiple view merging as a combination of two WLS problems. A two-step algorithm is presented to computer planar surface descriptions and transformations among different views simultaneously. After surface equations are extracted, spatial connectivity among these surfaces is established to enable the polyhedral object model to be constructed.
Experiments using synthetic data and real range images show that our approach is robust against noise and mismatching and generates accurate polyhedral object models by averaging over all visible surfaces. Two examples are presented to illustrate the reconstruction of polyhedral object models from sequences of real range images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
N. Ahuja and J. Veenstra, “Generating octrees from object silhouettes in orthographic views,”IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 137–149, 1989.
F. Arman and J.K. Aggarwal, “Model-based object recognition in dense-range images—a review,”ACM Computing Surveys, vol. 25, no. 1, pp. 5–43, 1993
B. Bhanu, “Representation and shape matching of 3D objects,”IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 340–351, 1984.
[4] Y Chen and G. Medioni, “Object modeling by registration of multiple range images,”Proc. IEEE Int’l Conf. R & A,pp. 2,724–2,729, Apr. 1991.
[5] C. Debrunner and N. Ahuja, “Motion and structure factorization and segmentation of long multiple motion image sequences,”Proc. ECCV, pp. 217–221, 1992.
D. Dobkin, L. Guibas, J. Hershberger, and J. Snoeyink, “An efficient algorithm for finding the CSG representation of a simple polygon,”Algorithmica, vol. 10, pp. 1–23, 1993.
Y. Dodge,Analysis of Experiments with Missing Data. Wiley, 1985.
O.D. Faugeras and M. Hebert, “The representation, recognition, and localization of 3D objects,”Int’l J. Robotics Research. vol. 5, no. 3, pp. 27–52, 1986.
[9] F.P. Ferrie and M.D. Levine, “Integrating information from multiple views,”Proc. IEEE Workshop Computer Vision. pp. 117–122, 1987.
G.H. Golub and C.F. Van Loan,Matrix Computation, 2nd Edition. John Hopkins Univ. Press, 1989.
[11] K. Ikeuchi, “Generating an interpretation tree from a CAD model for 3D-object reconstruction in bin-picking,”Int’l J. Computer Vision. pp. 145–165, 1987.
[12] B. Parvin and G. Medioni, “B-rep from unregistered multiple range images,”Proc. IEEE Int’l Conf. R & A,pp. 1,602–1,607, May 1992.
C.J. Poelman and T. Kanade, “A paraperspective factorization method for shape and motion recovery” CMU-CS-92–208, Oct. 1992.
F.P. Preparata and M.I. Shamos,Computational Geometry. Springer-Verlag, 1988.
A. Ruhe, “Numerical computation of principal components when several observations are missing,” Tech Rep. UMINF-48-74, Dept Information Processing, Umea Univ., Umea, Sweden, 1974.
[16] M. Soucy and D. Laurendeau, “Multiresolution surface modeling from multiple range views,”Proc. IEEE CVPR, pp. 348–353, 1992.
K. Sugihara,Machine Interpretation of Line Drawings, MIT Press, 1986.
R. Szeliski and S.B. Kang, “Recovering 3D shape and motion from image streams using nonlinear least squares,” DEC CRL 93/3, 1993.
[19] C. Tornasi and T. Kanade, “Shape and motion from image streams under orthography: A factorization method “Int’l J. Computer Vision,vol. 9, no. 2, pp. 137–154,1992.
S. Ullman,The Interpretation of Visual Motion. MIT Press, 1979.
[21] B.C. Vemuri and J.K. Aggarwal, “3D model construction from multiple views using range and intensity data”Proc. CVPR,pp. 435–437, 1986.
[22] T. Wiberg, “Computation of principal components when data are missing,”Proc. Second Symp. Computational Statistics, pp. 229–236, Berlin, 1976.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer Science+Business Media New York
About this chapter
Cite this chapter
Shum, H., Ikeuchi, K., Reddy, R. (2001). Principal Component Analysis with Missing Data and Its Application to Polyhedral Object Modeling. In: Ikeuchi, K., Sato, Y. (eds) Modeling from Reality. The Springer International Series in Engineering and Computer Science, vol 640. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-0797-0_1
Download citation
DOI: https://doi.org/10.1007/978-1-4615-0797-0_1
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-5244-0
Online ISBN: 978-1-4615-0797-0
eBook Packages: Springer Book Archive