Monocular Non-Rigid Surface Reconstruction with Learned Deformation Model

Abstract

CURRENT techniques for monocular reconstruction either require dense correspondences and rely on motion and deformation cues, or assume a highly accurate reconstruction (referred to as a template) of at least a single frame given in advance and operate in the manner of non-rigid tracking. Accurate computation of dense point tracks often requires multiple frames and can be computationally expensive. Availability of a template is a very strong prior which restricts system operation to a pre-defined environment and scenarios (see chapter 3.1 for the detailed introduction to the field and the state of the art).