This paper introduces a new approach for acquiring high-ﬁdelity 3D facial performances with realistic dynamic wrinkles and ﬁne-scale facial details. Our approach leverages state-of-the-art motion capture technology and advanced 3D scanning technology for facial performance acquisition.
We start the process by recording 3D facial performances of an actor using a marker-based motion capture system and perform facial analysis on the captured data, thereby determining a minimal set of face scans required for accurate facial reconstruction. We introduce a two-step registration process to efﬁciently build dense consistent surface correspondences across all the face scans. We reconstruct high-ﬁdelity 3D facial performances by combining motion capture data with the minimal set of face scans in the blend-shape interpolation framework. We have evaluated the performance of our system on both real and synthetic data. Our results show that the system can capture facial performances that match both the spatial resolution of static face scans and the acquisition speed of motion capture systems.