Princeton > CS Dept > PIXL > Graphics > Publications Local Access 

Dynamic Shape Capture using Multi-View Photometric Stereo
ACM Trans. Graphics (Proc. SIGGRAPH Asia), December 2009

Daniel Vlasic, Pieter Peers, Ilya Baran,
Paul Debevec, Jovan Popović, Szymon Rusinkiewicz,
Wojciech Matusik


Our system rapidly acquires images under varying illumination in order to compute photometric normals from multiple viewpoints. The normals are then used to reconstruct detailed mesh sequences of dynamic shapes such as human performers.

Abstract

We describe a system for high-resolution capture of moving 3D geometry, beginning with dynamic normal maps from multiple views. The normal maps are captured using active shape-from-shading (photometric stereo), with a large lighting dome providing a series of novel spherical lighting configurations. To compensate for low-frequency deformation, we perform multi-view matching and thin-plate spline deformation on the initial surfaces obtained by integrating the normal maps. Next, the corrected meshes are merged into a single mesh using a volumetric method. The final output is a set of meshes, which were impossible to produce with previous methods. The meshes exhibit details on the order of a few millimeters, and represent the performance over human-size working volumes at a temporal resolution of 60Hz.

Citation (BibTeX)

Daniel Vlasic, Pieter Peers, Ilya Baran, Paul Debevec, Jovan Popović, Szymon Rusinkiewicz, and Wojciech Matusik. Dynamic Shape Capture using Multi-View Photometric Stereo. ACM Trans. Graphics (Proc. SIGGRAPH Asia) 28(5), December 2009.

Paper
  PDF file

Video
  AVI (DIVX)

Links
  Project page at MIT (includes datasets)
  Project page at USC ICT