Y.M. Kim, C. Theobalt, J. Diebel, J. Kosecka, B. Micusik, S. Thrun, Multi-view Image and ToF Sensor Fusion for Dense 3D Reconstruction, IEEE Workshop on 3-D Digital Imaging and Modeling (3DIM), 2009

Abstract:

Multi-view stereo methods frequently fail to properly reconstruct 3D scene geometry if visible texture is sparse or the scene exhibits difficult self-occlusions. Time-of-Flight (ToF) depth sensors can provide 3D information regardless of texture but with only limited resolution and accuracy. To find an optimal reconstruction, we propose an integrated multi-view sensor fusion approach that combines information from multiple color cameras and multiple ToF depth sensors. First, multi-view ToF sensor measurements are combined to obtain a coarse but complete model. Then, the initial model is refined by means of a probabilistic multiview fusion framework, optimizing over an energy function that aggregates ToF depth sensor information with multiview stereo and silhouette constraints. We obtain high quality dense and detailed 3D models of scenes challenging for stereo alone, while simultaneously reducing complex noise of ToF sensors.

Bibtex: 

@inproceedings{ktdkmt-mitsfd3r-09,
    author = {Young Min Kim and Christian Theobalt and James Diebel and Jana Kosecka Branislav Miscusik},
    title = {Multi-view Image and ToF Sensor Fusion for Dense 3D Reconstruction},
    booktitle = {IEEE Workshop on 3-D Digital Imaging and Modeling (3DIM)}
    year = {2009}
}