Multi-view video representation based on fast Monte Carlo surface reconstruction
Jordi Salvador (Technicolor)
Josep R. Casas (Universitat Politècnica de Catalunya)
IEEE Transactions on Image Processing, 2013
For binaries and video demos, please visit the UPC's project website. NOTE. Ranked 53 among the 100 most downloaded IEEE Xplore articles in July 2013.
Abstract
This article provides an alternative solution for the costly representation of multi-view
video data, which can be used for both rendering and scene analysis. First, a new, efficient Monte Carlo discrete surface reconstruction method for foreground objects with static background is presented, which outperforms volumetric techniques and is suitable for GPU environments. Some extensions are also presented, which allow speeding up the reconstruction by exploiting multi-resolution and temporal correlation. Then, a fast meshing algorithm is applied, which allows interpolating a continuous surface from the discrete reconstructed points. As shown by the experimental results, the original video frames can be reconstructed
with high accuracy by projecting the reconstructed foreground objects onto the original viewpoints. Furthermore, the reconstructed scene can be easily projected to other desired virtual viewpoints, simplifying thus the design of Free-Viewpoint Video applications. In our
experimental results, we show that our techniques for reconstruction and meshing compare favorably to the state-of-the-art, and we also introduce a rule-of-thumb for effective application of the method with a good representation cost vs. quality trade-off.
BibTeX
@article{Salvador2013,author = {Salvador, J. and Casas, J.R.},
title = {{Multi-view video representation based on fast Monte Carlo surface reconstruction}},
journal = {IEEE Transactions on Image Processing},
volume = {22},
number = {9},
year = {2013},
doi = {10.1109/TIP.2013.2264818},
}
