Affordable Access

Publisher Website

Wide-baseline foreground object interpolation using silhouette shape prior.

  • Verleysen, Cedric
  • Maugey, Thomas
  • Frossard, Pascal
  • Vleeschouwer, Christophe De
Published Article
IEEE Transactions on Image Processing
Institute of Electrical and Electronics Engineers
Publication Date
Jul 31, 2017
DOI: 10.1109/TIP.2017.2734567
PMID: 28783631


We consider the synthesis of intermediate views of an object captured by two widely spaced and calibrated cameras. This problem is challenging because foreshortening effects and occlusions induce significant differences between the reference images when the cameras are far apart. That makes the association or disappearance/appearance of their pixels difficult to estimate. Our main contribution lies in disambiguating this illposed problem by making the interpolated views consistent with a plausible transformation of the object silhouette between the reference views. This plausible transformation is derived from an object-specific prior that consists of a nonlinear shape manifold learned from multiple previous observations of this object by the two reference cameras. The prior is used to estimate the evolution of the epipolar silhouette segments between the reference views. This information directly supports the definition of epipolar silhouette segments in the intermediate views, as well as the synthesis of textures in those segments. It permits to reconstruct the Epipolar Plane Images (EPIs) and the continuum of views associated with the Epipolar Plane Image Volume, obtained by aggregating the EPIs. Experiments on synthetic and natural images show that our method preserves the object topology in intermediate views and deals effectively with the self-occluded regions and the severe foreshortening effect associated with widebaseline camera configurations.

Report this publication


Seen <100 times