Plenoptic Modeling for Viewpoint Editing

(Doretto & Soatto, 2003) further extends the previous VBR approach by introducing a model of the spatio-temporal statistics of a collection of images of dynamic scenes as seen from a moving camera. The joint modeling of the moving vantage point together with the statistics of the scene motion is obtained by introducing a time-variant linear dynamical system. The resulting algorithms could be useful for video editing where the motion of a virtual camera can be controlled interactively, as well as for performing stabilized synthetic generation of video sequences.

References

1. Towards plenoptic dynamic textures Doretto, G., and Soatto, S. In Proceedings of the 3rd International Workshop on Texture Analysis and Synthesis, 2003. abstract bibTeX pdf

   We present a technique to infer a model of the spatio-temporal statistics of a collection of images of dynamic scenes seen from a moving camera. We use a time-variant linear dynamical system to jointly model the statistics of the video signal and the moving vantage point. We propose three approaches to inference, the first based on the plenoptic function, the second based on interpolating linear dynamical models, the third based on approximating the scene as piecewise planar. For the last two approaches, we also illustrate the potential of the proposed techniques with a number of experiments. The resulting algorithms could be useful for video editing where the motion of the vantage point can be controlled interactively, as well as to perform stabilized synthetic generation of video sequences.

   @inproceedings{dorettoS03texture,
     author = {Doretto, G. and Soatto, S.},
     title = {Towards plenoptic dynamic textures},
     booktitle = {Proceedings of the 3rd International Workshop on Texture Analysis
     	and Synthesis},
     year = {2003},
     pages = {25--30},
     address = {Nice, France},
     month = oct,
     bib2html_pubtype = {Conferences},
     bib2html_rescat = {Dynamic Textures, Image Based Rendering, Registration from Dynamic
     	Textures},
     file = {dorettoS03texture.pdf:doretto\\conference\\dorettoS03texture.pdf:PDF;dorettoS03texture.pdf:doretto\\conference\\dorettoS03texture.pdf:PDF},
     owner = {doretto}
   }