Moving object segmentation using scene understanding

Perera, A. G. A., Brooksby, G., Hoogs, A., Doretto, G., and Kaufhold, J.
Moving object segmentation using scene understanding
Technical Report 2005GRC182, GE Global Research, 2005. Visualization and Computer Vision Laboratory

Download

(unavailable)

Abstract

We present a novel approach to improving moving object detection algorithms for aerial video by incorporating scene understanding. We argue that scene understanding is a valuable input feature for moving object segmentation, and show how it can be used to reduce the false positive rate of any moving object detection algorithm. The approach is especially effective on sequences with large scene depth and much parallax, as often occurs with low, fast-moving sensors. In one difficult sequence, our results show an 8-fold reduction of false positives on average, with essentially no impact on the true positive rate, even when scene understanding is only moderately accurate. We show how scene understanding can be used to increase the accuracy of frame-to-frame homography estimates, and also present a novel approach that uses motion information from the previous frame for outlier rejection at the current frame to further increase accuracy.

BibTeX

@TechReport{pereraBHDK05tr,
  Title                    = {Moving object segmentation using scene understanding},
  Author                   = {Perera, A. G. A. and Brooksby, G. and Hoogs, A. and Doretto, G. and Kaufhold, J.},
  Institution              = {GE Global Research},
  Year                     = {2005},
  Address                  = {Niskayuna, NY, USA},
  Month                    = mar,
  Note                     = {Visualization and Computer Vision Laboratory},
  Number                   = {2005GRC182},
  Abstract                 = {We present a novel approach to improving moving object detection algorithms for aerial video by incorporating scene understanding. We argue that scene understanding is a valuable input feature for moving object segmentation, and show how it can be used to reduce the false positive rate of any moving object detection algorithm. The approach is especially effective on sequences with large scene depth and much parallax, as often occurs with low, fast-moving sensors. In one difficult sequence, our results show an 8-fold reduction of false positives on average, with essentially no impact on the true positive rate, even when scene understanding is only moderately accurate. We show how scene understanding can be used to increase the accuracy of frame-to-frame homography estimates, and also present a novel approach that uses motion information from the previous frame for outlier rejection at the current frame to further increase accuracy.},
  Bib2html_pubtype         = {Tech Reports},
  Bib2html_rescat          = {Video Surveillance, Visual Motion Segmentation},
  File                     = {pereraBHDK05tr.pdf:doretto\\report\\pereraBHDK05tr.pdf:PDF;pereraBHDK05tr.pdf:doretto\\report\\pereraBHDK05tr.pdf:PDF},
  Keywords                 = {motion segmentation, moving object detection, scene understanding, scene content, recognition},
  Owner                    = {doretto},
  Timestamp                = {2006.11.29}
}