Department of Electrical Engineering (ISY)

Structure and Motion Estimation from Rolling Shutter Video

Johan Hedborg, Erik Ringaby, Per-Erik Forssén, Michael Felsberg
IWMV11, Barcelona, Spain
The Second IEEE International Workshop on Mobile Vision
November 2011

Abstract

The majority of consumer quality cameras sold today have CMOS sensors with rolling shutters. In a rolling-shutter camera, images are read out row by row, and thus each row is exposed during a different time interval. A rolling-shutter exposure causes geometric image distortions when either the camera or the scene is moving, and this causes state-of-the-art structure and motion algorithms to fail. We demonstrate a novel method for solving the structure and motion problem for rolling-shutter video. The method relies on exploiting the continuity of the camera motion, both between frames, and across a frame. We demonstrate the effectiveness of our method by controlled experiments on real video sequences. We show, both visually and quantitatively, that our method outperforms standard structure and motion, and is more accurate and efficient than a two-step approach, doing image rectification and structure and motion.

Full Paper

Portable document format file PDF ()

---

Bibtex entry

@InProceedings{hedborg11,
  author = 	 {Johan Hedborg and Erik Ringaby and Per-Erik Forss\'en and Michael Felsberg},
  title = 	 {Structure and Motion Estimation from Rolling Shutter Video},
  booktitle = {The Second {IEEE} International Workshop on Mobile Vision},
  year = 	 {2011},
  OPTeditor = 	 {},
  address = 	 {Barcelona, Spain},
  month = 	 {November},
  organization = {{IEEE}},
  isbn =         {978-1-4673-0061-2}
  OPTpublisher = {}
}