Department of Electrical Engineering (ISY)

Efficient Video Rectification and Stabilisation for Cell-Phones

Erik Ringaby, Per-Erik Forssén
International Journal of Computer Vision
Volume 96, Number 3, Pages 335-352
February 2012

Abstract

This article presents a method for rectifying and stabilising video from cell-phones with rolling shutter (RS) cameras. Due to size constraints, cell-phone cameras have constant, or near constant focal length, making them an ideal application for calibrated projective geometry. In contrast to previous RS rectification attempts that model distortions in the image plane, we model the 3D rotation of the camera. We parameterise the camera rotation as a continuous curve, with knots distributed across a short frame interval. Curve parameters are found using non-linear least squares over inter-frame correspondences from a KLT tracker. By smoothing a sequence of reference rotations from the estimated curve, we can at a small extra cost, obtain a high-quality image stabilisation. Using synthetic RS sequences with associated ground-truth, we demonstrate that our rectification improves over two other methods. We also compare our video stabilisation with the methods in iMovie and Deshaker.

Full Paper

On-line PDF available at the SpringerLink website. DiVA entry here. Video on YouTube.

---

Bibtex entry

@Article{ringaby11,
  author = 	 {Erik Ringaby and Per-Erik Forss\'en},
  title = 	 {Efficient Video Rectification and Stabilisation for Cell-Phones},
  journal = 	 {International Journal of Computer Vision},
  year = 	 {2012},
  volume = 	 {96},
  number = 	 {3},
  pages = 	 {335-352},
  month = 	 {February},
  issn = {0920-5691},
  note = 	 {http://dx.doi.org/10.1007/s11263-011-0465-8},
  annote = 	 {On-line 13 June 2011}
}