Department of Electrical Engineering (ISY)

Stabilizing Cell Phone Video using Inertial Measurement Sensors

Gustav Hanning, Nicklas Forslöw, Per-Erik Forssén, Erik Ringaby, David Törnqvist, Jonas Callmer
IWMV11, Barcelona, Spain
The Second IEEE International Workshop on Mobile Vision
November 2011

Abstract

We present a system that rectifies and stabilizes video sequences on mobile devices with rolling-shutter cameras. The system corrects for rolling-shutter distortions using measurements from accelerometer and gyroscope sensors, and a 3D rotational distortion model. In order to obtain a stabilized video, and at the same time keep most content in view, we propose an adaptive low-pass filter algorithm to obtain the output camera trajectory. The accuracy of the orientation estimates has been evaluated experimentally using ground truth data from a motion capture system. We have conducted a user study, where the output from our system, implemented in iOS, has been compared to that of three other applications, as well as to the uncorrected video. The study shows that users prefer our sensor-based system.

Full Paper

Portable document format file PDF ()
This paper was awarded the IWMV best paper award

---

Bibtex entry

@InProceedings{hanning11,
  author = 	 {Gustav Hanning and Nicklas Forsl\"ow and Per-Erik Forss\'en and Erik Ringaby and David T\"ornqvist and Jonas Callmer},
  title = 	 {Stabilizing Cell Phone Video using Inertial Measurement Sensors},
  booktitle = {The Second {IEEE} International Workshop on Mobile Vision},
  year = 	 {2011},
  OPTeditor = 	 {},
  address = 	 {Barcelona, Spain},
  month = 	 {November},
  organization = {{IEEE}},
  isbn =         {978-1-4673-0061-2}
  OPTpublisher = {}
}