Abstract

The utility of using inertial data for the structure-from-motion (SfM) problem is addressed. We show how inertial data can be used for improved noise resistance, reduction of inherent ambiguities, and handling of mixed-domain sequences. We also show that the number of feature points needed for accurate and robust SfM estimation can be significantly reduced when inertial data are employed. Cramér–Rao lower bounds are computed to quantify the improvements in estimating motion parameters. A robust extended-Kalman-filter-based SfM algorithm using inertial data is then developed to fully exploit the inertial information. This algorithm has been tested by using synthetic and real image sequences, and the results show the efficacy of using inertial data for the SfM problem.

© 2001 Optical Society of America

Performance bounds for estimating three-dimensional motion parameters from a sequence of noisy images

Ted J. Broida and Rama Chellappa
J. Opt. Soc. Am. A 6(6) 879-889 (1989)

Structure from motion with efficient homography-based line matching

Yan Shen and Yuxing Dai
J. Opt. Soc. Am. A 35(2) 200-209 (2018)

Motion and structure from two perspective views: from essential parameters to Euclidean motion through the fundamental matrix

Zhengyou Zhang
J. Opt. Soc. Am. A 14(11) 2938-2950 (1997)

Estimation of contour motion and deformation for nonrigid object tracking

Jie Shao, Fatih Porikli, and Rama Chellappa
J. Opt. Soc. Am. A 24(8) 2109-2121 (2007)

Synthetic-aperture-radar motion compensation and feature extraction by means of a relaxation-based algorithm

Zheng-She Liu and Jian Li
J. Opt. Soc. Am. A 15(3) 599-610 (1998)