Abstract

One of the most important problems in computer vision is the computation of the two-dimensional projective transformation (homography) that maps features of planar objects in different images and videos. This computation is required by many applications such as image mosaicking, image registration, and augmented reality. The real-time performance imposes constraints on the methods used. In this paper, we address the real-time detection and tracking of planar objects in a video sequence where the object of interest is given by a reference image template. Most existing approaches for homography estimation are based on two steps: feature extraction (first step) followed by a combinatorial optimization method (second step) to match features between the reference template and the scene frame. This paper has two main contributions. First, we detect both planar and nonplanar objects via efficient object feature classification in the input images, which is applied prior to performing the matching step. Second, for the tracking part (planar objects), we propose a fast method for the computation of the homography that is based on the transferred object features and their associated local raw brightness. The advantage of the proposed schemes is a fast matching as well as fast and robust object registration that is given by either a homography or three-dimensional pose.

©2012 Optical Society of America

Online multi-object tracking with efficient track drift and fragmentation handling

Jaeyong Ju, Daehun Kim, Bonhwa Ku, David K. Han, and Hanseok Ko
J. Opt. Soc. Am. A 34(2) 280-293 (2017)

Robust object tracking based on local discriminative sparse representation

Xin Wang, Siqiu Shen, Chen Ning, Yuzhen Zhang, and Guofang Lv
J. Opt. Soc. Am. A 34(4) 533-544 (2017)

Detection and removal of fence occlusions in an image using a video of the static/dynamic scene

Sankaraganesh Jonna, Krishna K. Nakka, Vrushali S. Khasare, Rajiv R. Sahay, and Mohan S. Kankanhalli
J. Opt. Soc. Am. A 33(10) 1917-1930 (2016)

Effects of image restoration on automatic acquisition of moving objects in thermal video sequences degraded by the atmosphere

Oren Haik and Yitzhak Yitzhaky
Appl. Opt. 46(36) 8562-8572 (2007)

Research of the three-dimensional tracking and registration method based on multiobjective constraints in an AR system

Zhe An, Xiping Xu, Jinhua Yang, Yang Liu, and Yuxuan Yan
Appl. Opt. 57(32) 9625-9634 (2018)