Abstract

There has been much research on how to restore a single image from distorted video. Random water surface variation, an inability to model the surface, and multiple factors in the imaging processing leading to different geometric distortions in each frame are among the challenges. This paper proposes an inverted pyramid structure based on the cross optical flow registration approach and a multi-scale weight fusion method based on wavelet decomposition. The inverted pyramid based on the registration method is used to estimate the original pixel positions. A multi-scale image fusion method is applied to fuse the two inputs processed by optical flow and backward mapping, and two iterations are proposed to improve the accuracy and stability of the output video. The method is tested on several reference distorted videos and our videos, which were obtained through our experimental equipment. The obtained results exhibit significant improvements over other reference methods. The corrected videos obtained with our approach have a higher degree of sharpness, and the time required to restore the videos is significantly reduced.

© 2023 Optica Publishing Group

Stabilization of turbulence-degraded video using patch-based reference frame

Fouzia Nawreen, Kalyan Kumar Halder, Murat Tahtali, and Sreenatha G. Anavatti
Opt. Continuum 2(12) 2484-2499 (2023)

Reconstruction of distorted underwater images using robust registration

Zhen Zhang and Xu Yang
Opt. Express 27(7) 9996-10008 (2019)

Correction of geometrically distorted underwater images using shift map analysis

Kalyan Kumar Halder, Manoranjan Paul, Murat Tahtali, Sreenatha G. Anavatti, and Manzur Murshed
J. Opt. Soc. Am. A 34(4) 666-673 (2017)

Distorted underwater image reconstruction for an autonomous underwater vehicle based on a self-attention generative adversarial network

Tengyue Li, Qianqian Yang, Shenghui Rong, Long Chen, and Bo He
Appl. Opt. 59(32) 10049-10060 (2020)

Synthetic imaging through wavy water surface with centroid evolution

Ruiwen Zhang, Dahua He, Yapeng Li, Liang Huang, and Xiaojing Bao
Opt. Express 26(20) 26009-26019 (2018)