Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Method for estimating the relative contribution of phase and power spectra to the total information in natural-scene patches

Not Accessible

Your library or personal account may give you access

Abstract

A wide variety of recent studies have argued that the human visual system provides an efficient means of processing the information in the natural environment. However, the amount of information (entropy) in the signal can be estimated in a number of ways, and it is has been unclear how much of the information is carried by the different sources of redundancy. The primary difficulty is that there has been no rational way to estimate the entropy of such complex scenes. In this paper, we provide a technique that uses a recent approach to estimating the entropy and dimensionality of natural scenes [D. M. Chandler and D. J. Field, J. Opt. Soc. Am. A 24, 922–941 (2007)] to estimate the amount of information attributable to the power and phase spectra in natural-scene patches. By comparing the entropies of patches that have swapped phase spectra and fixed phase spectra, we demonstrate how to estimate both the amount of information in each type of spectrum and the amount of information that is shared by these spectra (mutual information). We applied this technique to small patches (4×4 and 8×8). From our estimates, we show that the power spectrum of 8×8 patches carries approximately 54% of the total information, the phase spectrum carries 56%, and 10% is mutual information (54%+56%10%=100%). This technique is currently limited to relatively small image patches, due to the number of patches currently in our collection (on the order of 106). However, the technique can, in theory, be extended to larger images. Even with these relatively small patches, we discuss how these results can provide important insights into both compression techniques and efficient coding techniques that work with relatively small image patches (e.g., JPEG, sparse coding, independent components analysis).

© 2011 Optical Society of America

Full Article  |  PDF Article
More Like This
Estimates of the information content and dimensionality of natural scenes from proximity distributions

Damon M. Chandler and David J. Field
J. Opt. Soc. Am. A 24(4) 922-941 (2007)

Chromatic structure of natural scenes

Thomas Wachtler, Te-Won Lee, and Terrence J. Sejnowski
J. Opt. Soc. Am. A 18(1) 65-77 (2001)

Image statistics of American Sign Language: comparison with faces and natural scenes

Rain G. Bosworth, Marian Stewart Bartlett, and Karen R. Dobkins
J. Opt. Soc. Am. A 23(9) 2085-2096 (2006)

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (11)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (1)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (15)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved