Constrained sampling from deep generative image models reveals mechanisms of human target detection.

The first steps of visual processing are often described as a bank of oriented filters followed by divisive normalization. This approach has been tremendously successful at predicting contrast thresholds in simple visual displays. However, it is unclear to what extent this kind of architecture also supports processing in more complex visual tasks performed in naturally looking images.

Radial frequency patterns describe a small and perceptually distinct subset of all possible planar shapes.

The visual system is exposed to a vast number of shapes and objects. Yet, human object recognition is effortless, fast and largely independent of naturally occurring transformations such as position and scale. The precise mechanisms of shape encoding are still largely unknown.

The role of global cues in the perceptual grouping of natural shapes.

Perceptual grouping of the bounding contours of objects is a crucial step in visual scene understanding and object recognition. The standard perceptual model for this task, supported by a convergence of physiological and psychophysical evidence, is based upon an association field that governs local grouping, and a Markov or transitivity assumption that allows global contours to be inferred solely from these local cues. However, computational studies suggest that these local cues may not be sufficient for reliable identification of object boundaries in natural scenes.

Human sensitivity to perturbations constrained by a model of the natural image manifold.

Humans are remarkably well tuned to the statistical properties of natural images. However, quantitative characterization of processing within the domain of natural images has been difficult because most parametric manipulations of a natural image make that image appear less natural. We used generative adversarial networks (GANs) to constrain parametric manipulations to remain within an approximation of the manifold of natural images.

Frequency tuning of shape perception revealed by classification image analysis.

Classification image analysis is a powerful technique for elucidating linear detection and discrimination mechanisms, but it has primarily been applied to contrast detection. Here we report a novel classification image methodology for identifying linear mechanisms underlying shape discrimination. Although prior attempts to apply classification image methods to shape perception have been confined to simple radial shapes, the method proposed here can be applied to general 2-D (planar) shapes of arbitrary complexity, including natural shapes.