Lightness, filling-in, and the fundamental role of context in visual perception.

Visual perception is defined by the unique spatial interactions that distinguish it from the point-to-point precision of a photometer. Over several decades, Lothar Spillmann has made key observations about the nature of these interactions and the role of context in perception. Our lab has explored the perceptual properties of spatial interactions and more generally the importance of visual context for neuronal responses and perception. Our investigations into the spatiotemporal dynamics of lightness provide insight into underlying mechanisms. For example, backward masking and luminance modulation experiments suggest that the representation of a uniformly luminous object develops first at the borders and, in some manner, the center fills in. The temporal dynamics of lightness induction are also consistent with a filling-in process. There is a slow cutoff temporal frequency above which surround luminance modulation will not elicit perceptual induction of a central area. The larger the central area, the lower the cutoff frequency for induction, perhaps indicating that an edge-based process requires more time to "complete" the larger area. In recordings from primary visual cortex we find that neurons respond in a manner surprisingly consistent with lightness perception and the spatial and temporal properties of induction. For example, the activity of V1 neurons can be modulated by light outside the receptive field and as the modulation rate is increased response modulation falls off more rapidly for large uniform areas than smaller areas. The conclusion we draw from these experiments is that lightness appears to be computed slowly on the basis of edge and context information. A possible role for the spatial interactions is lightness constancy, which is thought to depend on extensive spatial integration. We find not only that V1 responses are strongly context dependent, but that this dependence makes V1 lightness constant on average. The dependence of constancy on surround interactions underscores the fundamental role that context plays in perception. In more recent studies, further support has been found for the importance of context in experiments using natural scene stimuli.