Localizing, describing, interpreting: effects of different audio text structures on attributing meaning to digital pictures.

Based on previous research on multimedia learning and text comprehension, an eye-tracking study was conducted to examine the influence of audio text coherence on visual attention and memory in a multimedia learning situation with a focus on picture comprehension. Audio text coherence was manipulated by the type of LDI structure, that is, whether localization, description, and interpretation followed in immediate succession for each pictorial detail or whether localizations and description of details were separated from their interpretation. Results show that with a LDI integrated structure compared to a LDI separated structure the referred-to picture elements were fixated longer during interpretation parts, and linkages between descriptions and interpretations were better recalled and recognized.

Aesthetic Experience of Representational Art: Liking Is Affected by Audio-Information Naming and Explaining Inaccuracies of Historical Paintings.

Paintings in museums are often accompanied by additional information, such as titles or audio-texts. Previous research has reported mostly positive effects of additional information on the liking and subjective understanding of a painting. However, some studies have also reported negative effects when additional information introduces inconsistencies between the painting's content and the represented reality.

The Closer, The Better? Processing Relations Between Picture Elements in Historical Paintings.

The present eye-tracking study investigated how audio explanations influence perception and the cognitive processing of historical paintings. Spatially close and distant pairs of picture elements and their semantic relations were named in an audio text either immediately after each other or with descriptions of other elements in between. It was assumed that the number of backward fixation counts on the first of the two mentioned related picture elements should be higher if they are spatially close rather than spatially distant.