Videos are often accompanied by narration delivered either by an audio stream or by captions, yet little is known about saccadic patterns while viewing narrated video displays. Eye movements were recorded while viewing video clips with (a) audio narration, (b) captions, (c) no narration, or (d) concurrent captions and audio. A surprisingly large proportion of time (>40%) was spent reading captions even in the presence of a redundant audio stream. Redundant audio did not affect the saccadic reading patterns but did lead to skipping of some portions of the captions and to delays of saccades made into the caption region. In the absence of captions, fixations were drawn to regions with a high density of information, such as the central region of the display, and to regions with high levels of temporal change (actions and events), regardless of the presence of narration. The strong attraction to captions, with or without redundant audio, raises the question of what determines how time is apportioned between captions and video regions so as to minimize information loss. The strategies of apportioning time may be based on several factors, including the inherent attraction of the line of sight to any available text, the moment by moment impressions of the relative importance of the information in the caption and the video, and the drive to integrate visual text accompanied by audio into a single narrative stream.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4521331 | PMC |
| http://dx.doi.org/10.1167/13.4.1 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Emotion Recognition Using EEG Signals and Audiovisual Features with Contrastive Learning.
Bioengineering (Basel)
October 2024
Department of Electronic Convergence Engineering, Kwangwoon University, 20 Gwangun-ro, Nowon-gu, Seoul 01897, Republic of Korea.
Article Synopsis
- Multimodal emotion recognition combines data from various sources, like physiological signals and visual and audio cues, to better understand human emotions.
- Current techniques struggle with conflicting information from these sources, prompting the development of a new framework that uses EEG data along with audio-visual features to improve emotion classification.
- This new method incorporates specialized encoders and cross-modal attention to enhance feature extraction and fusion, achieving promising results in emotion recognition across multiple datasets.
How to treat systolic anterior motion of the anterior mitral valve leaflet during endoscopic minimally invasive surgery.
Multimed Man Cardiothorac Surg
September 2024
Department of Cardiac Surgery Medical University of Innsbruck Innsbruck, Austria.
Systolic anterior motion is characterized by the displacement of the anterior mitral leaflet towards the left ventricle outflow tract. Iatrogenic systolic anterior motion occurs after mitral valve repair as a result of mitral annuloplasty. Possible causes include excess height of a redundant posterior mitral leaflet and/or the use of an undersized ring.
View Article and Find Full Text PDFLaparoscopic salpingostomy for two types of hydrosalpinx: a step-by-step video tutorial.
Fertil Steril
January 2025
Department of Obstetrics and Gynecology, Chongqing Health Center for Women and Children, Women and Children's Hospital of Chongqing Medical University, Chongqing, People's Republic of China. Electronic address:
Objective: This study aims to illustrate our laparoscopic salpingostomy approach for two types of hydrosalpinx, emphasizing various reproductive surgical techniques.
Design: A step-by-step demonstration of the technique is provided alongside narrated video footage.
Setting: University hospital.
Quantifying functional redundancy in polysaccharide-degrading prokaryotic communities.
Microbiome
July 2024
State Key Laboratory of Microbial Technology, Institute of Microbial Technology, Shandong University, Qingdao, 266237, China.
Background: Functional redundancy (FR) is widely present, but there is no consensus on its formation process and influencing factors. Taxonomically distinct microorganisms possessing genes for the same function in a community lead to within-community FR, and distinct assemblies of microorganisms in different communities playing the same functional roles are termed between-community FR. We proposed two formulas to respectively quantify the degree of functional redundancy within and between communities and analyzed the FR degrees of carbohydrate degradation functions in global environment samples using the genetic information of glycoside hydrolases (GHs) encoded by prokaryotes.
View Article and Find Full Text PDFA compendium of ruminant gastrointestinal phage genomes revealed a higher proportion of lytic phages than in any other environments.
Microbiome
April 2024
Key Laboratory of Molecular Biophysics of the Ministry of Education, Hubei Key Laboratory of Bioinformatics and Molecular-Imaging, Center for Artificial Biology, Department of Bioinformatics and Systems Biology, College of Life Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, Hubei, China.
Background: Ruminants are important livestock animals that have a unique digestive system comprising multiple stomach compartments. Despite significant progress in the study of microbiome in the gastrointestinal tract (GIT) sites of ruminants, we still lack an understanding of the viral community of ruminants. Here, we surveyed its viral ecology using 2333 samples from 10 sites along the GIT of 8 ruminant species.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!