Eye movements are vital for human vision, and it is therefore important to understand how observers decide where to look. Meaning maps (MMs), a technique to capture the distribution of semantic information across an image, have recently been proposed to support the hypothesis that meaning rather than image features guides human gaze. MMs have the potential to be an important tool far beyond eye-movements research. Here, we examine central assumptions underlying MMs. First, we compared the performance of MMs in predicting fixations to saliency models, showing that DeepGaze II - a deep neural network trained to predict fixations based on high-level features rather than meaning - outperforms MMs. Second, we show that whereas human observers respond to changes in meaning induced by manipulating object-context relationships, MMs and DeepGaze II do not. Together, these findings challenge central assumptions underlying the use of MMs to measure the distribution of meaning in images.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.cognition.2020.104465DOI Listing

Publication Analysis

Top Keywords

meaning maps
8
saliency models
8
central assumptions
8
assumptions underlying
8
underlying mms
8
meaning
7
mms
7
maps saliency
4
models based
4
based deep
4

Similar Publications

While bacille-calmette-guerin (BCG) vaccination is one of the recommended strategies for preventing tuberculosis (TB), its coverage is low in several countries, including Ethiopia. This study investigated the spatial co-distribution and drivers of TB prevalence and low BCG coverage in Ethiopia. This ecological study was conducted using data from a national TB prevalence survey and the Ethiopian demographic and health survey (EDHS) to map the spatial co-distribution of BCG vaccination coverage and TB prevalence.

View Article and Find Full Text PDF

Human motion similarity evaluation based on deep metric learning.

Sci Rep

December 2024

College of Sports, Beihua University, Jilin, 132000, China.

In order to eliminate the impact of camera viewpoint factors and human skeleton differences on the action similarity evaluation and to address the issue of human action similarity evaluation under different viewpoints, a method based on deep metric learning is proposed in this article. The method trains an automatic encoder-decoder deep neural network model by means of a homemade synthetic dataset, which maps the 2D human skeletal key point sequence samples extracted from motion videos into three potential low-dimensional dense spaces. Action feature vectors independent of camera viewpoint and human skeleton structure are extracted in the low-dimensional dense spaces, and motion similarity metrics are performed based on these features, thereby effectively eliminating the effects of camera viewpoint and human skeleton size differences on motion similarity evaluation.

View Article and Find Full Text PDF

Toward Collective Chemistry under Strong Light-Matter Coupling.

J Phys Chem Lett

December 2024

Department of Chemistry and Department of Physics, Westlake University, Hangzhou, Zhejiang 310030, China.

Collective strong light-matter coupling provides a versatile means to manipulate physicochemical properties of molecules and materials. Understanding collective polaritonic dynamics is hindered by the macroscopic number of molecules interacting collectively with photonic modes. We develop a many-body theory to investigate the spectroscopy and dynamics of a molecular ensemble embedded in an optical cavity in the collective strong coupling regime.

View Article and Find Full Text PDF

A previously developed algorithm for the preliminary identification of protein proteoforms associated with post-translational modifications (PTMs) based on 2D electrophoresis data (DOI: 10.18097/BMCRM00191) has been used in this study for analysis of experimental data obtained using mice and reported in two papers by different authors. The authors of the first paper identified 8 groups of spots on 2D electrophoretic maps corresponding to 8 proteins with at least two unconcretised proteoforms.

View Article and Find Full Text PDF

Regional brain iron mapping in obstructive sleep apnea adults.

Sleep Med

December 2024

Department of Anesthesiology and Perioperative Medicine, University of California Los Angeles, Los Angeles, CA, USA; Department of Radiology, University of California Los Angeles, Los Angeles, CA, USA; Department of Bioengineering, University of California Los Angeles, Los Angeles, CA, USA; Brain Research Institute, University of California Los Angeles, Los Angeles, CA, USA. Electronic address:

Purpose: Obstructive sleep apnea (OSA) subjects show significant white matter injury, including myelin changes in several brain areas, potentially from impaired glial cells, contributing to increased iron levels that escalate neurodegeneration, but brain iron loads are unclear. Our aim was to examine regional brain iron load, using T2∗-relaxometry, in OSA adults before and after continuous positive airway pressure (CPAP) treatment over controls.

Methods: We performed T2∗-weighted imaging using a 3.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!