On reliability of annotations in contextual emotion imagery.

Sci Data

Robótica y Manufactura Avanzada, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional, Ramos Arizpe, Coahuila, 25900, México.

Published: August 2023

We documented the relabeling process for a subset of a renowned database for emotion-in-context recognition, with the aim of promoting reliability in final labels. To this end, emotion categories were organized into eight groups, while a large number of participants was requested for tagging. A strict control strategy was performed along the experiments, whose duration was 13.45 minutes average per day. Annotators were free to participate in any of the daily experiments (the average number of participants was 28), and a Z-Score filtering technique was implemented to keep trustworthiness of annotations. As a result, the value of the agreement parameter Fleiss' Kapa increasingly varied from slight to almost perfect, revealing a coherent diversity of the experiments. Our results support the hypothesis that a small number of categories and a large number of voters benefit reliability of annotations in contextual emotion imagery.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10423283PMC
http://dx.doi.org/10.1038/s41597-023-02435-1DOI Listing

Publication Analysis

Top Keywords

reliability annotations
8
annotations contextual
8
contextual emotion
8
emotion imagery
8
large number
8
number participants
8
imagery documented
4
documented relabeling
4
relabeling process
4
process subset
4

Similar Publications

Objectives: Accurate kidney and tumor segmentation of computed tomography (CT) scans is vital for diagnosis and treatment, but manual methods are time-consuming and inconsistent, highlighting the value of AI automation. This study develops a fully automated AI model using vision transformers (ViTs) and convolutional neural networks (CNNs) to detect and segment kidneys and kidney tumors in Contrast-Enhanced (CECT) scans, with a focus on improving sensitivity for small, indistinct tumors.

Methods: The segmentation framework employs a ViT-based model for the kidney organ, followed by a 3D UNet model with enhanced connections and attention mechanisms for tumor detection and segmentation.

View Article and Find Full Text PDF

Glycans associated with biopharmaceutical drugs play crucial roles in drug safety and efficacy, and therefore, their reliable detection and quantification is essential. Our study introduces a multi-level quantification approach for glycosylation analysis in monoclonal antibodies (mAbs), focusing on minor abundant glycovariants. Mass spectrometric data is evaluated mainly employing open-source software tools.

View Article and Find Full Text PDF

Low magnesium (Mg) intake increases the risk of various diseases such as anxiety disorder, depression, and diabetes. However, a reliable biomarker of mild Mg deficiency due to low Mg intake has not yet been identified. We speculate that metabolomics will be effective for biomarker discovery because Mg can affect various metabolic processes in the body.

View Article and Find Full Text PDF

The dataset represents a significant advancement in Bengali lip-reading and visual speech recognition research, poised to drive future applications and technological progress. Despite Bengali's global status as the seventh most spoken language with approximately 265 million speakers, linguistically rich and widely spoken languages like Bengali have been largely overlooked by the research community. fills this gap by offering a pioneering dataset tailored for Bengali lip-reading, comprising visual data from 150 speakers across 54 classes, encompassing Bengali phonemes, alphabets, and symbols.

View Article and Find Full Text PDF

Blood-based biomarkers for motor neuron disease are needed for better diagnosis, progression prediction, and clinical trial monitoring. We used whole blood-derived total RNA and performed whole transcriptome analysis to compare the gene expression profiles in (motor neurone disease) MND patients to the control subjects. We compared 42 MND patients to 42 aged and sex-matched healthy controls and described the whole transcriptome profile characteristic for MND.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!