Co-linguistic content inferences: From gestures to sound effects and emoji.

Q J Exp Psychol (Hove)

Western Sydney University, MARCS Institute for Brain, Behaviour and Development, Penrith, NSW, Australia.

Published: October 2022

Among other uses, co-speech gestures can contribute additional semantic content to the spoken utterances with which they coincide. A growing body of research is dedicated to understanding how inferences from gestures interact with logical operators in speech, including negation ("not"/"n't"), modals (e.g., "might"), and quantifiers (e.g., "each," "none," "exactly one"). A related but less addressed question is what kinds of meaningful content other than gestures can evince this same behaviour; this is in turn connected to the much broader question of what properties of gestures are responsible for how they interact with logical operators. We present two experiments investigating sentences with and in lieu of gestures, revealing a remarkably similar inference pattern to that of co-speech gestures. The results suggest that gestural inferences do not behave the way they do because of any traits specific to gestures, and that the inference pattern extends to a much broader range of content.

Download full-text PDF

Source
http://dx.doi.org/10.1177/17470218221080645DOI Listing

Publication Analysis

Top Keywords

gestures
8
inferences gestures
8
co-speech gestures
8
interact logical
8
logical operators
8
inference pattern
8
co-linguistic content
4
content inferences
4
gestures sound
4
sound effects
4

Similar Publications

Objectives: In recent years, significant progress has been made in the research of gesture recognition using surface electromyography (sEMG) signals based on machine learning and deep learning techniques. The main motivation for sEMG gesture recognition research is to provide more natural, convenient, and personalized human-computer interaction, which makes research in this field have considerable application prospects in rehabilitation technology. However, the existing gesture recognition algorithms still need to be further improved in terms of global feature capture, model computational complexity, and generalizability.

View Article and Find Full Text PDF

Impact of expressive intentions on upper-body kinematics in two expert pianists.

Front Psychol

January 2025

Laboratoire de Simulation et Modélisation du Mouvement, École de Kinésiologie et des Sciences de l'Activité Physique, Université de Montréal, Montréal, QC, Canada.

Introduction: Expression is a key aspect of music performance. Studies on pianists' gestures and expression have mainly documented the impact of their expressive intentions on proximal segments and head linear kinematics. It remains unclear how pianists' expressive intentions influence joint angular kinematics as well as exposure to risk factors of injury, such as poor overall posture and distal jerky movements, two kinematic factors linked to injury.

View Article and Find Full Text PDF

Introduction Effective communication is crucial for healthcare professionals, impacting patient care and interdisciplinary collaboration. However, medical education often lacks structured training in communication and presentation techniques. Herein, we evaluate the efficacy of structured workshops aimed at enhancing presentation skills among ear, nose, and throat (ENT) doctors through training in visual material design and concise verbal communication, including elevator pitches.

View Article and Find Full Text PDF

In human-computer interaction, gesture recognition based on physiological signals offers advantages such as a more natural and fast interaction mode and less constrained by the environment than visual-based. Surface electromyography-based gesture recognition has significantly progressed. However, since individuals have physical differences, researchers must collect data multiple times from each user to train the deep learning model.

View Article and Find Full Text PDF

Objective: The goal of this study is to construct a 16-week, two-stage, adaptive intervention consisting of DTT ([discrete trials training], largely considered usual care for children with autism), JASP-EMT (a blended, naturalistic, developmental behavioral intervention involving JASPER [joint attention, symbolic play, engagement and regulation] and EMT [enhanced milieu teaching]), and parent training (P) for improving spontaneous, communicative utterances in school-aged, minimally verbal autistic children. Intervention was delivered both at school (DTT, JASP-EMT) and home (P). This manuscript reports results for the study's primary aim and a closely related secondary aim.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!