Sign language is a visual language used by deaf people. One difficulty of sign language recognition is that sign instances of vary in both motion and shape in three-dimensional (3D) space. In this research, we use 3D depth information from hand motions, generated from Microsoft's Kinect sensor and apply a hierarchical conditional random field (CRF) that recognizes hand signs from the hand motions. The proposed method uses a hierarchical CRF to detect candidate segments of signs using hand motions, and then a BoostMap embedding method to verify the hand shapes of the segmented signs. Experiments demonstrated that the proposed method could recognize signs from signed sentence data at a rate of 90.4%.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4327011 | PMC |
| http://dx.doi.org/10.3390/s150100135 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Assessing sign language comprehension in adults with intellectual disability and deafness.
J Deaf Stud Deaf Educ
January 2025
Institute of Neurology of Senses and Language, Hospital of St. John of God Linz, Linz, Austria.
Language comprehension is an essential component of human development that is associated not only with expressive language development and knowledge acquisition, but also with social inclusion, mental health, and quality of life. For deaf and hard-of-hearing adults with intellectual disability, there is a paucity of measures of receptive sign language skills, although these are a prerequisite for individualized planning and evaluation of intervention. Assessments require materials and procedures that are accurate, feasible, and suitable for low levels of functioning.
View Article and Find Full Text PDFThe impact of face masks on metacognition in sign language is mediated by proficiency.
Cogn Process
January 2025
Institute of Cognitive Sciences and Technologies (ISTC-CNR), Via Nomentana 56, 00161, Rome, Italy.
Face masks can impact processing a narrative in sign language, affecting several metacognitive dimensions of understanding (i.e., perceived effort, confidence and feeling of understanding).
View Article and Find Full Text PDFDevelopment, Reliability, and Concurrent Validity of the American Sign Language Version of the Computerized Revised Token Test.
J Speech Lang Hear Res
January 2025
Department of Communication Science and Disorders, University of Pittsburgh, PA.
Purpose: The present study assessed the test-retest reliability of the American Sign Language (ASL) version of the Computerized Revised Token Test (CRTT-ASL) and compared the differences and similarities between ASL and English reading by Deaf and hearing users of ASL.
Method: Creation of the CRTT-ASL involved filming, editing, and validating CRTT instructions, sentence commands, and scoring. Deaf proficient (DP), hearing nonproficient (HNP), and hearing proficient sign language users completed the CRTT-ASL and the English self-paced, word-by-word reading CRTT (CRTT-Reading-Word Fade [CRTT-R-wf]).
Using peer narrative support to promote return to work for cancer survivors: a protocol study of action research.
Arch Public Health
January 2025
School of Nursing and Rehabilitation, Nantong University, Nantong, Jiangsu, 226001, China.
Background: Chinese cancer survivors are not doing well in returning to work. Peer support, as an external coping resource to help cancer survivors return to work, brings together members of the lay community with similar stressors or problems for mutual support. Peer volunteers have not received systematic training, so inappropriate language in the support process can often cause secondary damage to both the peer and the cancer survivor.
View Article and Find Full Text PDFSign Language Recognition System for Deaf Patients: Protocol for a Systematic Review.
JMIR Res Protoc
January 2025
Department of Computer Science, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil.
Background: Individuals with hearing impairments may face hindrances in health care assistance, which may significantly impact the prognosis and the incidence of complications and iatrogenic events. Therefore, the development of automatic communication systems to assist the interaction between this population and health care workers is paramount.
Objective: This study aims to systematically review the evidence on communication systems using human-computer interaction techniques developed for deaf people who communicate through sign language that are already in use or proposed for use in health care contexts and have been tested with human users or videos of human users.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!