Learning joints relation graphs for video action recognition.

Front Neurorobot

School of Software, Henan Institute of Engineering, Zhengzhou, China.

Published: October 2022

AI Article Synopsis

  • Previous video action recognition methods largely focus on spatial and temporal features while neglecting the relationships between joints, which are crucial for accurately identifying actions.
  • This paper introduces a joint spatial-temporal reasoning (JSTR) framework that emphasizes the importance of joint relationships to improve action recognition from videos.
  • The JSTR framework incorporates a spatial relation graph for joint positioning and an intra-joint temporal relation graph for capturing time dynamics, successfully demonstrating its effectiveness across three real-world video action recognition datasets.

Article Abstract

Previous video action recognition mainly focuses on extracting spatial and temporal features from videos or capturing physical dependencies among joints. The relation between joints is often ignored. Modeling the relation between joints is important for action recognition. Aiming at learning discriminative relation between joints, this paper proposes a joint spatial-temporal reasoning (JSTR) framework to recognize action from videos. For the spatial representation, a joints spatial relation graph is built to capture position relations between joints. For the temporal representation, temporal information of body joints is modeled by the intra-joint temporal relation graph. The spatial reasoning feature and the temporal reasoning feature are fused to recognize action from videos. The effectiveness of our method is demonstrated in three real-world video action recognition datasets. The experiment results display good performance across all of these datasets.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9597689PMC
http://dx.doi.org/10.3389/fnbot.2022.918434DOI Listing

Publication Analysis

Top Keywords

action recognition
16
video action
12
relation joints
12
joints relation
8
recognize action
8
action videos
8
relation graph
8
reasoning feature
8
joints
7
relation
6

Similar Publications

Background/purpose: launched a call to action for dermatologists in the rise of syphilis. In practice, dermatologists and stomatologists perform early diagnoses of syphilis and refer patients to adequate treatment.

Materials And Methods: This scientometric study aimed to investigate and compare research trends and characteristics of syphilis publications by dermatologists and stomatologists in the Scopus database, with emphasis on the analysis of the keywords that can reflect research directions and topics of concern.

View Article and Find Full Text PDF

Tau oligomers impair memory and synaptic plasticity through the cellular prion protein.

Acta Neuropathol Commun

January 2025

Department of Neuroscience, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy.

Deposition of abnormally phosphorylated tau aggregates is a central event leading to neuronal dysfunction and death in Alzheimer's disease (AD) and other tauopathies. Among tau aggregates, oligomers (TauOs) are considered the most toxic. AD brains show significant increase in TauOs compared to healthy controls, their concentration correlating with the severity of cognitive deficits and disease progression.

View Article and Find Full Text PDF

Analyzing the habits of exercisers is crucial for developing targeted interventions that can effectively promote long-term physical activity behavior. While much of existing literature has focused on individual-level factors, there is a growing recognition of the importance of examining how broader determinants impact physical activity. In this study, we analyze large-scale human mobility data from over 20 million individuals to investigate how visits to various locations, such as cafes and restaurants, influence visits to fitness centers.

View Article and Find Full Text PDF

Nursing team proxemic mapping in the hemotherapy space.

Rev Esc Enferm USP

January 2025

Universidade Federal do Rio de Janeiro, Escola de Enfermagem Anna Nery, Departamento de Enfermagem Médico-Cirúrgica, Rio de Janeiro, RJ, Brazil.

Objective: To analyze the influence of proxemic factors on communication and care provided by nursing professionals during transfusion in hemotherapy.

Method: A descriptive, exploratory and qualitative study with 25 nursing professionals from a hospital specializing in onco-hematological diseases in Rio de Janeiro, based on a systematized script, individual records of proxemic factors described by Edward Hall and recorded situational interviews. The analysis considered data thematic content and used the SketchUp 3D Modeling Software Review program to visually demonstrate the behavioral mapping of the interaction of nursing professionals with patients during care.

View Article and Find Full Text PDF

Breaking down silos and echo chambers: Adolescence through an interdisciplinary lens.

J Res Adolesc

March 2025

Department of Health Policy and Department of Human and Organizational Development, Vanderbilt University, Nashville, Tennessee, USA.

Research on adolescence occurs across a variety of disciplines, including education, psychology, sociology, public health, biology, and medicine, among other fields, each with its own definition of the most pressing problems, levels of analysis, and proposed solutions. There is widespread recognition that human development occurs across levels simultaneously from molecular changes to broader cultural systems. Yet it remains challenging to integrate across levels and scholarly disciplines.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!