A Deep Learning Model for Markerless Pose Estimation Based on Keypoint Augmentation: What Factors Influence Errors in Biomechanical Applications?

In biomechanics, movement is typically recorded by tracking the trajectories of anatomical landmarks previously marked using passive instrumentation, which entails several inconveniences. To overcome these disadvantages, researchers are exploring different markerless methods, such as pose estimation networks, to capture movement with equivalent accuracy to marker-based photogrammetry. However, pose estimation models usually only provide joint centers, which are incomplete data for calculating joint angles in all anatomical axes.

Multimodal human motion dataset of 3D anatomical landmarks and pose keypoints.

In this paper, we present a dataset that takes 2D and 3D human pose keypoints estimated from images and relates them to the location of 3D anatomical landmarks. The dataset contains 51,051 poses obtained from 71 persons in A-Pose while performing 7 movements (walking, running, squatting, and four types of jumping). These poses were scanned to build a collection of 3D moving textured meshes with anatomical correspondence.

Positioning errors of anatomical landmarks identified by fixed vertices in homologous meshes.

Background: Human movement analysis is usually achieved by tracking markers attached to anatomical landmarks with photogrammetry. Such marker-based systems have disadvantages that have led to the development of markerless procedures, although their accuracy is not usually comparable to that of manual palpation procedures. New motion acquisition systems, such as 3D temporal scanners, provide homologous meshes that can be exploited for this purpose.

Accuracy of a 3D temporal scanning system for gait analysis: Comparative with a marker-based photogrammetry system.

Background: Combining the accuracy of marker-based stereophotogrammetry and the usability and comfort of markerless human movement analysis is a difficult challenge. 3D temporal scanners are a promising solution, since they provide moving meshes with thousands of vertices that can be used to analyze human movements.

Research Question: Can a 3D temporal scanner be used as a markerless system for gait analysis with the same accuracy as traditional, marker-based stereophotogrammetry systems?

Methods: A comparative study was carried out using a 3D temporal scanner synchronized with a marker-based stereophotogrammetry system.