How much can we infer about human shape using an event camera that only detects the pixel position where the luminance changed and its timestamp? This neuromorphic vision technology captures changes in pixel values at ultra-high speeds, regardless of the variations in environmental lighting brightness. Existing methods for human mesh recovery (HMR) from event data need to utilize intensity images captured with a generic frame-based camera, rendering them vulnerable to low-light conditions, energy/memory constraints, and privacy issues. In contrast, we explore the potential of solely utilizing event data to alleviate these issues and ascertain whether it offers adequate cues for HMR, as illustrated in Fig. 1. This is a quite challenging task due to the substantially limited information ensuing from the absence of intensity images. To this end, we propose EventPointMesh, a framework which treats event data as a three-dimensional (3D) spatio-temporal point cloud for reconstructing the human mesh. By employing a coarse-to-fine pose feature extraction strategy, we extract both global features and local features. The local features are derived by processing the spatio-temporally dispersed event points into groups associated with individual body segments. This combination of global and local features allows the framework to achieve a more accurate HMR, capturing subtle differences in human movements. Experiments demonstrate that our method with only sparse event data outperforms baseline methods. The dataset and code will be available at https://github.com/RyosukeHori/EventPointMesh.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2024.3462816DOI Listing

Publication Analysis

Top Keywords

event data
16
human mesh
12
local features
12
mesh recovery
8
intensity images
8
features local
8
event
7
eventpointmesh human
4
recovery solely
4
solely event
4

Similar Publications

Importance: Retrieval strategies for children, adolescents, and young adults with relapsed classic Hodgkin lymphoma (cHL) aim to maintain efficacy while minimizing long-term toxic effects. Children, adolescents, and young adults with low-risk, relapsed cHL may benefit from replacing high-dose chemotherapy and autologous stem cell transplant with less intensive involved-site radiotherapy (ISRT).

Objective: To evaluate a risk-stratified, response-adapted, transplant-free approach for treatment of children, adolescents, and young adults with low-risk relapsed cHL with nivolumab plus brentuximab vedotin (BV) followed by BV plus bendamustine for patients with suboptimal response and ISRT (30.

View Article and Find Full Text PDF

High incidence of tuberculosis in young children living with HIV in the Western Cape, South Africa.

J Acquir Immune Defic Syndr

January 2025

Centre for Infectious Disease Epidemiology and Research, School of Public Health, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa.

Background: Data on tuberculosis (TB) incidence and risk factors among children living with HIV (CLHIV) in the universal ART era are limited.

Methods: We analysed routinely-collected data on TB diagnoses for CLHIV age ≤5 years, born 2018-2022, in the Westen Cape, South Africa. We examined factors associated with TB diagnosis, with death and loss to follow-up as competing events.

View Article and Find Full Text PDF

Importance: Hypertension underpins significant global morbidity and mortality. Early lifestyle intervention and treatment are effective in reducing adverse outcomes. Artificial intelligence-enhanced electrocardiography (AI-ECG) has been shown to identify a broad spectrum of subclinical disease and may be useful for predicting incident hypertension.

View Article and Find Full Text PDF

Importance: The current standard-of-care salvage therapy in relapsed/refractory classic Hodgkin lymphoma (cHL) includes consolidation high-dose chemotherapy (HDCT)/autologous stem cell transplant (aSCT).

Objective: To investigate whether presalvage risk factors and fludeoxyglucose-18 (FDG) positron emission tomography (PET) response to reinduction chemotherapy can guide escalation or de-escalation between HDCT/aSCT or transplant-free consolidation with radiotherapy to minimize toxic effects while maintaining high cure rates.

Design, Setting, And Participants: EuroNet-PHL-R1 was a nonrandomized clinical trial that enrolled patients younger than 18 years with first relapsed/refractory cHL across 68 sites in 13 countries in Europe between January 2007 and January 2013.

View Article and Find Full Text PDF

Background: Repetitive transcranial magnetic stimulation (rTMS) has shown potential in alleviating hemiplegic shoulder pain (HSP) and improving upper limb function, yet its efficacy remains debated. This study aims to assess the effectiveness of rTMS for HSP through a systematic review and meta-analysis.

Methods: Four databases were searched with the keywords "rTMS" and "HSP".

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!