Temporal Gap-Aware Attention Model for Temporal Action Proposal Generation.

J Imaging

National Electronic and Computer Technology Center, National Science and Technology Development Agency, Khlong Nueng, Khlong Luang District, Pathum Thani 12120, Thailand.

Published: November 2024

Temporal action proposal generation is a method for extracting temporal action instances or proposals from untrimmed videos. Existing methods often struggle to segment contiguous action proposals, which are a group of action boundaries with small temporal gaps. To address this limitation, we propose incorporating an attention mechanism to weigh the importance of each proposal within a contiguous group. This mechanism leverages the gap displacement between proposals to calculate attention scores, enabling a more accurate localization of action boundaries. We evaluate our method against a state-of-the-art boundary-based baseline on ActivityNet v1.3 and Thumos 2014 datasets. The experimental results demonstrate that our approach significantly improves the performance of short-duration and contiguous action proposals, achieving an average recall of 78.22%.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11678434PMC
http://dx.doi.org/10.3390/jimaging10120307DOI Listing

Publication Analysis

Top Keywords

temporal action
12
action proposal
8
proposal generation
8
contiguous action
8
action proposals
8
action boundaries
8
action
7
temporal
5
temporal gap-aware
4
gap-aware attention
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!