Impacts of Image Obfuscation on Fine-grained Activity Recognition in Egocentric Video.

Proc IEEE Int Conf Pervasive Comput Commun Workshops

Department of Computer Science, Northwestern University, Evanston, IL, USA.

Published: March 2022

Automated detection and validation of fine-grained human activities from egocentric vision has gained increased attention in recent years due to the rich information afforded by RGB images. However, it is not easy to discern how much rich information is necessary to detect the activity of interest reliably. Localization of hands and objects in the image has proven helpful to distinguishing between hand-related fine-grained activities. This paper describes the design of a hand-object-based mask obfuscation method (HOBM) and assesses its effect on automated recognition of fine-grained human activities. HOBM masks all pixels other than the hand and object in-hand, improving the protection of personal user information (PUI). We test a deep learning model trained with and without obfuscation using a public egocentric activity dataset with 86 class labels and achieve almost similar classification accuracies (2% decrease with obfuscation). Our findings show that it is possible to protect PUI at smaller image utility costs (loss of accuracy).

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704364PMC
http://dx.doi.org/10.1109/percomworkshops53856.2022.9767447DOI Listing

Publication Analysis

Top Keywords

fine-grained human
8
human activities
8
impacts image
4
obfuscation
4
image obfuscation
4
fine-grained
4
obfuscation fine-grained
4
fine-grained activity
4
activity recognition
4
recognition egocentric
4

Similar Publications

CTCNet: a fine-grained classification network for fluorescence images of circulating tumor cells.

Med Biol Eng Comput

January 2025

Anhui BioX-Vision Biological Technology Co., Ltd, Hefei, 230031, Anhui, China.

The identification and categorization of circulating tumor cells (CTCs) in peripheral blood are imperative for advancing cancer diagnostics and prognostics. The intricacy of various CTCs subtypes, coupled with the difficulty in developing exhaustive datasets, has impeded progress in this specialized domain. To date, no methods have been dedicated exclusively to overcoming the classification challenges of CTCs.

View Article and Find Full Text PDF

With the rapid development of artificial intelligence technology, an increasing number of village-related modeling problems have been addressed. However, first, the exploration of village-related watershed fine-grained classification problems, particularly the multi-view watershed fine-grained classification problem, has been hindered by dataset collection limitations; Second, village-related modeling networks typically employ convolutional modules for attentional modeling to extract salient features, yet they lack global attentional feature modeling capabilities; Lastly, the extensive number of parameters and significant computational demands render village-related watershed fine-grained classification networks infeasible for end-device deployment. To tackle these challenges, we introduce a multi-view attention mechanism designed for precise watershed classification, leveraging knowledge distillation techniques, abbreviated as MANet-KD.

View Article and Find Full Text PDF

The fine-grained mining and construction of semantic associations within multimodal intangible cultural heritage (ICH) resources are crucial for deepening our understanding of their knowledge content and ensuring their systematic protection and transmission in the digital and intelligent era. This paper addresses the urgent need for the digital preservation and transmission of ICH resources. Following a review of current research on Qingyang sachets and ICH, the study introduces an ontology-based approach to constructing a semantic description model for the multimodal digital resources related to Qingyang sachets.

View Article and Find Full Text PDF

After a long-distance migration, Avars with Eastern Asian ancestry arrived in Eastern Central Europe in 567 to 568 CE and encountered groups with very different European ancestry. We used ancient genome-wide data of 722 individuals and fine-grained interdisciplinary analysis of large seventh- to eighth-century CE neighbouring cemeteries south of Vienna (Austria) to address the centuries-long impact of this encounter. We found that even 200 years after immigration, the ancestry at one site (Leobersdorf) remained dominantly East Asian-like, whereas the other site (Mödling) shows local, European-like ancestry.

View Article and Find Full Text PDF

Multi-source biological knowledge-guided hypergraph spatiotemporal subnetwork embedding for protein complex identification.

Brief Bioinform

November 2024

Information Science and Technology College, Dalian Maritime University, No.1 Linghai Road, 116026, Dalian, Liaoning, China.

Identifying biologically significant protein complexes from protein-protein interaction (PPI) networks and understanding their roles are essential for elucidating protein functions, life processes, and disease mechanisms. Current methods typically rely on static PPI networks and model PPI data as pairwise relationships, which presents several limitations. Firstly, static PPI networks do not adequately represent the scopes and temporal dynamics of protein interactions.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!