DEFAEK: Domain Effective Fast Adaptive Network for Face Anti-Spoofing.

Neural Netw

Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, 106335, Taiwan, ROC. Electronic address:

Published: April 2023

Existing deep learning based face anti-spoofing (FAS) or deepfake detection approaches usually rely on large-scale datasets and powerful networks with significant amount of parameters to achieve satisfactory performance. However, these make them resource-heavy and unsuitable for handheld devices. Moreover, they are limited by the types of spoof in the dataset they train on and require considerable training time. To produce a robust FAS model, they need large datasets covering the widest variety of predefined presentation attacks possible. Testing on new or unseen attacks or environments generally results in poor performance. Ideally, the FAS model should learn discriminative features that can generalize well even on unseen spoof types. In this paper, we propose a fast learning approach called Domain Effective Fast Adaptive nEt-worK (DEFAEK), a face anti-spoofing approach based on the optimization-based meta-learning paradigm that effectively and quickly adapts to new tasks. DEFAEK treats differences in an environment as domains and simulates multiple domain shifts during training. To further improve the effectiveness and efficiency of meta-learning, we adopt the metric learning in the inner loop update with careful sample selection. With extensive experiments on the challenging CelebA-Spoof and FaceForensics++ datasets, the evaluation results show that DEFAEK can learn cues independent of the environment with good generalization capability. In addition, the resulting model is lightweight following the design principle of modern lightweight network architecture and still generalizes well on unseen classes. In addition, we also demonstrate our model's capabilities by comparing the numbers of parameters, FLOPS, and model performance with other state-of-the-art methods.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2023.01.018DOI Listing

Publication Analysis

Top Keywords

face anti-spoofing
12
domain effective
8
effective fast
8
fast adaptive
8
fas model
8
well unseen
8
defaek
4
defaek domain
4
adaptive network
4
network face
4

Similar Publications

Makeup modifies facial textures and colors, impacting the precision of face anti-spoofing systems. Many individuals opt for light makeup in their daily lives, which generally does not hinder face identity recognition. However, current research in face anti-spoofing often neglects the influence of light makeup on facial feature recognition, notably the absence of publicly accessible datasets featuring light makeup faces.

View Article and Find Full Text PDF

Optical neural networks are considered next-generation physical implementations of artificial neural networks, but their capabilities are limited by on-chip integration scale and requirement for coherent light sources. This study proposes a spectral convolutional neural network (SCNN) with matter meta-imaging. The optical convolutional layer is implemented by integrating very large-scale and pixel-aligned spectral filters on CMOS image sensor.

View Article and Find Full Text PDF

Generalizing face anti-spoofing (FAS) models to unseen distributions is challenging due to domain shifts. Previous domain generalization (DG) based FAS methods focus on learning invariant features across domains in the spatial space, which may be ineffective in detecting subtle spoof patterns. In this paper, we propose a novel approach called Frequency Space Disentanglement and Augmentation (FSDA) for generalizable FAS.

View Article and Find Full Text PDF

Algorithm of face anti-spoofing based on pseudo-negative features generation.

Front Neurosci

April 2024

Data and AI Technology Company, China Telecom Corporation Ltd., Beijing, China.

Article Synopsis
  • Advancements in face anti-spoofing technology face challenges due to evolving attacker methods, diverse presentation modes, and a lack of negative sample data, highlighting the need for better cross-domain strategies.
  • The new method enhances face anti-spoofing systems by generating pseudo-negative features and using KL divergence loss to improve the training dataset, leading to a more effective classifier.
  • Experimental results from four public datasets show that the proposed approach significantly improves performance on both small and large datasets, demonstrating strong generalization across different scenarios.
View Article and Find Full Text PDF

Face Anti-Spoofing (FAS) seeks to protect face recognition systems from spoofing attacks, which is applied extensively in scenarios such as access control, electronic payment, and security surveillance systems. Face anti-spoofing requires the integration of local details and global semantic information. Existing CNN-based methods rely on small stride or image patch-based feature extraction structures, which struggle to capture spatial and cross-layer feature correlations effectively.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!