Generic Object Sensor and Spoof Noise Classification, Modeling, and Synthesis

Joel Stehouwer, Amin Jourabloo, Yaojie Liu, Xiaoming Liu

Keywords: Low-level Vision, Database

Biometric recognition is increasingly used in commercial and high-security settings. Because of this, the threat of spoofing techniques, the act of presenting a fake biometric object to a sensor, is a large concern. Recent research has focused on face, fingerprint, and iris anti-spoofing. However, no other research attempts to use data from generic objects, which does not suffer from privacy concerns, for the task of anti-spoofing. We show that algorithms trained on generic objects can generalize to the face modality.

Illustration of the anti-spoof process and the motivation for generic object anti-spoofing and novel noise synthesis.

Figure 1: The generic object anti-spoofing process. Generic objects can generalize to biometric modalities because it learns cues that are image content independent. We introduce a method to synthesize unseen combinations (marked as X) of sensors and mediums.

The use of generic objects provides for rich appearance variation and simplicity in additional data collection. To improve anti-spoofing performance, we introduce a method to synthesize images from novel, unseen, combinations of sensors and mediums. This synthesized data is used to increase the anti-spoofing ability of the GOLab algorithm.

Architecture of the proposed generic object noise synthesis and classification networks.

Figure 2: Overview for the GOAS architecture. We alternate training between GOGen and GOLab/GODisc. The GOGen learns noise prototypes for each sensor and medium, which improves its ability to synthesize targeted combinations.

GOSet Dataset

GOSet dataset download page: http://cvlab.cse.msu.edu/goset-generic-object-dataset.html

The GOSet dataset contains live and spoof videos from 24 objects captured by 7 camera sensors in the live configuration and through 6 spoof mediums.

GOGen and GOLab Source Code

The source code for the GOGen and GOLab networks is available at: https://github.com/JStehouwer/GOAS_CVPR2020

Acknowledgement

This research is based upon work supported by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via IARPA R&D Contract No.~2017-17020200004. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon.

Publications

  • Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing
    Joel Stehouwer, Amin Jourabloo, Yaojie Liu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Poster | Code
    • @inproceedings{ noise-modeling-synthesis-and-classification-for-generic-object-anti-spoofing,
      author = { Joel Stehouwer and Amin Jourabloo and Yaojie Liu and Xiaoming Liu },
      title = { Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }