3D Face Modeling | 3D Object Detection | 3D Shape Correspondence | 3D Shape Reconstruction | Activity Recognition | Application | Biometrics | Camera Calibration | Camera+LiDAR+Radar | Data Imputation | Database | Depth Completion | Depth Prediction | Domain Adaptation | Expression Recognition | Face Alignment | Face Antispoofing | Face Deidentification | Face Recognition | Face Reconstruction | Face Relighting | Face Synthesis | Forecasting | Gait Recognition | Generic Object 3D Reconstruction | Image Alignment | Image Manipulation | Image Segmentation | Low-level Vision | Medical Imaging | Motion Compensation | Multi-modality | Multimedia Retrieval | Object Detection | Pedestrian Detection | Plant Vision | Semantic Segmentation | Surveillance | Tracking | Typing Behavior

Low-level Vision

  1. summary image

    Face Relighting with Geometrically Consistent Shadows

    Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu

    Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose. Methods that propose techniques for handling hard shadows often do not produce geometrically consistent shadows since they do not directly leverage the estimated face geometry while synthesizing ...

    Continue reading

    Keywords: Face Relighting, Low-level Vision

  2. summary image

    Proactive Image Manipulation Detection

    Vishal Asnani, Xi Yin, Tal Hassner, Sijia Liu, Xiaoming Liu

    Image manipulation detection algorithms are often trained to discriminate between images manipulated with particular Generative Models (GMs) and genuine/real images, yet generalize poorly to images manipulated with GMs unseen in the training. Conventional detection algorithms receive an input image passively. By contrast, we propose a proactive scheme to image ...

    Continue reading

    Keywords: Image Manipulation, Low-level Vision

  3. summary image

    Towards High Fidelity Face Relighting with Realistic Shadows

    Andrew Hou, Ze Zhang, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu

    Existing face relighting methods often struggle with two problems: maintaining the local facial details of the subject and accurately removing and synthesizing shadows in the relit image, especially hard shadows. We propose a novel deep face relighting method that addresses both problems. Our method learns to predict the ratio (quotient ...

    Continue reading

    Keywords: Face Relighting, Low-level Vision

  4. summary image

    Face Anti-spoofing, Face Presentation Attack Detection

    Yaojie Liu, Joel Stehouwer, Amin Jourabloo, Yousef Atoum, Xiaoming Liu

    Biometrics utilize physiological, such as fingerprint, face, and iris, or behavioral characteristics, such as typing rhythm and gait, to uniquely identify or authenticate an individual. As biometric systems are widely used in real-world applications including mobile phone authentication and access control, biometric spoof, or Presentation Attack (PA) are becoming a ...

    Continue reading

    Keywords: Face Antispoofing, Biometrics, Low-level Vision, Database

  5. summary image

    Facial Forgery Detection

    Hao Dang*, Feng Liu*, Joel Stehouwer*, Xiaoming Liu, Anil Jain

    The prevalence of facial recognition, biometric unlock, and social media presents a significant opportunity for bad actors to introduce forged or manipulated images to spread false information or damage reputations. This is aided by the continuing improvement in realistic image synthesis and manipulation by generative adversarial network, GAN, based methods ...

    Continue reading

    Keywords: Image Manipulation, Low-level Vision, Database

  6. summary image

    Generic Object Sensor and Spoof Noise Classification, Modeling, and Synthesis

    Joel Stehouwer, Amin Jourabloo, Yaojie Liu, Xiaoming Liu

    Biometric recognition is increasingly used in commercial and high-security settings. Because of this, the threat of spoofing techniques, the act of presenting a fake biometric object to a sensor, is a large concern. Recent research has focused on face, fingerprint, and iris anti-spoofing. However, no other research attempts to use ...

    Continue reading

    Keywords: Low-level Vision, Database

2023

  • FaceGuard: A Self-Supervised Defense Against Adversarial Face Images
    Debayan Deb, Xiaoming Liu, Anil Jain
    In Proceedings of the 17th International Conference on Automatic Face and Gesture Recognition (FG), Hawaii, USA, Jan. 2023
    Bibtex | PDF | arXiv
  • @inproceedings{ faceguard-a-self-supervised-defense-against-adversarial-face-images,
      author = { Debayan Deb and Xiaoming Liu and Anil Jain },
      title = { FaceGuard: A Self-Supervised Defense Against Adversarial Face Images },
      booktitle = { In Proceedings of the 17th International Conference on Automatic Face and Gesture Recognition (FG) },
      address = { Hawaii, USA },
      month = { January },
      year = { 2023 },
    }
  • Unified Detection of Digital and Physical Face Attacks
    Debayan Deb, Xiaoming Liu, Anil Jain
    In Proceedings of the 17th International Conference on Automatic Face and Gesture Recognition (FG), Hawaii, USA, Jan. 2023
    Bibtex | PDF | arXiv
  • @inproceedings{ unified-detection-of-digital-and-physical-face-attacks,
      author = { Debayan Deb and Xiaoming Liu and Anil Jain },
      title = { Unified Detection of Digital and Physical Face Attacks },
      booktitle = { In Proceedings of the 17th International Conference on Automatic Face and Gesture Recognition (FG) },
      address = { Hawaii, USA },
      month = { January },
      year = { 2023 },
    }

2022

  • PSSC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization
    Xiaohong Liu, Yaojie Liu, Jun Chen, Xiaoming Liu
    IEEE Transactions on Circuits and Systems for Video Technology, , Jul. 2022 (in press)
    Bibtex | PDF | arXiv | Code
  • @article{ pssc-net-progressive-spatio-channel-correlation-network-for-image-manipulation-detection-and-localization,
      author = { Xiaohong Liu and Yaojie Liu and Jun Chen and Xiaoming Liu },
      title = { PSSC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localization },
      journal = { IEEE Transactions on Circuits and Systems for Video Technology },
      month = { July },
      year = { 2022 },
    }
  • Spoof Trace Disentanglement for Generic Face Anti-Spoofing
    Yaojie Liu, Xiaoming Liu
    IEEE Transactions on Pattern Analysis and Machine Intelligence, , May. 2022
    Bibtex | PDF | arXiv | Project Webpage
  • @article{ spoof-trace-disentanglement-for-generic-face-anti-spoofing,
      author = { Yaojie Liu and Xiaoming Liu },
      title = { Spoof Trace Disentanglement for Generic Face Anti-Spoofing },
      journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
      month = { May },
      year = { 2022 },
    }
  • Multi-domain Learning for Updating Face Anti-spoofing Models
    Xiao Guo, Yaojie Liu, Anil Jain, Xiaoming Liu
    In Proceeding of European Conference on Computer Vision (ECCV 2022), Tel-Aviv, Israel, Oct. 2022 (Oral presentation)
    Bibtex | PDF | arXiv | Supplemental | Code
  • @inproceedings{ multi-domain-learning-for-updating-face-anti-spoofing-models,
      author = { Xiao Guo and Yaojie Liu and Anil Jain and Xiaoming Liu },
      title = { Multi-domain Learning for Updating Face Anti-spoofing Models },
      booktitle = { In Proceeding of European Conference on Computer Vision },
      address = { Tel-Aviv, Israel },
      month = { October },
      year = { 2022 },
    }
  • Face Relighting with Geometrically Consistent Shadows
    Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, Jun. 2022
    Bibtex | PDF | arXiv | Supplemental | Project Webpage | Code | Video
  • @inproceedings{ face-relighting-with-geometrically-consistent-shadows,
      author = { Andrew Hou and Michel Sarkis and Ning Bi and Yiying Tong and Xiaoming Liu },
      title = { Face Relighting with Geometrically Consistent Shadows },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { New Orleans, LA },
      month = { June },
      year = { 2022 },
    }
  • Proactive Image Manipulation Detection
    Vishal Asnani, Xi Yin, Tal Hassner, Sijia Liu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, Jun. 2022
    Bibtex | PDF | arXiv | Supplemental | Project Webpage | Code
  • @inproceedings{ proactive-image-manipulation-detection,
      author = { Vishal Asnani and Xi Yin and Tal Hassner and Sijia Liu and Xiaoming Liu },
      title = { Proactive Image Manipulation Detection },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { New Orleans, LA },
      month = { June },
      year = { 2022 },
    }
  • Reverse Engineering of Imperceptible Adversarial Image Perturbations
    Yifan Gong, Yuguang Yao, Yize Li, Yimeng Zhang, Xiaoming Liu, Xue Lin, Sijia Liu
    In Proceeding of The International Conference on Learning Representations (ICLR 2022), Virtual, Apr. 2022
    Bibtex | PDF
  • @inproceedings{ reverse-engineering-of-imperceptible-adversarial-image-perturbations,
      author = { Yifan Gong and Yuguang Yao and Yize Li and Yimeng Zhang and Xiaoming Liu and Xue Lin and Sijia Liu },
      title = { Reverse Engineering of Imperceptible Adversarial Image Perturbations },
      booktitle = { In Proceeding of The International Conference on Learning Representations },
      address = { Virtual },
      month = { April },
      year = { 2022 },
    }
  • Blind Removal of Facial Foreign Shadows
    Yaojie Liu*, Andrew Hou*, Xinyu Huang, Liu Ren, Xiaoming Liu
    In Proceedings of British Machine Vision Conference (BMVC), London, UK, Nov. 2022
    Bibtex | PDF | Supplemental
  • @inproceedings{ blind-removal-of-facial-foreign-shadows,
      author = { Yaojie Liu* and Andrew Hou* and Xinyu Huang and Liu Ren and Xiaoming Liu },
      title = { Blind Removal of Facial Foreign Shadows },
      booktitle = { In Proceedings of British Machine Vision Conference (BMVC) },
      address = { London, UK },
      month = { November },
      year = { 2022 },
    }

2021

  • Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images
    Vishal Asnani, Xi Yin, Tal Hassner, Xiaoming Liu
    IEEE Transactions on Pattern Analysis and Machine Intelligence, , Apr. 2021 (Under Review)
    Bibtex | PDF | arXiv | Code | Dataset
  • @article{ reverse-engineering-of-generative-models-inferring-model-hyperparameters-from-generated-images,
      author = { Vishal Asnani and Xi Yin and Tal Hassner and Xiaoming Liu },
      title = { Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images },
      journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
      month = { April },
      year = { 2021 },
    }
  • Towards High Fidelity Face Relighting with Realistic Shadows
    Andrew Hou, Ze Zhang, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2021), Nashville, TN, Jun. 2021
    Bibtex | PDF | arXiv | Supplemental | Project Webpage | Code | Video
  • @inproceedings{ towards-high-fidelity-face-relighting-with-realistic-shadows,
      author = { Andrew Hou and Ze Zhang and Michel Sarkis and Ning Bi and Yiying Tong and Xiaoming Liu },
      title = { Towards High Fidelity Face Relighting with Realistic Shadows },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Nashville, TN },
      month = { June },
      year = { 2021 },
    }
  • UltraDepth: Exposing High-resolution Texture from Depth Cameras
    Zhiyuan Xie, Xiaomin Ouyang, Xiaoming Liu, Guoliang Xing
    The 19th ACM Conference on Embedded Networked Sensor Systems (SenSys 2021), Coimbra, Portrugal, Nov. 2021
    Bibtex | PDF | Video
  • @inproceedings{ ultradepth-exposing-high-resolution-texture-from-depth-cameras,
      author = { Zhiyuan Xie and Xiaomin Ouyang and Xiaoming Liu and Guoliang Xing },
      title = { UltraDepth: Exposing High-resolution Texture from Depth Cameras },
      booktitle = { The 19th ACM Conference on Embedded Networked Sensor Systems },
      address = { Coimbra, Portrugal },
      month = { November },
      year = { 2021 },
    }

2020

  • On Disentangling Spoof Traces for Generic Face Anti-Spoofing
    Yaojie Liu, Joel Stehouwer, Xiaoming Liu
    In Proceeding of European Conference on Computer Vision (ECCV 2020), Virtual, Aug. 2020
    Bibtex | PDF | arXiv | Project Webpage | Code | Video
  • @inproceedings{ on-disentangling-spoof-traces-for-generic-face-anti-spoofing,
      author = { Yaojie Liu and Joel Stehouwer and Xiaoming Liu },
      title = { On Disentangling Spoof Traces for Generic Face Anti-Spoofing },
      booktitle = { In Proceeding of European Conference on Computer Vision },
      address = { Virtual },
      month = { August },
      year = { 2020 },
    }
  • On the Detection of Digital Face Manipulation
    Hao Dang*, Feng Liu*, Joel Stehouwer*, Xiaoming Liu, Anil Jain
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Supplemental | Poster | Project Webpage | Code
  • @inproceedings{ on-the-detection-of-digital-face-manipulation,
      author = { Hao Dang* and Feng Liu* and Joel Stehouwer* and Xiaoming Liu and Anil Jain },
      title = { On the Detection of Digital Face Manipulation },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }
  • Camera Trace Erasing
    Chang Chen, Zhiwei Xiong, Xiaoming Liu, Feng Wu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Code
  • @inproceedings{ camera-trace-erasing,
      author = { Chang Chen and Zhiwei Xiong and Xiaoming Liu and Feng Wu },
      title = { Camera Trace Erasing },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }
  • Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing
    Joel Stehouwer, Amin Jourabloo, Yaojie Liu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Poster | Project Webpage | Code
  • @inproceedings{ noise-modeling-synthesis-and-classification-for-generic-object-anti-spoofing,
      author = { Joel Stehouwer and Amin Jourabloo and Yaojie Liu and Xiaoming Liu },
      title = { Noise Modeling, Synthesis and Classification for Generic Object Anti-Spoofing },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }
  • Color-wise Attention Network for Low-light Image Enhancement
    Yousef Atoum, Mao Ye, Liu Ren, Ying Tai, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition Workshop (CVPRW 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Code | Dataset
  • @inproceedings{ color-wise-attention-network-for-low-light-image-enhancement,
      author = { Yousef Atoum and Mao Ye and Liu Ren and Ying Tai and Xiaoming Liu },
      title = { Color-wise Attention Network for Low-light Image Enhancement },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition Workshop },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }

2019

  • Presentation Attack Detection for Face in Mobile Phones
    Yaojie Liu, Joel Stehouwer, Amin Jourabloo, Yousef Atoum, Xiaoming Liu
    Selfie Biometrics, Ajita Rattani, Reza Derakhshani and Arun Ross, Eds., Springer, 2019
    Bibtex | PDF | Project Webpage
  • @incollection{ presentation-attack-detection-for-face-in-mobile-phones,
      author = { Yaojie Liu and Joel Stehouwer and Amin Jourabloo and Yousef Atoum and Xiaoming Liu },
      title = { Presentation Attack Detection for Face in Mobile Phones },
      in book chapter of = { Selfie Biometrics },
      publisher = { Springer },
      editor = { Ajita Rattani, Reza Derakhshani and Arun Ross },
      year = { 2019 },
    }
  • Deep Tree Learning for Zero-shot Face Anti-Spoofing
    Yaojie Liu, Joel Stehouwer, Amin Jourabloo, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, CA, Jun. 2019 (Oral Presentation, Best Paper Award Finalist)
    Bibtex | PDF | arXiv | Poster | Project Webpage | Code | Video
  • @inproceedings{ deep-tree-learning-for-zero-shot-face-anti-spoofing,
      author = { Yaojie Liu and Joel Stehouwer and Amin Jourabloo and Xiaoming Liu },
      title = { Deep Tree Learning for Zero-shot Face Anti-Spoofing },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Long Beach, CA },
      month = { June },
      year = { 2019 },
    }

2018

  • Face De-Spoofing: Anti-Spoofing via Noise Modeling
    Amin Jourabloo*, Yaojie Liu*, Xiaoming Liu
    Proc. European Conference on Computer Vision (ECCV 2018), Munich, Germany, Sep. 2018
    Bibtex | PDF | arXiv | Poster | Project Webpage | Code
  • @inproceedings{ face-de-spoofing-anti-spoofing-via-noise-modeling,
      author = { Amin Jourabloo* and Yaojie Liu* and Xiaoming Liu },
      title = { Face De-Spoofing: Anti-Spoofing via Noise Modeling },
      booktitle = { Proc. European Conference on Computer Vision },
      address = { Munich, Germany },
      month = { September },
      year = { 2018 },
    }
  • FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors
    Yu Chen*, Ying Tai*, Xiaoming Liu, Chunhua Shen, Jian Yang
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2018), Salt Lake City, UT, Jun. 2018 (Spotlight)
    Bibtex | PDF | arXiv | Project Webpage | Code
  • @inproceedings{ fsrnet-end-to-end-learning-face-super-resolution-with-facial-priors,
      author = { Yu Chen* and Ying Tai* and Xiaoming Liu and Chunhua Shen and Jian Yang },
      title = { FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Salt Lake City, UT },
      month = { June },
      year = { 2018 },
    }
  • Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision
    Yaojie Liu*, Amin Jourabloo*, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2018), Salt Lake City, UT, Jun. 2018
    Bibtex | PDF | arXiv | Poster | Project Webpage | Code
  • @inproceedings{ learning-deep-models-for-face-anti-spoofing-binary-or-auxiliary-supervision,
      author = { Yaojie Liu* and Amin Jourabloo* and Xiaoming Liu },
      title = { Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Salt Lake City, UT },
      month = { June },
      year = { 2018 },
    }

2017

  • MemNet: A Persistent Memory Network for Image Restoration
    Ying Tai, Jian Yang, Xiaoming Liu, Chunyan Xu
    In Proceeding of International Conference on Computer Vision (ICCV 2017), Venice, Italy, Oct. 2017
    Bibtex | PDF | Project Webpage | Code
  • @inproceedings{ memnet-a-persistent-memory-network-for-image-restoration,
      author = { Ying Tai and Jian Yang and Xiaoming Liu and Chunyan Xu },
      title = { MemNet: A Persistent Memory Network for Image Restoration },
      booktitle = { In Proceeding of International Conference on Computer Vision },
      address = { Venice, Italy },
      month = { October },
      year = { 2017 },
    }
  • Image Super-Resolution via Deep Recursive Residual Network
    Ying Tai, Jian Yang, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, Jul. 2017
    Bibtex | PDF | Project Webpage | Code
  • @inproceedings{ image-super-resolution-via-deep-recursive-residual-network,
      author = { Ying Tai and Jian Yang and Xiaoming Liu },
      title = { Image Super-Resolution via Deep Recursive Residual Network },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Honolulu, HI },
      month = { July },
      year = { 2017 },
    }
  • Face Anti-Spoofing Using Patch and Depth-based CNNs
    Yousef Atoum, Yaojie Liu, Amin Jourabloo, Xiaoming Liu
    In Proceeding of International Joint Conference on Biometrics (IJCB 2017), Denver, CO, Oct. 2017
    Bibtex | PDF | Poster | Project Webpage
  • @inproceedings{ face-anti-spoofing-using-patch-and-depth-based-cnns,
      author = { Yousef Atoum and Yaojie Liu and Amin Jourabloo and Xiaoming Liu },
      title = { Face Anti-Spoofing Using Patch and Depth-based CNNs },
      booktitle = { In Proceeding of International Joint Conference on Biometrics },
      address = { Denver, CO },
      month = { October },
      year = { 2017 },
    }

2007

  • Multi-Frame Super-Resolution for Face Recognition
    Frederick Wheeler, Xiaoming Liu, Peter Tu
    Proc. of IEEE Conference on Biometrics: Theory, Applications and Systems (BTAS 2007), Washington D.C, USA, Sep. 2007
    Bibtex | PDF
  • @inproceedings{ multi-frame-super-resolution-for-face-recognition,
      author = { Frederick Wheeler and Xiaoming Liu and Peter Tu },
      title = { Multi-Frame Super-Resolution for Face Recognition },
      booktitle = { Proc. of IEEE Conference on Biometrics: Theory, Applications and Systems },
      address = { Washington D.C, USA },
      month = { September },
      year = { 2007 },
    }
  • Multi-Frame Image Restoration for Face Recognition
    Frederick Wheeler, Xiaoming Liu, Peter Tu, Ralph Hoctor
    Proc. IEEE Signal Processing Society Workshop on Signal Processing Applications for Public Security and Forensics (SAFE 2007), Washington, D.C., USA, Apr. 2007
    Bibtex | PDF
  • @inproceedings{ multi-frame-image-restoration-for-face-recognition,
      author = { Frederick Wheeler and Xiaoming Liu and Peter Tu and Ralph Hoctor },
      title = { Multi-Frame Image Restoration for Face Recognition },
      booktitle = { Proc. IEEE Signal Processing Society Workshop on Signal Processing Applications for Public Security and Forensics },
      address = { Washington, D.C., USA },
      month = { April },
      year = { 2007 },
    }