Projects

  1. summary image

    Proactive Image Manipulation Detection

    Vishal Asnani, Xi Yin, Tal Hassner, Sijia Liu, Xiaoming Liu

    Image manipulation detection algorithms are often trained to discriminate between images manipulated with particular Generative Models (GMs) and genuine/real images, yet generalize poorly to images manipulated with GMs unseen in the training. Conventional detection algorithms receive an input image passively. By contrast, we propose a proactive scheme to image ...

    Continue reading

    Keywords: Image Manipulation, Low-level Vision

  2. summary image

    Gait Recognition via Disentangled Representation Learning

    Ziyuan Zhang, Luan Tran, Xi Yin, Yousef Atoum, Xiaoming Liu, Jian Wan, Nanxin Wang

    Gait, the walking pattern of individuals, is one of the most important biometrics modalities. Most of the existing gait recognition methods take silhouettes or articulated body models as the gait features. These methods suffer from degraded recognition performance when handling confounding variables, such as clothing, carrying and view angle. To ...

    Continue reading

    Keywords: Biometrics, Gait Recognition, Database

  3. summary image

    Feature Transfer Learning for Deep Face Recognition with Long-Tail Data

    Xi Yin, Xiang Yu, Kihyuk Sohn, Xiaoming Liu, Manmohan Chandraker

    Real-world face recognition datasets exhibit long-tail characteristics, which results in biased classifiers in conventionally-trained deep neural networks, or insufficient data when long-tail classes are ignored. In this paper, we propose to handle long-tail classes in the training of a face recognition engine by augmenting their feature space under a center-based ...

    Continue reading

    Keywords: Face Recognition, Biometrics

  4. summary image

    Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition

    Xi Yin, Xiaoming Liu

    This work explores Multi-Task Learning (MTL) for face recognition. First, we propose a multi-task Convolutional Neural Network (CNN) for face recognition where identity classification is the main task and Pose, Illumination, and Expression (PIE) estimations are the side tasks. Second, we develop a dynamic-weighting scheme to automatically assign the loss ...

    Continue reading

    Keywords: Face Recognition, Biometrics

  5. summary image

    Disentangled Representation Learning GAN for Pose-Invariant Face Recognition

    Luan Tran, Xi Yin, Xiaoming Liu

    The large pose discrepancy between two face images is one of the fundamental challenges in automatic face recognition. Conventional approaches to pose-invariant face recognition either perform face frontalization on, or learn a pose-invariant representation from, a non-frontal face image. We argue that it is more desirable to perform both tasks ...

    Continue reading

    Keywords: Face Recognition, Surveillance, Biometrics, Face Synthesis

  6. summary image

    Towards Large-Pose Face Frontalization in the Wild

    Xi Yin, Xiang Yu, Kihyuk Sohn, Xiaoming Liu, Manmohan Chandraker

    Despite recent advances in face recognition using deep learning, severe accuracy drops are observed for large pose variations in unconstrained environments. Learning pose-invariant features is one solution, but needs expensively labeled large scale data and carefully designed feature learning algorithms. In this work, we focus on frontalizing faces in the ...

    Continue reading

    Keywords: Face Recognition, Face Reconstruction, 3D Shape Reconstruction, Face Synthesis, Biometrics

  7. summary image

    Illuminating Pedestrians via Simultaneous Detection & Segmentation

    Garrick Brazil, Xi Yin, Xiaoming Liu

    Pedestrian detection is a critical problem in computer vision with significant impact on safety in urban autonomous driving. In this work, we explore how semantic segmentation can be used to boost pedestrian detection accuracy while having little to no impact on network efficiency. We propose a segmentation infusion network to ...

    Continue reading

    Keywords: Pedestrian Detection, Semantic Segmentation, Object Detection, Image Segmentation

  8. summary image

    Multi-Modality Imagery Database for Plant Phenotyping

    Jeffrey A. Cruz, Xi Yin, Xiaoming Liu, Saif M. Imran, Daniel D. Morris, David M. Kramer, Jin Chen

    We have collected a multi-modality plant imagery database named “MSU-PID” including two types of plants: Arabidopsis and bean. It is captured using four types of imaging sensors:fluorescence, infrared(IR), RGB color, and depth. The imaging setup and the variety of manual labels allow MSU-PID to be used for a ...

    Continue reading

    Keywords: Plant Vision, Database, Application, Multi-Modality

Publications

2023

  • Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images
    Vishal Asnani, Xi Yin, Tal Hassner, Xiaoming Liu
    IEEE Transactions on Pattern Analysis and Machine Intelligence, , Jul. 2023 (in press)
    Bibtex | PDF | arXiv | Supplemental | Code | Dataset
  • @article{ reverse-engineering-of-generative-models-inferring-model-hyperparameters-from-generated-images,
      author = { Vishal Asnani and Xi Yin and Tal Hassner and Xiaoming Liu },
      title = { Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images },
      journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
      month = { July },
      year = { 2023 },
    }
  • MaLP: Manipulation Localization Using a Proactive Scheme
    Vishal Asnani, Xi Yin, Tal Hassner, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2023), Vancouver, Canada, Jun. 2023
    Bibtex | PDF | Supplemental | Code
  • @inproceedings{ malp-manipulation-localization-using-a-proactive-scheme,
      author = { Vishal Asnani and Xi Yin and Tal Hassner and Xiaoming Liu },
      title = { MaLP: Manipulation Localization Using a Proactive Scheme },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Vancouver, Canada },
      month = { June },
      year = { 2023 },
    }

2022

  • Proactive Image Manipulation Detection
    Vishal Asnani, Xi Yin, Tal Hassner, Sijia Liu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, Jun. 2022
    Bibtex | PDF | arXiv | Supplemental | Project Webpage | Code
  • @inproceedings{ proactive-image-manipulation-detection,
      author = { Vishal Asnani and Xi Yin and Tal Hassner and Sijia Liu and Xiaoming Liu },
      title = { Proactive Image Manipulation Detection },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { New Orleans, LA },
      month = { June },
      year = { 2022 },
    }

2020

  • FAN: Feature Adaptation Network for Surveillance Face Recognition and Normalization
    Xi Yin, Ying Tai, Yuge Huang, Xiaoming Liu
    In Proceeding of Asian Conference on Computer Vision (ACCV 2020), Kyoto, Japan, Nov. 2020
    Bibtex | PDF | arXiv
  • @inproceedings{ fan-feature-adaptation-network-for-surveillance-face-recognition-and-normalization,
      author = { Xi Yin and Ying Tai and Yuge Huang and Xiaoming Liu },
      title = { FAN: Feature Adaptation Network for Surveillance Face Recognition and Normalization },
      booktitle = { In Proceeding of Asian Conference on Computer Vision },
      address = { Kyoto, Japan },
      month = { November },
      year = { 2020 },
    }

2019

  • Gait Recognition via Disentangled Representation Learning
    Ziyuan Zhang, Luan Tran, Xi Yin, Yousef Atoum, Jian Wan, Nanxin Wang, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, CA, Jun. 2019 (Oral presentation)
    Bibtex | PDF | arXiv | Project Webpage | Code
  • @inproceedings{ gait-recognition-via-disentangled-representation-learning,
      author = { Ziyuan Zhang and Luan Tran and Xi Yin and Yousef Atoum and Jian Wan and Nanxin Wang and Xiaoming Liu },
      title = { Gait Recognition via Disentangled Representation Learning },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Long Beach, CA },
      month = { June },
      year = { 2019 },
    }
  • Feature Transfer Learning for Face Recognition with Under-Represented Data
    Xi Yin, Xiang Yu, Kihyuk Sohn, Xiaoming Liu, Manmohan Chandraker
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, CA, Jun. 2019
    Bibtex | PDF | arXiv | Supplemental | Poster | Project Webpage
  • @inproceedings{ feature-transfer-learning-for-face-recognition-with-under-represented-data,
      author = { Xi Yin and Xiang Yu and Kihyuk Sohn and Xiaoming Liu and Manmohan Chandraker },
      title = { Feature Transfer Learning for Face Recognition with Under-Represented Data },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Long Beach, CA },
      month = { June },
      year = { 2019 },
    }

2018

  • Representation Learning by Rotating Your Faces
    Luan Tran, Xi Yin, Xiaoming Liu
    IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 41, No. 12, pp.3007-3021, , Sep. 2018
    Bibtex | PDF | arXiv | Project Webpage | Code
  • @article{ representation-learning-by-rotating-your-faces,
      author = { Luan Tran and Xi Yin and Xiaoming Liu },
      title = { Representation Learning by Rotating Your Faces },
      journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
      volume = { 41 },
      number = { 12 },
      month = { September },
      year = { 2018 },
      pages = { 3007--3021 },
    }

2017

  • Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition
    Xi Yin, Xiaoming Liu
    IEEE Transactions on Image Processing, Vol. 27, No. 2, pp.964-975, , Aug. 2017
    Bibtex | PDF | Project Webpage | Code
  • @article{ multi-task-convolutional-neural-network-for-pose-invariant-face-recognition,
      author = { Xi Yin and Xiaoming Liu },
      title = { Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition },
      journal = { IEEE Transactions on Image Processing },
      volume = { 27 },
      number = { 2 },
      month = { August },
      year = { 2017 },
      pages = { 964--975 },
    }
  • Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos
    Xi Yin, Xiaoming Liu, Jin Chen, David M. Kramer
    IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, No. 6, pp.1411-1423, , Jul. 2017
    Bibtex | PDF | arXiv | Project Webpage | Code
  • @article{ joint-multi-leaf-segmentation-alignment-and-tracking-from-fluorescence-plant-videos,
      author = { Xi Yin and Xiaoming Liu and Jin Chen and David M. Kramer },
      title = { Joint Multi-Leaf Segmentation, Alignment, and Tracking from Fluorescence Plant Videos },
      journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
      volume = { 40 },
      number = { 6 },
      month = { July },
      year = { 2017 },
      pages = { 1411--1423 },
    }
  • Illuminating Pedestrians via Simultaneous Detection & Segmentation
    Garrick Brazil, Xi Yin, Xiaoming Liu
    In Proceeding of International Conference on Computer Vision (ICCV 2017), Venice, Italy, Oct. 2017
    Bibtex | PDF | arXiv | Poster | Project Webpage | Code
  • @inproceedings{ illuminating-pedestrians-via-simultaneous-detection-segmentation,
      author = { Garrick Brazil and Xi Yin and Xiaoming Liu },
      title = { Illuminating Pedestrians via Simultaneous Detection & Segmentation },
      booktitle = { In Proceeding of International Conference on Computer Vision },
      address = { Venice, Italy },
      month = { October },
      year = { 2017 },
    }
  • Towards Large-Pose Face Frontalization in the Wild
    Xi Yin, Xiang Yu, Kihyuk Sohn, Xiaoming Liu, Manmohan Chandraker
    In Proceeding of International Conference on Computer Vision (ICCV 2017), Venice, Italy, Oct. 2017
    Bibtex | PDF | arXiv | Supplemental | Poster | Project Webpage
  • @inproceedings{ towards-large-pose-face-frontalization-in-the-wild,
      author = { Xi Yin and Xiang Yu and Kihyuk Sohn and Xiaoming Liu and Manmohan Chandraker },
      title = { Towards Large-Pose Face Frontalization in the Wild },
      booktitle = { In Proceeding of International Conference on Computer Vision },
      address = { Venice, Italy },
      month = { October },
      year = { 2017 },
    }
  • Disentangled Representation Learning GAN for Pose-Invariant Face Recognition
    Luan Tran, Xi Yin, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, Jul. 2017 (Oral presentation)
    Bibtex | PDF | Project Webpage | Code
  • @inproceedings{ disentangled-representation-learning-gan-for-pose-invariant-face-recognition,
      author = { Luan Tran and Xi Yin and Xiaoming Liu },
      title = { Disentangled Representation Learning GAN for Pose-Invariant Face Recognition },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Honolulu, HI },
      month = { July },
      year = { 2017 },
    }

2016

  • Multi-modality Imagery Database for Plant Phenotyping
    Jeffrey Cruz, Xi Yin, Xiaoming Liu, Saif Imran, Daniel Morris, David Kramer, Jin Chen
    Machine Vision and Applications, Vol. 27, No. 5, pp.735-749, , Jul. 2016 (equal contribution by first two authors)
    Bibtex | PDF | Project Webpage
  • @article{ multi-modality-imagery-database-for-plant-phenotyping,
      author = { Jeffrey Cruz and Xi Yin and Xiaoming Liu and Saif Imran and Daniel Morris and David Kramer and Jin Chen },
      title = { Multi-modality Imagery Database for Plant Phenotyping },
      journal = { Machine Vision and Applications },
      volume = { 27 },
      number = { 5 },
      month = { July },
      year = { 2016 },
      pages = { 735--749 },
    }
  • Leaf Segmentation in Plant Phenotyping: A Collation Study
    Hanno Scharr, Massimo Minervini, Andrew P. French, Christian Klukas, David M. Kramer, Xiaoming Liu, Imanol L. Muntion, Jean-Michel Pape, Gerrit Polder, Danijela Vukadinovic, Xi Yin, Sotirios A. Tsaftaris
    Machine Vision and Application, Vol. ['27', '7'], No. 4, pp.585-606, , May. 2016
    Bibtex | PDF | Project Webpage | Code
  • @article{ leaf-segmentation-in-plant-phenotyping-a-collation-study,
      author = { Hanno Scharr and Massimo Minervini and Andrew P. French and Christian Klukas and David M. Kramer and Xiaoming Liu and Imanol L. Muntion and Jean-Michel Pape and Gerrit Polder and Danijela Vukadinovic and Xi Yin and Sotirios A. Tsaftaris },
      title = { Leaf Segmentation in Plant Phenotyping: A Collation Study },
      journal = { Machine Vision and Application },
      volume = { ['27', '7'] },
      number = { 4 },
      month = { May },
      year = { 2016 },
      pages = { 585--606 },
    }

2015

  • Attribute Preserved Face De-identification
    Amin Jourabloo, Xi Yin, Xiaoming Liu
    Proc. 8th IAPR International Conference on Biometrics (ICB 2015), Phuket, Thailand, May. 2015 (equal contribution by first two authors)
    Bibtex | PDF | Project Webpage
  • @inproceedings{ attribute-preserved-face-de-identification,
      author = { Amin Jourabloo and Xi Yin and Xiaoming Liu },
      title = { Attribute Preserved Face De-identification },
      booktitle = { Proc. 8th IAPR International Conference on Biometrics },
      address = { Phuket, Thailand },
      month = { May },
      year = { 2015 },
    }

2014

  • Multi-Leaf Tracking from Fluorescence Plant Videos
    Xi Yin, Xiaoming Liu, Jin Chen, David M. Kramer
    In Proceedings of IEEE Conference on Image Processing (ICIP 2014), Paris, France, Oct. 2014 (Top 10% Paper Award)
    Bibtex | PDF | Project Webpage
  • @inproceedings{ multi-leaf-tracking-from-fluorescence-plant-videos,
      author = { Xi Yin and Xiaoming Liu and Jin Chen and David M. Kramer },
      title = { Multi-Leaf Tracking from Fluorescence Plant Videos },
      booktitle = { In Proceedings of IEEE Conference on Image Processing },
      address = { Paris, France },
      month = { October },
      year = { 2014 },
    }
  • Multi-Leaf Alignment from Fluorescence Plant Images
    Xi Yin, Xiaoming Liu, Jin Chen, David M. Kramer
    Proc. IEEE Winter Conference on Application of Computer Vision (WACV 2014), Steamboat Springs, USA, Mar. 2014 (Best Student Paper Award)
    Bibtex | PDF | Project Webpage
  • @inproceedings{ multi-leaf-alignment-from-fluorescence-plant-images,
      author = { Xi Yin and Xiaoming Liu and Jin Chen and David M. Kramer },
      title = { Multi-Leaf Alignment from Fluorescence Plant Images },
      booktitle = { Proc. IEEE Winter Conference on Application of Computer Vision },
      address = { Steamboat Springs, USA },
      month = { March },
      year = { 2014 },
    }