1. 

   Depth Coefficients for Depth Completion

   Saif Imran, Yunfei Long, Xiaoming Liu, Daniel Morris

   Depth completion involves estimating a dense depth image from sparse depth measurements, often guided by a color image. While linear upsampling is straight forward, it results in artifacts including depth pixels being interpolated in empty space across discontinuities between objects. Current methods use deep networks to upsample and "complete" the ...

   Continue reading

   Keywords: Depth Completion, Camera+LiDAR+Radar, Multi-modality, Depth Prediction

2. 

   MSU-AVIS dataset: Fusing Face and Voice Modalities for Biometric Recognition in Indoor Surveillance Videos

   Anurag Chowdhury, Yousef Atoum, Luan Tran, Xiaoming Liu, Arun Ross

   Indoor video surveillance systems often use the face modality to establish the identity of a person of interest. However, the face image may not offer sufficient discriminatory information in many scenarios due to substantial variations in pose, illumination, expression, resolution and distance between the subject and the camera.

   In such ...

   Continue reading

   Keywords: Application, Biometrics, Face Recognition, Surveillance, Multi-modality

3. 

   Learning to Fuse Information with Missing Modalities

   Luan Tran, Xiaoming Liu, Jiayu Zhou, Rong Jin

   One of the key GEOINT capabilities is to be able to automatically recognize a large array of objects from visual data. Depending on the resolution of imagery, objects may range from specific locations or scenes, road, building, forest to vehicle, human, etc. This is clearly a technically challenging problem for ...

   Continue reading

   Keywords: Data Imputation, Multi-modality

4. 

   Multi-Modality Imagery Database for Plant Phenotyping

   Jeffrey A. Cruz, Xi Yin, Xiaoming Liu, Saif M. Imran, Daniel D. Morris, David M. Kramer, Jin Chen

   We have collected a multi-modality plant imagery database named “MSU-PID” including two types of plants: Arabidopsis and bean. It is captured using four types of imaging sensors:fluorescence, infrared(IR), RGB color, and depth. The imaging setup and the variety of manual labels allow MSU-PID to be used for a ...

   Continue reading

   Keywords: Plant Vision, Database, Application, Multi-Modality

2024

• Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation
  Feng Liu, Minchul Kim, Zhiyuan Ren, Xiaoming Liu
  In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2024), Seattle, WA, Jun. 2024
  Bibtex | PDF | Supplemental
@inproceedings{ distilling-clip-with-dual-guidance-for-learning-discriminative-human-body-shape-representation,
  author = { Feng Liu and Minchul Kim and Zhiyuan Ren and Xiaoming Liu },
  title = { Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation },
  booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
  address = { Seattle, WA },
  month = { June },
  year = { 2024 },
}

2023

• RADIANT: RADar Image Association NeTwork for 3D Object Detection
  Yunfei Long, Abhinav Kumar, Daniel Morris, Xiaoming Liu, Marcos Paul Gerardo Castro, Punarjay Chakravarty
  In Proceeding of Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI), Washington, D.C., Feb. 2023
  Bibtex | PDF
@inproceedings{ radiant-radar-image-association-network-for-3d-object-detection,
  author = { Yunfei Long and Abhinav Kumar and Daniel Morris and Xiaoming Liu and Marcos Paul Gerardo Castro and Punarjay Chakravarty },
  title = { RADIANT: RADar Image Association NeTwork for 3D Object Detection },
  booktitle = { In Proceeding of Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI) },
  address = { Washington, D.C. },
  month = { February },
  year = { 2023 },
}

2021

• Full-Velocity Radar Returns by Radar-Camera Fusion
  Yunfei Long, Daniel Morris, Xiaoming Liu, Marcos Castro, Punarjay Chakravarty, Praveen Narayanan
  In Proceeding of International Conference on Computer Vision (ICCV 2021), Montreal, Canada, Oct. 2021 (Oral presentation)
  Bibtex | PDF | Supplemental | Code | Video
@inproceedings{ full-velocity-radar-returns-by-radar-camera-fusion,
  author = { Yunfei Long and Daniel Morris and Xiaoming Liu and Marcos Castro and Punarjay Chakravarty and Praveen Narayanan },
  title = { Full-Velocity Radar Returns by Radar-Camera Fusion },
  booktitle = { In Proceeding of International Conference on Computer Vision },
  address = { Montreal, Canada },
  month = { October },
  year = { 2021 },
}
• Radar-Camera Pixel Depth Association for Depth Completion
  Yunfei Long, Daniel Morris, Xiaoming Liu, Marcos Paul Gerardo Castro, Punarjay Chakravarty, Praveen Narayanan
  In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2021), Nashville, TN, Jun. 2021
  Bibtex | arXiv | Code | Video
@inproceedings{ radar-camera-pixel-depth-association-for-depth-completion,
  author = { Yunfei Long and Daniel Morris and Xiaoming Liu and Marcos Paul Gerardo Castro and Punarjay Chakravarty and Praveen Narayanan },
  title = { Radar-Camera Pixel Depth Association for Depth Completion },
  booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
  address = { Nashville, TN },
  month = { June },
  year = { 2021 },
}

2019

• Depth Coefficients for Depth Completion
  Saif Imran, Yunfei Long, Xiaoming Liu, Daniel Morris
  In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2019), Long Beach, CA, Jun. 2019
  Bibtex | PDF | arXiv | Supplemental | Poster | Project Webpage | Code | Video
@inproceedings{ depth-coefficients-for-depth-completion,
  author = { Saif Imran and Yunfei Long and Xiaoming Liu and Daniel Morris },
  title = { Depth Coefficients for Depth Completion },
  booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
  address = { Long Beach, CA },
  month = { June },
  year = { 2019 },
}

2018

• MSU-AVIS dataset: Fusing Face and Voice Modalities for Biometric Recognition in Indoor Surveillance Videos
  Anurag Chowdhury, Yousef Atoum, Luan Tran, Xiaoming Liu, Arun Ross
  In Proceeding of International Conference on Pattern Recognition (ICPR 2018), Beijing, China, Aug. 2018
  Bibtex | PDF | Poster | Project Webpage
@inproceedings{ msu-avis-dataset-fusing-face-and-voice-modalities-for-biometric-recognition-in-indoor-surveillance-videos,
  author = { Anurag Chowdhury and Yousef Atoum and Luan Tran and Xiaoming Liu and Arun Ross },
  title = { MSU-AVIS dataset: Fusing Face and Voice Modalities for Biometric Recognition in Indoor Surveillance Videos },
  booktitle = { In Proceeding of International Conference on Pattern Recognition },
  address = { Beijing, China },
  month = { August },
  year = { 2018 },
}

2017

• Missing Modalities Imputation via Cascaded Residual Autoencoder
  Luan Tran, Xiaoming Liu, Jiayu Zhou, Rong Jin
  In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, Jul. 2017
  Bibtex | PDF | Project Webpage | Code
@inproceedings{ missing-modalities-imputation-via-cascaded-residual-autoencoder,
  author = { Luan Tran and Xiaoming Liu and Jiayu Zhou and Rong Jin },
  title = { Missing Modalities Imputation via Cascaded Residual Autoencoder },
  booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
  address = { Honolulu, HI },
  month = { July },
  year = { 2017 },
}
• Face Anti-Spoofing Using Patch and Depth-based CNNs
  Yousef Atoum, Yaojie Liu, Amin Jourabloo, Xiaoming Liu
  In Proceeding of International Joint Conference on Biometrics (IJCB 2017), Denver, CO, Oct. 2017
  Bibtex | PDF | Poster | Project Webpage
@inproceedings{ face-anti-spoofing-using-patch-and-depth-based-cnns,
  author = { Yousef Atoum and Yaojie Liu and Amin Jourabloo and Xiaoming Liu },
  title = { Face Anti-Spoofing Using Patch and Depth-based CNNs },
  booktitle = { In Proceeding of International Joint Conference on Biometrics },
  address = { Denver, CO },
  month = { October },
  year = { 2017 },
}

2016

• Multi-modality Imagery Database for Plant Phenotyping
  Jeffrey Cruz, Xi Yin, Xiaoming Liu, Saif Imran, Daniel Morris, David Kramer, Jin Chen
  Machine Vision and Applications, Vol. 27, No. 5, pp.735-749, , Jul. 2016 (equal contribution by first two authors)
  Bibtex | PDF | Project Webpage
@article{ multi-modality-imagery-database-for-plant-phenotyping,
  author = { Jeffrey Cruz and Xi Yin and Xiaoming Liu and Saif Imran and Daniel Morris and David Kramer and Jin Chen },
  title = { Multi-modality Imagery Database for Plant Phenotyping },
  journal = { Machine Vision and Applications },
  volume = { 27 },
  number = { 5 },
  month = { July },
  year = { 2016 },
  pages = { 735--749 },
}

2010

• Improving Biometric Identification Through Quality- based Face and Fingerprint Biometric Fusion
  Yan Tong, Frederick W. Wheeler, Xiaoming Liu
  Proc. IEEE Computer Society Workshop on Biometrics (CVPRW 2010), San Francisco, California, Jun. 2010
  Bibtex | PDF
@inproceedings{ improving-biometric-identification-through-quality-based-face-and-fingerprint-biometric-fusion,
  author = { Yan Tong and Frederick W. Wheeler and Xiaoming Liu },
  title = { Improving Biometric Identification Through Quality- based Face and Fingerprint Biometric Fusion },
  booktitle = { Proc. IEEE Computer Society Workshop on Biometrics },
  address = { San Francisco, California },
  month = { June },
  year = { 2010 },
}