Projects

  1. summary image

    The Edge of Depth: Explicit Constraints between Segmentation and Depth

    Shengjie Zhu, Garrick Brazil, Xiaoming Liu

    In this work we study the mutual benefits of two common computer vision tasks, self-supervised depth estimation and semantic segmentation from images. For example, to help unsupervised monocular depth estimation, constraints from semantic segmentation has been explored implicitly such as sharing and transforming features. In contrast, we propose to explicitly ...

    Continue reading

    Keywords: Depth Prediction, Image Segmentation, Semantic Segmentation

Publications

2024

  • RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry
    Shengjie Zhu*, Girish Chandar Ganesan*, Abhinav Kumar, Xiaoming Liu
    In Proceeding of European Conference on Computer Vision (ECCV 2024), Milan, Italy, Oct. 2024
    Bibtex | PDF | arXiv
    • @inproceedings{ replay-remove-projective-lidar-depthmap-artifacts-via-exploiting-epipolar-geometry,
      author = { Shengjie Zhu* and Girish Chandar Ganesan* and Abhinav Kumar and Xiaoming Liu },
      title = { RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry },
      booktitle = { In Proceeding of European Conference on Computer Vision },
      address = { Milan, Italy },
      month = { October },
      year = { 2024 },
    }
  • Revisit Self-Supervision with Local Structure-from-Motion
    Shengjie Zhu, Xiaoming Liu
    In Proceeding of European Conference on Computer Vision (ECCV 2024), Milan, Italy, Oct. 2024
    Bibtex | PDF | arXiv
    • @inproceedings{ revisit-self-supervision-with-local-structure-from-motion,
      author = { Shengjie Zhu and Xiaoming Liu },
      title = { Revisit Self-Supervision with Local Structure-from-Motion },
      booktitle = { In Proceeding of European Conference on Computer Vision },
      address = { Milan, Italy },
      month = { October },
      year = { 2024 },
    }

2023

  • Tame a Wild Camera: In-the-Wild Monocular Camera Calibration
    Shengjie Zhu, Abhinav Kumar, Masa Hu, Xiaoming Liu
    In Proceeding of Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, LA, Dec. 2023
    Bibtex | arXiv | Code | Video
    • @inproceedings{ tame-a-wild-camera-in-the-wild-monocular-camera-calibration,
      author = { Shengjie Zhu and Abhinav Kumar and Masa Hu and Xiaoming Liu },
      title = { Tame a Wild Camera: In-the-Wild Monocular Camera Calibration },
      booktitle = { In Proceeding of Thirty-seventh Conference on Neural Information Processing Systems },
      address = { New Orleans, LA },
      month = { December },
      year = { 2023 },
    }
  • PMatch: Paired Masked Image Modeling for Dense Geometric Matching
    Shengjie Zhu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2023), Vancouver, Canada, Jun. 2023
    Bibtex | PDF | Supplemental
    • @inproceedings{ pmatch-paired-masked-image-modeling-for-dense-geometric-matching,
      author = { Shengjie Zhu and Xiaoming Liu },
      title = { PMatch: Paired Masked Image Modeling for Dense Geometric Matching },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Vancouver, Canada },
      month = { June },
      year = { 2023 },
    }
  • Video Depth Estimation in light of Limited Inference View Angles
    Shengjie Zhu, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2023), Vancouver, Canada, Jun. 2023
    Bibtex | PDF | Supplemental | Video
    • @inproceedings{ video-depth-estimation-in-light-of-limited-inference-view-angles,
      author = { Shengjie Zhu and Xiaoming Liu },
      title = { Video Depth Estimation in light of Limited Inference View Angles },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Vancouver, Canada },
      month = { June },
      year = { 2023 },
    }

2020

  • The Edge of Depth: Explicit Constraints between Segmentation and Depth
    Shengjie Zhu, Garrick Brazil, Xiaoming Liu
    In Proceeding of IEEE Computer Vision and Pattern Recognition (CVPR 2020), Seattle, WA, Jun. 2020
    Bibtex | PDF | arXiv | Supplemental | Project Webpage | Code | Video
    • @inproceedings{ the-edge-of-depth-explicit-constraints-between-segmentation-and-depth,
      author = { Shengjie Zhu and Garrick Brazil and Xiaoming Liu },
      title = { The Edge of Depth: Explicit Constraints between Segmentation and Depth },
      booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
      address = { Seattle, WA },
      month = { June },
      year = { 2020 },
    }