Yilun Chen

I am currently a researcher at Shanghai AI Labotory. Prior to that, I did my Ph.D. at CSE department of The Chinese University of Hong Kong, under the supervision of Prof. Jiaya Jia.

My research interests primarily focus on computer vision and deep learning, specifically in the area of 3D object detection and scene understanding.

We are actively seeking motivated research fellows and interns with experience or interest in Robotics and 3D Perception at Shanghai AI Laboratory. If you are interested in LLM + Robotics, 3D perception, or other related topics, please contact me via email.

Email / LinkedIn / Google Scholar / Github



Timeline

  • [Oct 2024] Our paper of PointLLM receives ECCV 2024 Best Paper Candidate!👏 Check out the Demo!
  • [Sep 2024] Three papers are accepted by NeurIPS 2024 and one paper is accepted by CoRL 2024.
  • [July 2024] One paper is accepted by ECCV 2024.
  • [Aug 2023] Code for FocalFormer3D is released!
  • [July 2023] Our paper FocalFormer3D is accepted by ICCV 2023.
  • [Mar 2023] FocalFormer3D ranks 1st place in nuScenes LiDAR 3D Detection and 3D Tracking leaderboard.
  • [Sep 2022] One paper is accepted by NeurIPS 2022.
  • [Aug 2022] DSGN++ is accepted by T-PAMI 2022 and code is available.
  • [March 2022] Two papers got accepted by CVPR2022.
  • [April 2020] Code for DSGN is released!
  • [March 2020] DSGN is accepted by CVPR 2020.
  • [June 2019] Fast Point R-CNN is accepted by ICCV 2019.
  • [February 2018] Our CPN is accepted by CVPR 2018
  • [Oct 2017] Won 1st Place in COCO 2017 Keypoint Challenge


Selected Publications
FocalFormer3D

FocalFormer3D: Focusing on Hard Instance for 3D Object Detection
Yilun Chen, Zhiding Yu, Yukang Chen, Shiyi Lan, Anima Anandkumar, Jiaya Jia, Jose M. Alvarez
IEEE International Conference on Computer Vision (ICCV) , 2023
Ranked 1st place in nuScenes LiDAR 3D detection leaderboard. (Mar. 2023)
Ranked 1st place in nuScenes LiDAR 3D tracking leaderboard. (Mar. 2023)
[PDF] [Code]

DSGN++

DSGN++: Exploiting Visual-Spatial Relation for Stereo-based 3D Detectors
Yilun Chen, Shijia Huang, Shu Liu, Bei Yu, Jiaya Jia
IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), 2022 (accepted)
Ranked 1st place among all camera-based approaches on KITTI 3D detection leaderboard (All categories, Nov. 2021).
Its multi-modal variant [VoCo] ranked 1st place among all approaches on KITTI 3D detection leaderboard (Car, May. 2022).
[PDF] [Code]

UVTR

Unifying Voxel-based Representation with Transformer for 3D Object Detection
Yanwei Li, Yilun Chen, , Xiaojuan Qi, Zeming Li, Jian Sun, Jiaya Jia
Conference on Neural Information Processing Systems (NeurIPS), 2022
[PDF] [Code]

dsgn

Multi-View Transformer for 3D Visual Grounding
Shijia Huang, Yilun Chen, Jiaya Jia, Liwei Wang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[PDF] [Code]

dsgn

Efficient Neural Radiance Fields
Tao Hu, Shu Liu, Yilun Chen, Tiancheng Shen, Jiaya Jia
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[PDF] [Code]

dsgn

DSGN: Deep Stereo Geometry Network for 3D Object Detection
Yilun Chen, Shu Liu, Xiaoyong Shen, Jiaya Jia
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Ranked 1st place among all camera-based approaches on KITTI 3D detection leaderboard. (All categories, Nov. 2019).
[PDF] [Project Page] [Code]

fprcnn

Fast Point R-CNN
Yilun Chen, Shu Liu, Xiaoyong Shen, Jiaya Jia
IEEE International Conference on Computer Vision (ICCV) , 2019
[PDF] [project page] [bibtex]

cpn

Cascaded Pyramid Network for Multi-Person Pose Estimation
Yilun Chen*, Zhicheng Wang*, Yuxiang Peng, Zhiqiang Zhang, Gang Yu, Jian Sun
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Champion of MS-COCO 2017 Keypoint Detection Challenge
Ranked 1st place on COCO Keypoint detection leaderboard (Oct. 2017).
[PDF] [project page] [Code] [bibtex]

rfcn++

R-FCN++: Towards Accurate Region-based Fully Convolutional Networks for Object Detection
Zeming Li, Yilun Chen, Gang Yu, Yangdong Deng
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018
[PDF] [bibtex]

Experience
nvidia June. 2022 - Feb. 2023, NVIDIA Research
Intern Mentor: Zhiding Yu, Jose M. Alvarez
smartmore Mar. 2020 - June. 2022, SmartMore Inc.
Intern Mentor: Shu Liu
tencent Mar. 2018 - Jan. 2020, Tecent Youtu, X-Lab
Intern Mentor: Shu Liu
face Nov. 2016 - Nov. 2017, Megvii Face++
Intern Mentor: Gang Yu


Education
cuhk

Aug. 2018 - Present , The Chinese University of Hong Kong ,

Ph.D. Student, Computer Science & Engineering

cuhk

Aug. 2013 - July. 2017 , BeiHang University ,

Bachelor Degree, Computer Science & Engineering

Service
  • Conference Reviewer: CVPR2020-2022, ECCV 2020, ICCV 2019,2021,2023, ICLR 2022, NeurIPS 2022-2023, ICRA 2021, IROS 2022

  • Jounral Reviewer: T-PAMI

  • Teaching: CSCI3310, CSCI3180, CSCI1120, ENGG1100