Mingjie Pan

Mingjie Pan (潘铭杰)
Affiliation: Peking University
Address: 5 Yiheyuan Road, Haidian District, Beijing, China
Email: pmj@stu.pku.edu.cn

About Me ([GitHub] [Google Scholar] )

I'm currently a Ph.D candidate at the Peking University (PKU).

Previously, I received my B.E degree from UESTC and MS degree from PKU.

My research interests focus on:

Embodied AI & Manipulation
3D Vision

News

2025/02: OmniManip and CheckManual are accepted by CVPR 2025, both as Highlight 🎉
2025/02: We released AgibotDigitalWorld, a large manipulation dataset generated with high quality simulation.
2024/12: LidarLLM is accepted by AAAI 2025.
2024/01: RenderOcc is accepted by ICRA 2024!
2023/12: One paper is accepted by AAAI 2024.
2023/09: Ranked 2nd place in ICCV 2023 Challenge - Continual Test-time Adaptation for Semantic Segmentation.
2023/06: One paper is selected by MICCAI 2023.
2023/05: Ranked 3rd place in CVPR 2023 Challenge - Vision-Centric 3D Occupancy Prediction.
2023/03: One paper is selected by CVPR 2023.
2020/06: Win Finalist Award in MCM/ICM 2020 (Top 0.5%).
2020-06: Win National First Prize in RoboMaster 2020.

Selected Projects [Full List]

(* Equal contribution)

OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints
Mingjie Pan*, Jiyao Zhang*, Tianshu Wu, Yinghao Zhao, Wenlong Gao, Hao Dong
Paper | Code (coming soon)
CVPR 2025, Highlight 🎉

AgiBotDigitalWorld
Jiyao Zhang, Mingjie Pan, Baifeng Xie, Yinghao Zhao, Wenlong Gao, Guangte Xiang, Jiawei Zhang, Dong Li, Zhijun Li, Sheng Zhang, Hongwei Fan, Chengyue Zhao, Shukai Yang, Maoqing Yao, Chuanzhe Suo, Hao Dong
Huggingface, 2025
We will release the core data generation framework in months, plsease contact us if you want to join!

RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision
Mingjie Pan*, Jiaming Liu*, Renrui Zhang*, Peixiang Huang, Xiaoqi Li, Bing Wang, Hongwei Xie, Li Liu, Shanghang Zhang
Paper | Code
ICRA 2024

LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding
Senqiao Yang*, Jiaming Liu*, Ray Zhang*, Mingjie Pan*, Zoey Guo, Xiaoqi Li, Zehui Chen, Peng Gao, Yandong Guo, Shanghang Zhang
Paper
AAAI 2025

DiffuseIR: Diffusion Models For Isotropic Reconstruction of 3D Microscopic Images
Mingjie Pan*, Yulu Gan*, Fangxu Zhou, Jiaming Liu, Ying Zhang, Aimin Wang, Shanghang Zhang, Dawei Li
Paper
MICCAI 2023

Cloud-device collaborative adaptation to continual changing environments in the real-world
Yulu Gan*, Mingjie Pan*, Rongyu Zhang, Zijian Ling, Lingran Zhao, Jiaming Liu, Shanghang Zhang
Paper
CVPR 2023

Selected Awards

3rd Prize of CVPR 2023 Challenge - Vision-Centric 3D Occupancy Prediction, May 2023 (Team leader)
Silver medal (12th/1506) at Kaggle, Sartorius - Cell Instance Segmentation, Apr 2022 (Team leader)
Finalist Award (Top 0.5% of 27149) at MCM/ICM, June 2020 (Team leader)
1st Prize at RoboMaster, Mainland China Regional Competition, June 2020 (Team leader)
2nd Prize at National Undergraduate Electronic Design Contest, Automatic quadcopter, Sept 2019 (Team leader)
Outstanding Graduate Special Scholarship (x2), 2018 - 2019

MISC

Experience of robots from years ago.