Runpei Dong homepage

News

NEW [2024/04] I will be attending ICLR 2024 in person, see you in 🇦🇹Austria!
NEW [2024/04] One paper accepted to IJCAI 2024 and one paper acccepted to Robotics and Automation Letters (RA-L).
NEW [2024/01] One paper accepted to ICLR 2024 as Spotlight presentation.
[2023/11] Honorably selected as NeurIPS 2023 Top Reviewer.
[2023/09] One paper accepted to NeurIPS 2023.
[2023/09] Introduce multimodal LLM: DreamLLM
[2023/09] Invited talk on multimodal foundation models at Tsinghua University and Xi'an Jiaotong University.
[2023/04] I will be attending ICLR 2023 in person, see you in 🇷🇼Rwanda!
[2023/04] One paper accepted to ICML 2023.
[2023/03] Invited talk on 3D representation learning at Tsinghua University.
[2023/03] One paper accepted to CVPR 2023.
[2023/01] One paper accepted to ICLR 2023.
[2022/09] I join Megvii (Foundation Model Group) as a research intern.
[2022/06] One paper accepted to ECCV 2022 as Oral presentation.
[2021/12] One paper accepted to ICML 2022 as Spotlight presentation.

	DreamLLM: Synergistic Multimodal Comprehension and Creation Runpei Dong, Chunrui Han, Yuang Peng, Zekun Qi, Zheng Ge, Jinrong Yang, Liang Zhao, Jianjian Sun, Hongyu Zhou, Haoran Wei, Xiangwen Kong, Xiangyu Zhang, Kaisheng Ma, Li Yi ICLR 2024 / Project / PDF / Code / OpenReview / Poster / Slides Spotlight Presentation (5%)

	Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? Runpei Dong, Zekun Qi, Linfeng Zhang, Junbo Zhang, Jianjian Sun, Zheng Ge, Li Yi, Kaisheng Ma ICLR 2023 / PDF / Code / OpenReview / Poster / Slides

	Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining Zekun Qi, Runpei Dong, Guofan Fan, Zheng Ge, Xiangyu Zhang, Kaisheng Ma, Li Yi ICML 2023 / PDF / Code / OpenReview / Poster / Slides

	ShapeLLM: Universal 3D Object Understanding for Embodied Interaction Zekun Qi, Runpei Dong†, Shaochen Zhang, Haoran Geng, Chunrui Han, Zheng Ge, He Wang, Li Yi, Kaisheng Ma Project / PDF / Code
	ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning Liang Zhao, En Yu, Zheng Ge, Jinrong Yang, Haoran Wei, Hongyu Zhou, Jianjian Sun, Yuang Peng, Runpei Dong, Chunrui Han, Xiangyu Zhang IJCAI 2024 / PDF / Demo
	Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception Chunrui Han, Jianjian Sun, Zheng Ge, Jinrong Yang, Runpei Dong, Hongyu Zhou, Weixin Mao, Yuang Peng, Xiangyu Zhang IEEE RA-L / PDF
	VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi, Muzhou Yu, Runpei Dong†, Kaisheng Ma NeurIPS 2023 / PDF / Code
	CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIP Junbo Zhang, Runpei Dong, Kaisheng Ma ICCV 2023 @ OpenSUN3D / PDF
	PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection Linfeng Zhang, Runpei Dong, Hung-Shuo Tai, Kaisheng Ma CVPR 2023 / PDF / Code
	Region-aware Knowledge Distillation for Efficient Image-to-Image Translation Linfeng Zhang, Xin Chen, Runpei Dong, Kaisheng Ma BMVC 2023 / PDF / Code
	CORSD: Class-Oriented Relational Self Distillation Muzhou Yu, Sia Huat Tan, Kailu Wu, Runpei Dong, Linfeng Zhang, Kaisheng Ma ICASSP 2023 / PDF
	Contrastive Deep Supervision Linfeng Zhang, Xin Chen, Junbo Zhang, Runpei Dong, Kaisheng Ma ECCV 2022 / PDF / Code / Slides Oral Presentation (2.7%)
	Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks Runpei Dong, Zhanhong Tan, Mengdi Wu, Linfeng Zhang, Kaisheng Ma ICML 2022 / PDF / Code / Slides Spotlight Presentation
	Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention Sia Huat Tan, Runpei Dong, Kaisheng Ma BMVC 2021 / PDF / Code
	NN-Baton: DNN Workload Orchestration and Chiplet Granularity Exploration for Multichip Accelerators Zhanhong Tan, Hongyu Cai, Runpei Dong, Kaisheng Ma ISCA 2021 / PDF

Awards

NeurIPS 2023 Top Reviewer
Chinese National Scholarship (2022~2023)
Excellent Postgraduate (2021~2023), Xi'an Jiaotong University

Professional Services

Program committee or conference reviewer
- Conferences: NeurIPS (2022, 2023), ICLR (2024), ICML (2022, 2024), CVPR (2023, 2024), ICCV (2023), ECCV (2022, 2024), COLM (2024), IJCAI (2024), ACCV (2024), BMVC (2024), ICASSP (2023, 2024)
- Journals: TMLR, IEEE TPAMI, IEEE TCSVT

News | Codebases | Publications | Awards | Services