About Me
I will join in Multimedia Lab (MMLab) at Chinese University of Hong Kong as a Postdoctoral Fellow, working with Prof. Xiangyu Yue.
In 2025.06, I received my PhD degree in Department of Computer Science, Beijing Institute of Technology, advised by Prof. Jianbing Shen. In 2019.06, I recevied my Bachelor degree from the Class of Xu at the same university.
My current research interests lie in vision-language learning, multimodal large language models (MLLMs), and embodied agents. (1) During my graduate studies, I focused on building intelligent perception models that understand visual and linguistic information. (2) More recently, I’ve been exploring decision-making systems capable of actively interacting with both humans and dynamic environments. Ultimately, my goal is to develop human-like agents that can perceive real-world environments and make autonomous decisions, moving us closer to achieving artificial general intelligence (AGI). Two articles that have deeply inspired my thinking are The Bitter Lesson and The Second Half.
I am always open to collaboration and discussions about the latest advancements in the field. Feel free to reach out!
News
- 2025.06: One paper (RAGNet) is accepted by ICCV2025.
- 2025.06: I successfully defense my Ph.D. thesis. I’m awarded Outstanding Graduates of Beijing (北京市优秀毕业生).
- 2025.02: One paper (DrivingSphere) is accepted by CVPR2025.
- 2024.12: One paper (NuPrompt) is accepted by AAAI2025.
- 2024.07: One paper (Merlin) is accepted by ECCV2024.
- 2024.05: I’m awarded Excellent Doctoral Thesis Seedling Fund (优秀博士论文育苗基金).
- 2024.01: One paper (TopoMLP) is accepted by ICLR2024.
- 2023.10: I’m awarded National Scholarship!
Experience
-
2025.02 – 2025.06, I am a research intern at a robotic start-up, Dexmal, supervised by Yingfei Liu and Tiancai Wang.
-
2024.09 – 2025.01, I am a visiting student at MBZUAI, supervised by Prof. Rao Muhammad Anwer and Prof. Fahad Shahbaz Khan.
-
2022.06 – 2024.08, I am a research intern at Foundation model group in MEGVII, supervised by Tiancai Wang and Xiangyu Zhang.
-
2021.05 – 2022.05, I am a research intern at Inception Institute of Artificial Intelligence, supervised by Xingping Dong and Prof. Ling Shao.
Publications
Preprint Papers:
-
Grounding Beyond Detection: Enhancing Contextual Understanding in Embodied 3D Grounding
Yani Zhang, Dongming Wu, Hao Shi, Yingfei Liu, Tiancai Wang, Haoqiang Fan, Xingping Dong
1st place on EmbodiedScan Visual Grounding
|2025|Paper|Code| -
Is a 3D-Tokenized LLM the Key to Reliable Autonomous Driving?
Yifan Bai*, Dongming Wu*, Yingfei Liu, Fan Jia, Weixin Mao, Ziheng Zhang, Yucheng Zhao, Jianbing Shen, Xing Wei, Tiancai Wang, Xiangyu Zhang (*Equal Contributions)
|2024|Paper| -
Bootstrapping Referring Multi-Object Tracking
Yani Zhang, Dongming Wu, Wencheng Han, Xingping Dong
|2024|Paper|Code|
Conference Papers
A Large-Scale Reasoning-based Affordance Segmentation Dataset and Model for Universal Robot Grasping
|ICCV 2025|
Dongming Wu, Yanping Fu, Saike Huang, Yingfei Liu, Fan Jia, Nian Liu, Feng Dai, Tiancai Wang, Rao Muhammad Anwer, Fahad Shahbaz Khan, Jianbing Shen
- We present a large-scale reasoning-based affordance segmentation benchmark RAGNet and introduce a comprehensive affordance-based grasping framework AffordanceNet.
DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulation
|CVPR 2025|Paper|Code|
Tianyi Yan, Dongming Wu, Wencheng Han, Junpeng Jiang, Xia Zhou, Kun Zhan, Cheng-zhong Xu, Jianbing Shen
- DrivingSphere is a novel geometry-aware closed-loop simulation framework that captures 2D visual and 3D geometric properties while seamlessly integrating with vision-based end-to-end driving agents.
Merlin:Empowering Multimodal LLMs with Foresight Minds
|ECCV 2024|Paper|Code|
En Yu, Liang Zhao, Yana Wei, Jinrong Yang, Dongming Wu, Lingyu Kong, Haoran Wei, Tiancai Wang, Zheng Ge, Xiangyu Zhang, Wenbing Tao
- Merlin is a groundbreaking model capable of generating natural language responses that are intricately linked with object trajectories of multiple images.
TopoMLP: A Simple yet Strong Pipeline for Driving Topology Reasoning
|ICLR 2024|Paper|Code|
Dongming Wu, Jiahao Chang, Fan Jia, Yingfei Liu, Tiancai Wang, Jianbing Shen
- TopoMLP is the 1st solution for 1st OpenLane Topology in Autonomous Driving Challenge. It suggests a first-detect-then-reason philosophy for better topology prediction.
OnlineRefer: A Simple Online Baseline for Referring Video Object Segmentation
|ICCV 2023|Paper|Code|
Dongming Wu, Tiancai Wang, Yuang Zhang, Xiangyu Zhang, Jianbing Shen
- OnlineRefer is the first to challenge the widespread belief that only offline models can deal well with RVOS and makes online RVOS great again.
Referring Multi-Object Tracking
|CVPR 2023|Paper|Code|
Dongming Wu, Wencheng Han, Tiancai Wang, Xingping Dong, Xiangyu Zhang, Jianbing Shen
- RMOT is a new referring understanding task that can detect and track an arbitrary number of objects following human instruction. We propose the first RMOT benckmark Refer-KITTI, and a baseline model TransRMOT.
Multi-Level Representation Learning with Semantic Alignment for Referring Video Object Segmentation
|CVPR 2022|Paper|
Dongming Wu, Xingping Dong, Ling Shao, Jianbing Shen
Journal Papers:
-
Person re-identification by context-aware part attention and multi-head collaborative learning(TIFS)
Dongming Wu, Mang Ye, Gaojie Lin, Xin Gao, Jianbing Shen
|2021|Paper| -
Reducing estimation bias via triplet-average deep deterministic policy gradient(TNNLS)
Dongming Wu, Xingping Dong, Jianbing Shen, Steven CH Hoi
|2020|Paper|
Technical Report:
- The 1st-place Solution for CVPR 2023 OpenLane Topology in Autonomous Driving Challenge
Dongming Wu, Fan Jia, Jiahao Chang, Zhuoling Li, Jianjian Sun, Chunrui Han, Shuailin Li, Yingfei Liu, Zheng Ge, Tiancai Wang
|2023|Paper|Code|
Honors
- Outstanding Graduates of Beijing (北京市优秀毕业生).
- Outstanding Graduates of BIT (北京理工大学优秀毕业生), Beijing Institute of Technology.
- Excellent Doctoral Thesis Seedling Fund(优秀博士论文育苗基金), Beijing Institute of Technology.
- National Scholarship, Ministry of Education China.
- The 1st place at OpenLane Topology in CVPR2023 Autonomous Driving Challenge ($15,000), Shanghai AI Lab and Huawei.
- ChinaCentury(华瑞世纪) Scholarship, Beijing Institute of Technology.
Service
Invited Reviewer for conferences:
- CVPR 2023,2024,2025
- ICCV 2023,2025
- ECCV 2024
- ICLR 2025
- AAAI 2025
Invited Reviewer for journals:
- International Journal of Computer Vision (IJCV)
- IEEE Transactions on Image Processing (TIP)
- IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
- IEEE Transactions on Multimedia (TMM)
- IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
- IEEE Transactions on Intelligent Vehicles (TIV)
- Pattern Recognition (PR)
- Neurocomputing