Shengxiang Sun
I am an incoming Master’s student in the Computer Science department at the University of Toronto, supervised by Prof. Florian Shkurti. Additionally, I have been privileged to collaborate with Prof. Lin Shao from the National University of Singapore and Dr. Weiyu Liu from Stanford University. As an undergraduate, I studied CS at the University of Toronto.
My research spans robotics and 3D computer vision, with a focus on generalizable robot manipulation. I am particularly interested in enabling robots to perform complex, long-horizon tasks from simple instructions, such as, “prepare a dish from this cookbook.” The solution I pursue involves leveraging Foundation Models to learn from the vast scale of existing human knowledge online, rather than relying on costly, manually collected data.
Selected Publications
* indicates equal contribution.
| Manual2Skill++: Connector-Aware General Robotic Assembly from Instruction Manuals via Vision–Language Models Chenrui Tie*, Shengxiang Sun*, Yudi Lin, Yanbo Wang, Zhongrui Li, Zhouhan Zhong, Jinxuan Zhu, Yiman Pang, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao International Conference on Robotics and Automation (ICRA) 2026 [paper] [project page] | |
| SAFE: Scalable Failure Estimation for Vision-Language-Action Models Qiao Gu, Yuanliang Ju, Shengxiang Sun, Igor Gilitschenski, Haruki Nishimura, Masha Itkina, Florian Shkurti Neural Information Processing Systems (NeurIPS) 2025 [paper] [project page] | |
| Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models Chenrui Tie*, Shengxiang Sun*, Jinxuan Zhu, Yiwei Liu, Jingxiang Guo, Yue Hu, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao Robotics: Science and Systems (RSS) 2025 [paper] [project page] |
Academic Service
- Reviewer for ICRA 2026, CVPR 2025 Robo-3DVLM
Selected Awards
- General In-Course Scholarship (2022-2025)
- Dean’s List (2023-2025)
- Summer NSERC Math & Computer Science Research Award (2024)
Internships
- Machine Learning Engineer, Loblaw Digital, Toronto, Ontario, Canada (Jan 2024 - Apr 2024)
- Machine Learning Research Intern, New H3C Technologies, Beijing, China (Jul 2023 - Aug 2023)
Education
- Bachelor of Computer Science in University of Toronto, Canada (Sept 2022 - Present)



