Shengxiang Sun

I am an incoming Master’s student in the Computer Science department at the University of Toronto, supervised by Prof. Florian Shkurti. Additionally, I have been privileged to collaborate with Prof. Lin Shao from the National University of Singapore and Dr. Weiyu Liu from Stanford University. As an undergraduate, I studied CS at the University of Toronto.

My research spans robotics and 3D computer vision, with a focus on generalizable robot manipulation. I am particularly interested in enabling robots to perform complex, long-horizon tasks from simple instructions, such as, “prepare a dish from this cookbook.” The solution I pursue involves leveraging Foundation Models to learn from the vast scale of existing human knowledge online, rather than relying on costly, manually collected data.

Selected Publications

* indicates equal contribution.
Manual2Skill++: Connector-Aware General Robotic Assembly from Instruction Manuals via Vision–Language Models
Chenrui Tie*, Shengxiang Sun*, Yudi Lin, Yanbo Wang, Zhongrui Li, Zhouhan Zhong, Jinxuan Zhu, Yiman Pang, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao
International Conference on Robotics and Automation (ICRA) 2026
[paper] [project page]
SAFE: Scalable Failure Estimation for Vision-Language-Action Models
Qiao Gu, Yuanliang Ju, Shengxiang Sun, Igor Gilitschenski, Haruki Nishimura, Masha Itkina, Florian Shkurti
Neural Information Processing Systems (NeurIPS) 2025
[paper] [project page]
Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models
Chenrui Tie*, Shengxiang Sun*, Jinxuan Zhu, Yiwei Liu, Jingxiang Guo, Yue Hu, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao
Robotics: Science and Systems (RSS) 2025
[paper] [project page]

Academic Service

  • Reviewer for ICRA 2026, CVPR 2025 Robo-3DVLM

Selected Awards

  • General In-Course Scholarship (2022-2025)
  • Dean’s List (2023-2025)
  • Summer NSERC Math & Computer Science Research Award (2024)

Internships

  • Machine Learning Engineer, Loblaw Digital, Toronto, Ontario, Canada (Jan 2024 - Apr 2024)
  • Machine Learning Research Intern, New H3C Technologies, Beijing, China (Jul 2023 - Aug 2023)

Education

  • Bachelor of Computer Science in University of Toronto, Canada (Sept 2022 - Present)