Shengxiang Sun

I am a final-year Computer Science undergraduate at the University of Toronto, working with Prof. Weiyu Liu from the University of Utah. Additionally, I have been privileged to collaborate with Prof. Florian Shkurti from the University of Toronto and Prof. Lin Shao from the National University of Singapore.

My research spans robotics and 3D computer vision, with a focus on generalizable robot manipulation. I am particularly interested in enabling robots to perform complex, long-horizon tasks from simple instructions, such as, “prepare a dish from this cookbook.” The solution I pursue involves leveraging Foundation Models to learn from the vast scale of existing human knowledge online, rather than relying on costly, manually collected data.

I am actively seeking a Master’s or PhD position in Robotics and Computer Vision for Fall 2026!

Selected Publications

* indicates equal contribution.
Manual2Skill++: Connector-Aware General Robotic Assembly from Instruction Manuals via Vision–Language Models
Chenrui Tie*, Shengxiang Sun*, Yudi Lin, Yanbo Wang, Zhongrui Li, Zhouhan Zhong, Jinxuan Zhu, Yiman Pang, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao
In Submission
SAFE: Scalable Failure Estimation for Vision-Language-Action Models
Qiao Gu, Yuanliang Ju, Shengxiang Sun, Igor Gilitschenski, Haruki Nishimura, Masha Itkina, Florian Shkurti
NeurIPS 2025
[paper] [project page]
Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models
Chenrui Tie*, Shengxiang Sun*, Jinxuan Zhu, Yiwei Liu, Jingxiang Guo, Yue Hu, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao
RSS 2025
[paper] [project page]

Selected Awards

  • General In-Course Scholarship (2022-2025)
  • Dean’s List (2023-2025)
  • Summer NSERC Math & Computer Science Research Award (2024)

Internships

  • Machine Learning Engineer, Loblaw Digital, Toronto, Ontario, Canada (Jan 2024 - Apr 2024)
  • Machine Learning Research Intern, New H3C Technologies, Beijing, China (Jul 2023 - Aug 2023)

Education

  • Bachelor of Computer Science in University of Toronto, Canada (Sept 2022 - Present)