Hi, I'm Shengxiang Sun

I’m a third-year Computer Science undergraduate at the University of Toronto, working with Prof. Florian Shkurti in the Robot Vision & Learning Lab. Additionally, I am fortunate to collaborate with Prof. Lin Shao from the National University of Singapore.

My research focuses on robotics, computer vision, and machine learning, with a particular interest in enabling robots to perform complex, long-horizon tasks through simple human instructions, such as “cook the egg.” I’m currently exploring robot generalization and safety across tasks, objects, and environments to advance this goal.

Email: owen.sun [at] mail.utoronto.ca


Selected Publications/Pre-prints

* indicates equal contribution

Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models

Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models

arXiv, 2025

A novel framework that enables robots to autonomously perform complex assembly tasks in real-life guided by high-level manual instructions.

Projects

Uncertainty Quantification in Vision-Language Models

Uncertainty Quantification in Vision-Language Models

Shengxiang Sun, Florian Shkurti

Summer research project to explore effective uncertainty estimation techniques for vision-language models.

GenAI For Automating Email Replies

GenAI For Automating Email Replies

This project involved combining Python, CI/CD, and Gemini Pro to automate thousands of email replies per week at Loblaw Digital.

InterView - GenAI Genesis 2024

InterView - GenAI Genesis 2024

Awarded first place in Best AI in Safety & Responsible AI. InterView is an AI platform that trains HR recruiters by providing real-time feedback on interview techniques and detecting biases related to age, gender, and ethnicity. It uses React for its frontend and Google's AI tools for accurate transcriptions and bias detection in interview transcripts.

Experience

  • LinS Lab, National University of Singapore
    Research Assistant, advised by Prof. Lin Shao
    Research Areas: robot learning from structured knowledge, foundational models for robotics
    October 2024 - Present
  • Robot Vision & Learning Lab, University of Toronto
    Research Assistant, advised by Prof. Florian Shkurti
    Research Areas: decision making under uncertainty, foundational models for robotics, hierachical image segmentation
    May 2024 - October 2024
  • Loblaw Digital
    Machine Learning Engineer Co-op
    Project: Generative AI for automated email replies
    Jan 2024 - April 2024
  • Department of Computer Science, University of Toronto
    Research Assistant, supervised by Prof. Xujie Si
    Research Areas: Neurosymbolic AI, trustworthy & intepretable algorithms
    Dec 2023 - April 2024
  • New H3C Technologies
    Machine Learning Researcher Intern
    Research Areas: multimodal large language models, diffusion dodels
    Jul 2023 - August 2023

Education

  • University of Toronto
    B.S. in Computer Science.
    Fall 2022 - Current