Jasper Gerigk

Jasper Gerigk

Computer Science PhD Student

University of Toronto

I am a second-year PhD student at the University of Toronto supervised by Professor Gilitschenski at the Toronto ISL lab. My work focuses on robust and reliable robotics systems using VLM and VLAs.

For my research during my undergraduate degree at the University of Toronto, I received an honorable mention at the CRA’s Outstanding Undergraduate Researcher Awards (2024). Beyond researching object-centric reinforcement learning at TISL, I combined graph neural networks and reinforcement learning to optimize traffic flow at intersections during an internship at Bosch Corporate Research. We were able to train models that outperformed traditional approaches and generalised well to unseen intersection layouts. Building on this experience, I applied geometric deep learning, under the supervision of Professor Engels, to the problem of learning strategies for the deck-building game Dominion. The resulting agent were able to learn strategies previously only seen in human play on a wider set of game configurations.

Academic Interests
  • Artificial Intelligence
  • Robotics
  • Large Models
Education
  • BSc Computer Science Specialist and Mathematics Major, 2024

    University of Toronto, Canada

  • IB Diploma, 2019

    Metropolitan School Frankfurt, Germany

PUBLICATIONS

(2026). SeededGrasp: Language-Guided Grasping in Complex Scenes with Multiple Embodiments. arXiv.

PDF Abstract

(2026). Update-Free On-Policy Steering via Verifiers. arXiv.

PDF Abstract

(2022). An Enhanced Graph Representation for Machine Learning Based Automatic Intersection Management. ITSC.

PDF Cite Abstract

EXPERIENCE

PhD Research
Research on policy learning for robot manipulation with a current focus on generalizable and robust training of vision language action models
Methods applied: PyTorch, VLM, VLA, ROS, Aloha, Franka
Student Researcher
Research on object-oriented reinforcement learning using foundational computer vision models
Initially worked as DSI SUDS Scholar and presented results at DSI SUDS Showcase
Methods applied: Python, PyTorch, JAX, SLURM
Member of the TISL research group led by Professor Gilitschenski
Worked on combining pre-trained computer vision models with reinforcement learning
Methods applied: Pytorch, JAX, Rainbow, SAM, FastSAM
Mercedes Benz AG, Böblingen, Germany
Data Analytics Internship
Member of the Fleet Learning for Automated Driving team
For the first time, used large-scale customer fleet data to analyze lateral vehicle movement to improve comfort of lane following assistant
Methods applied: Spark, Azure Databricks, Frequentist and Bayesian statistics in Python
Member of BMWK-funded research project “Lokales Umfeldmodell für das Kooperative, Automatisierte Fahren in komplexen Verkehrssituationen”
Development of multi-agent reinforcement learning algorithms for centralized planning of connected self-driving vehicles using graph neural networks
Methods applied: DQN, TD3, RCGN, GAT implemented in Python using PyTorch
Excubo AG, Zug, Switzerland
Software Development Internship
Designed and built functional software demonstration based on Server-Side Blazor (C#)
Contributed to backend by integrating machine learning methods using Python
German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
Student Internship
Created instructional material for AI undergraduate course at TU Kaiserslautern on Reinforcement Learning including Deep-Q learning for Brick Breaker using PyTorch
Fraunhofer Institute for Intelligent Analysis and Information Systems, St. Augustin, Germany
Student Internship
Implemented linear least squares for multiclass classification of geographic coordinates

TEACHING EXPERIENCE

Course Material Preparation Teaching Assistant, CSC311 (Introduction to Machine Learning)
Teaching Assistant, CSC258 (Computer Organization)
Teaching Assistant, CSC413 (Neural Networks and Deep Learning)
Teaching Assistant, CSC311 (Introduction to Machine Learning)
Teaching Assistant, CSC413 (Neural Networks and Deep Learning)

EDUCATION

University of Toronto
PhD in Computer Science
University of Toronto
September 2024 – Present Toronto, Canada
Supervised by Igor Gilitschenski
University of Toronto
Bachelor of Science
University of Toronto
September 2019 – April 2024 Toronto, Canada

GPA: 3.96/4.0

Programs:

  • Computer Science Specialist
  • Focus In Artificial Intelligence
  • Mathematics Major

Advanced Courses:

  • CSC311: Introduction to Machine Learning
  • CSC324: Principles of Programming Languages
  • CSC412: Probabilistic Learning and Reasoning
  • CSC413: Neural Networks and Deep Learning
  • CSC420: Introduction to Image Understanding
  • CSC494: Computer Science Project: Developed and published agent for Dominion under supervision of Professor Engels

Awards:

  • 2020, 2023 - Dean’s List Scholar
  • 2019 - 2020 - Millard Scholarship ($1208)
  • 2022 - 2023 - Dr. James A. & Connie P. Dickson Scholarship In Science & Mathematics ($500): Recognizes best University College students in science and mathematics
  • 2022 - 2023 - University of Toronto Scholar ($1500): Recognizes the most outstanding students across all three campuses of the University of Toronto
  • 2024 Computing Research Association’s Outstanding Undergraduate Researcher Award Honorable Mention
Technical University of Darmstadt
Bachelor of Science - Exchange
Technical University of Darmstadt
May 2021 – October 2021 Darmstadt, Germany

Courses covering:

  • Statistical Machine Learning
  • Natural Language Processing using Deep Learning
Johannes Gutenberg University Mainz
Bachelor of Science - Exchange
Johannes Gutenberg University Mainz
November 2020 – October 2021 Mainz, Germany

Courses covering:

  • Linear Algebra
  • Probability and Statistics
  • Numerical Methods

PROJECTS

Cosmos
Cosmos
Core-maintainer of the Cosmos open source project
Cosmos provides the foundation for the development of operating systems in C# and provides a custom compiler, standard library, and drivers
LearnAI
LearnAI
Participated in LearnAI program at UofT
Presented final project at StartAI Conference