Machine Learning Engineer - VLM/LLM Integration

The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation.

This role follows a hybrid work schedule and reports to a Senior Staff Software Engineer.

You will:

• Work with a creative team of people who help to design, train, and evaluate the large-scale ML models that are used throughout Waymo’s systems, both onboard autonomous vehicles and offboard in simulation

• Development of ML framework and infrastructure required for integrating state-of-the-art LLM/VLM models into Waymo's diverse production environments

• Work with Waymo's perception and planning teams to transfer AI Foundational research into scalable and production-ready solutions

You have:

• Bachelor or Master’s degree in Computer Science, similar technical field of study, or equivalent practical experience

• 3+ years of experience with Python

• 3+ years of ML software experience with machine learning frameworks including PyTorch, TensorFlow, Jax/Flax 

We prefer:

• Extensive ML infra experience: specifically in the automation of training, evaluating, and deploying large-scale models in production environments

• Deep learning experience, especially with generative models, e.g., LLMs/VLMs, and/or reinforcement learning

• Advanced proficiency in the internal architecture and performance tuning of ML frameworks like Pytorch, JAX, or Tensorflow