Senior Research Scientist, Multimodal Foundation Models and Robotics

Description

This is a senior research scientist role on the team that works on multimodal foundation models and robotics. The team is building humanoid robot foundation models and the systems that run them, within the company's Generalist Embodied Agent Research group.

The group builds general-purpose embodied agents that pick up complex skills in both virtual and physical settings. Its work spans multimodal foundation models, large-scale robot learning, game AI and physical simulation, and it includes a recent foundation model for humanoid robots.

Your work will feed into the company's long-term research bets and its product plans. This vacancy already exists.

Responsibilities

• Invent and build new AI algorithms and models for general-purpose humanoid robots and embodied agents.
• Create methods for training and running large foundation models at scale.
• Tune AI models and get them running in simulation and on real robot hardware.
• Work with research and engineering groups across the company to turn research into products and services.

Requirements

• A Ph.D. in computer science, electrical engineering or a closely related field, or equivalent research experience.
• Five years of relevant work or research experience in multimodal foundation models, robotics, or both.
• Hands-on training experience and publications in at least one of: LLMs, large vision-language models, video generative models with diffusion methods, or action-based transformers.
• Strong skill at rapid prototyping and training models in frameworks such as PyTorch, JAX or TensorFlow. Python is required. C++ and CUDA skills are a big plus.
• Experience working with large-scale machine learning systems and compute infrastructure.
• Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning or classical control.
• Solid programming in Python, C++, ROS and PyTorch.
• Deep grasp of robot kinematics, dynamics and sensors.
• Ability to operate robot hardware, lab equipment and tools safely.
• Working knowledge of control methods, including PID, model predictive control and whole-body control.
• Familiarity with physics simulators such as MuJoCo and Isaac Sim.
• Experience designing robot hardware and building it by hand.

Conditions

Base salary depends on location, experience and other objective, job-related factors. The expected base salary is 192,000 USD to 304,750 USD for Level 4, and 224,000 USD to 356,500 USD for Level 5.

Applications will be accepted at least until November 3, 2026.

The company uses AI tools in its recruiting process.

The company is an equal opportunity employer and does not discriminate on any protected characteristic.