You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Microsoft AI

Software Engineer | AI Infra

  • Hybrid
  • 3-6 years

Salary

$119,800 - 234,700/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The AI team at the company is hiring a software engineer for AI infrastructure to help build state-of-the-art large language models.

The team wants someone who is highly effective and brings positive energy, empathy, and kindness to work every day.

The role suits someone who likes building consumer experiences and products at a world-class level in a fast-moving setting.

You will help build the models that power the company's products and take on both engineering and research work.

Your work will cover model architecture, data curation, training and inference infrastructure, evaluation methods, and alignment with reinforcement learning from human feedback (RLHF), among other frontier AI topics.

The team's goal is to build AI that stays controllable, safety-aligned, and tied to human values, and to deliver models that reach billions of users.

Starting January 26, 2026, employees must work from a designated office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that office. This depends on local law and may differ by jurisdiction.

Responsibilities

  • Build software for pre-training and post-training infrastructure, including benchmarking, evaluation, routing, and backend systems.
  • Collect data and insights to shape the roadmap for LLM training compute.
  • Help build AI models that power the company's products.
  • Work around obstacles so your work reaches users quickly, and ship in iterations.
  • Work in a fast-paced, design-led product development cycle.
  • Live the company's culture and values.

Requirements

  • A bachelor's degree in computer science or a related technical field and 4+ years of engineering experience coding in languages such as C, C++, Java, JavaScript, or Python, or equivalent experience.
  • Optional: a master's degree in computer science or a related technical field and 6+ years of engineering experience coding in languages such as C, C++, Java, JavaScript, or Python, or a bachelor's degree in the same field and 8+ years of that experience, or equivalent experience.
  • Optional: experience with generative AI.
  • Optional: experience with distributed computing.
  • Optional: experience leading technical projects and backing architectural decisions with data.

Conditions

Software Engineering IC4 base pay across the U.S. is typically USD $119,800 - $234,700 per year; in the San Francisco Bay area and New York City metropolitan area it is USD $160,200 - $261,000 per year.

Software Engineering IC5 base pay across the U.S. is typically USD $142,800 - $274,800 per year; in the San Francisco Bay area and New York City metropolitan area it is USD $188,000 - $304,200 per year.

The position stays open for at least 5 days, and applications are accepted on a rolling basis until it is filled.

Starting January 26, 2026, you must work from a designated office at least four days a week if you live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of it.

The company provides equal opportunity to all applicants.

Benefits

  • Some roles may be eligible for benefits and other compensation.

Where you’d work

Hybrid, 4 or more days a week in the office

The office

About the company

Microsoft AI

Office in New York City, United States

Also hiring in London, United Kingdom, Mountain View, United States and Redmond, United States

1 of their 23 open roles is remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 22 checks run
  • 2 red flags

Still hiring?

14 checks

1 red flag

How crowded?

8 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details10 facts · Role, Location, Compensation
Tech stack
  • Python
  • Java
  • JavaScript
  • C++
  • LLMs
Specialty
Backend
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Development
Specialty
Backend
Experience
4+ years
Tech stack
  • Python
  • Java
  • JavaScript
  • C++
  • LLMs

Location

Work model
Hybrid
Region
United States
Office
  • New York City, United States
Days in the office
4 or more days

Compensation

Salary
$119,800 - 234,700 / year
Pay period
Annual

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason