AI Engineer 4 (Gen AI Platform Services: Agentic Systems)

Description

The company uses machine learning and AI to build customer experiences, such as alerting customers to unusual charges and answering their questions in real time, and it has been doing so for years.

The Intelligent Foundations and Experiences (IFX) team sets the direction for AI across the company. The team works with partners in other groups to push forward AI science and engineering, and it builds and deploys proprietary solutions that are central to the business and reach millions of customers.

The team's AI models and platforms let other teams add AI to their products in ways that are responsible, scalable and high impact.

Responsibilities

• Work with a cross-functional group of engineers, research scientists, technical program managers and product managers to ship AI-powered products that change how associates work and how customers interact with the company.
• Design, build, test, deploy and support AI software, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance and observability.
• Use open source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, vector databases and PyTorch.
• Research and introduce advanced foundation model optimization methods that improve scalability, cost, latency and throughput in large production AI systems.
• Shape the technical vision and long-term roadmap for the company's foundational AI systems.
• Own the end-to-end architecture of complex AI systems, keeping them maintainable, observable and ethically aligned.
• Set and maintain service-level objectives (SLOs) for AI reliability, covering latency, uptime and model performance drift.
• Work with infrastructure engineers to improve GPU and TPU utilization and speed up model inference pipelines.
• Lead cross-functional technical reviews of new AI system deployments to confirm they meet security, data governance and compliance standards.
• Mentor Principal and Senior Associates on scalable design, performance tuning and turning research into production systems.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering or a related field, plus at least 4 years of experience developing AI and ML algorithms or technologies.
• Or a Master's degree in one of those fields, plus at least 2 years of experience developing AI and ML algorithms or technologies.
• At least 4 years of experience programming in Python, Go, Scala, CUDA or Java.
• Preferred: experience leading the development of AI systems, making tradeoffs between cost, latency, throughput and accuracy.
• Preferred: 6+ years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud or Azure, or on an equivalent private cloud.
• Preferred: experience designing, building, delivering and supporting AI services.
• Preferred: experience building AI and ML components such as LLM inference, similarity search and vector databases, guardrails or memory, in Python, C++, C, Java, CUDA or Golang.
• Preferred: experience applying the latest techniques to optimize training and inference software for hardware utilization, latency, throughput and cost.
• Preferred: experience building agentic AI systems and agentic workflows.
• Preferred: a habit of following the latest AI research and systems work, and applying new techniques in production with good judgment.
• Preferred: experience designing distributed systems for model training, evaluation and online inference at petabyte scale.
• Preferred: experience defining AI model governance processes, including reproducibility, lineage tracking and automated retention schedules.
• Preferred: a record of shaping architecture decisions across several AI products or platforms.
• You enjoy building systems, take pride in quality and care about doing the right thing.
• You stay curious about research and can understand scientific papers well enough to apply their ideas sensibly.
• You adapt quickly, bring structure to large and unclear problems, ask good questions, dig into root causes and explain findings clearly and concisely.
• You are willing to propose new ideas even when they are unproven.
• You have a strong base in engineering and mathematics, and your skill across hardware, software and AI helps you find optimizations others miss.
• You are resilient and can find a way to reach business goals when no clear path exists.

Conditions

The company will consider sponsoring a new qualified applicant for work authorization for this role.

Salary for full-time roles: Cambridge, MA and McLean, VA are $197,300 to $225,100 a year for AI Engineer 4; New York, NY, San Francisco, CA and San Jose, CA are $215,200 to $245,600 a year for AI Engineer 4.

Pay for candidates hired in other locations follows the range for that location, and the exact salary is stated in the offer letter.

Part-time pay is prorated based on the regular hours agreed.

Applications will be accepted for at least 5 business days.

Agency submissions are not accepted.

The company is an equal opportunity employer and considers applicants with criminal histories as allowed by applicable law. It also promotes a drug-free workplace.

Roles posted in Canada, the United Kingdom and the Philippines are employed by separate company entities.

Benefits

• Performance-based incentive pay, which may include cash bonuses and or long-term incentives, and may be discretionary or non-discretionary depending on the plan.
• Health, financial and other benefits, with eligibility depending on full or part-time status, exempt or non-exempt status and management level.