AI Solutions Architect

Description

The company is a technology firm within the global Accenture group that serves the US federal government. Its roughly 13,000+ people support clients in defense, national security, public safety, civilian work, and military health.

This Senior Manager role leads the design, build, and rollout of large language model applications for enterprise use. You will connect technical work with business results and run cross-functional teams that deliver AI solutions from model fine-tuning through to production at scale.

Responsibilities

• Lead and coach a team of 3 ML engineers and full-stack developers.
• Set technical roadmaps for LLM applications that support business goals.
• Run sprint planning, code reviews, and architecture sessions.
• Handle staffing, schedules, and communication with stakeholders.
• Design full-stack LLM systems covering frontend, API layers, vector stores, and model orchestration.
• Direct engineering approaches, retrieval-augmented generation (RAG) work, and fine-tuning efforts.
• Build scalable microservices that connect to LLM APIs such as OpenAI, Anthropic, AWS Bedrock, and Azure OpenAI.
• Set up MLOps pipelines for model versioning, A/B testing, monitoring, and continuous deployment.
• Improve inference speed, lower latency, and manage cost.
• Build production apps with Python, TypeScript or JavaScript, and frameworks such as React, Next.js, and FastAPI.
• Create evaluation methods for model performance, safety, and alignment.
• Put guardrails, content filtering, and responsible AI practices in place.
• Prototype new capabilities such as function calling, agents, and multimodal applications.
• Work with product managers, external stakeholders, and security teams on requirements and compliance.
• Present technical proposals and demos to executive leaders.
• Define coding standards, documentation practices, and knowledge-sharing routines.
• Manage vendor relationships and assess new LLM technologies.

Requirements

• 8 years in software engineering or data science, including 3 years in leadership roles.
• 3 years of hands-on work with LLMs or generative AI applications.
• Experience deploying production AI or ML systems at scale.
• Experience managing cross-functional technical teams.
• Working knowledge of ML frameworks such as PyTorch, TensorFlow, Hugging Face, LangChain, or LlamaIndex.
• Experience with vector databases such as Pinecone, Weaviate, or ChromaDB, plus embeddings and/or semantic search.
• Experience with cloud platforms such as AWS, Azure, or GCP, and with containers such as Docker or Kubernetes.
• Familiarity with CI/CD, infrastructure-as-code, and/or MLOps tools such as MLflow or Weights & Biases.
• Deep understanding of LLM architectures, transformer models, and prompt engineering.
• Strategic thinking, with the ability to turn business needs into technical solutions.
• Strong communication skills for both technical and non-technical audiences.
• Experience with Agile or Scrum and project management.
• Understanding of data privacy, security, and AI governance frameworks.
• A Bachelor's degree in Computer Science, Engineering, or a related field (required).
• Bonus: a Master's degree or PhD in Computer Science, AI/ML, or a related discipline (strongly preferred).
• Bonus: DoD 8140 Policy Framework knowledge.
• Bonus: relevant certifications in prompt engineering, LLM development, or AI ethics.
• Bonus: a steady habit of keeping up with the fast-moving AI and ML field.
• You must hold an active TS/SCI clearance with a polygraph.

Conditions

Compensation depends on factors including office location, role, skill set, and experience.

The base pay range for this role is $139,300 to $269,000 USD in California, Colorado, Connecticut, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Ohio, Vermont, Virginia, Washington, and the District of Columbia.

Applications are accepted on an ongoing basis, with no fixed deadline.

The company gives equal opportunity to all applicants.

Benefits

• A wide range of benefits is offered.