Senior Data Engineer

Description

The team builds data services for millions of customers of the company's retail club business.

The work also prepares those data services for AI agents, LLM-based systems and other automated tools to find, trust and use.

You will work with engineering, AI/ML and product teams on the data side of this shift.

Responsibilities

• Design, build, test and deploy scalable data solutions that serve millions of customers and can be used by AI agents.
• Work with engineering, AI/ML and product teams so data services can be found, trusted and used by AI agents and LLM-based systems.
• Help shape a data-first, agent-aware architecture across the company's engineering teams and encourage new ideas around intelligent automation.
• Work with product and business teams to decide which data products to build first, focusing on autonomous decisions and context-rich recommendations.
• Build features that connect structured and unstructured data to downstream AI agents, supporting better answers, faster insights and automation.
• Deploy and monitor products on cloud platforms, designing in agent observability, telemetry and auditability.
• Create data health monitoring, traceability and context enrichment processes so the data agents use is reliable and governed.
• Lead technical solutioning for full-lifecycle projects, considering how data will support autonomous workflows, co-pilots and multi-agent systems.

Requirements

• Minimum: a Bachelor's degree in Computer Science and 3 years of software engineering or a related field, or 5 years of software engineering or a related field, or a Master's degree in Computer Science and 1 year of software engineering or a related field.
• Minimum: 2 years of experience in data engineering, database engineering, business intelligence or business analytics.
• 4-6 years of Big Data development, including scalable, fault-tolerant architectures.
• 2-3 years of hands-on work with GCP or Azure, including BigQuery, Dataflow, Pub/Sub or equivalent services.
• Strong grounding in data engineering best practices and experience building complex pipelines that agents can consume efficiently.
• Experience designing semantic layers or knowledge graphs that support data-aware AI agents.
• Proven data modeling and architecture skills, with an understanding of how data structure affects retrieval quality and relevance for agents.
• Understanding of data governance, covering quality, access control and lineage, especially for agent auditability and trust.
• Experience writing clean, testable code in Python, Java or Scala, and using PySpark or Spark for distributed processing.
• Ability to write optimized, scalable SQL and work with large datasets on cloud-native and open-source platforms.
• Familiarity with Kafka, Spark Streaming, Druid and Presto, and how they work together in real-time or hybrid systems.
• Solid software engineering across backend and frontend work.
• Advanced Java and Spring Boot skills, plus strong experience with a modern frontend framework such as React, Angular or Vue.js.
• Experience with SQL (Azure SQL) and NoSQL (Cosmos, Cassandra, MongoDB) databases in backend services and full stack systems.
• Hands-on experience with Kafka, Docker, Kubernetes, Azure and GCP.
• Strong grasp of DevOps, CI/CD pipelines, system observability and deployment for applications with frontend and backend parts.
• A record of designing and maintaining scalable, reliable, high-performing full stack applications.
• A record of building enterprise systems with user-facing interfaces and backend services.
• Strong skills in API design, performance tuning and scalable solution development across the full stack.
• Preferred: experience with data engineering, database engineering, business intelligence or business analytics, ETL tools, and large datasets in the cloud.
• Preferred: a Master's degree in Computer Science or a related field, plus 3 years of software engineering experience.
• Preferred: knowledge of WCAG 2.2 AA, assistive technologies and accessibility best practices for inclusive digital products.
• Beneficial but not required: exposure to LLM-driven workflows, prompt templating or orchestration tools such as LangChain, LlamaIndex or CrewAI.

Conditions

The annual salary range is $117,000.00 - $234,000.00.

Annual or quarterly performance bonuses are part of the pay.

Stock may be included for certain positions.

Primary location: 1275 Crossman Ave, Sunnyvale, CA 94089-1103, United States of America.

The company is an equal opportunity employer and keeps a drug-free workplace.

Benefits

• Competitive pay with performance-based bonuses.
• Medical, vision and dental coverage.
• 401(k), stock purchase plan and company-paid life insurance.
• PTO, including sick leave, parental leave, family care leave, bereavement, jury duty and voting time.
• Short-term and long-term disability, company discounts, military leave pay, and adoption and surrogacy expense reimbursement.
• Education program covering high school completion through bachelor's degrees, English language learning and short certificates, with tuition, books and fees fully paid by the company for full-time and part-time staff.
• PTO and/or PPTO for vacation, sick leave, holidays or other uses, with the amount based on job classification and length of employment, meeting or exceeding paid sick leave laws where they apply.
• Some benefits have eligibility rules and may depend on job classification and length of employment, and are subject to plan terms.