This is a mid-level position on a brand-new data platform that brings together the company's GSCM, SEASI, SMART and BOSS systems.
You would own the pipeline end to end, from ingestion through the Bronze, Silver and Gold layers, while moving legacy Alteryx workflows into code-based dbt and Python.
You would also build an MCP server so AI agents can query the business data marts, supporting the company's AI analytics work.
The goal is a scalable, governed data foundation that speeds up business insight and AI adoption.
Responsibilities
Pull data from Microsoft SQL Server (BOSS) and Oracle into the Bronze layer, using CDC for incremental loads.
Build dbt models for Silver that handle cleansing, standardization, deduplication and data quality tests.
Create Gold business data marts and port the existing Alteryx logic into them.
Set up Apache Iceberg tables and a REST Catalog, including schema evolution and time travel.
Build and run Apache Airflow DAGs, covering dependencies, scheduling and failure alerts.
Build an MCP server that gives AI agents catalog and metadata access, ontology integration and query execution against Gold marts.
Manage metadata and data lineage in OpenMetadata.
Automate Excel reporting with Python and openpyxl.
Requirements
3+ years of hands-on data engineering in production environments.
Strong SQL, including window functions, CTEs and query tuning.
Practical dbt experience with model design, incremental strategies, macros and tests.
Python for data processing and automation, including pandas.
Experience building Apache Airflow DAGs.
Experience with at least one analytical engine: Trino/Presto, Apache Spark or DuckDB.
Experience with at least one lakehouse table format: Apache Iceberg, Delta Lake or Apache Hudi.
Experience with Medallion Architecture and star schema or dimensional modeling.
Experience integrating relational sources such as Microsoft SQL Server and Oracle through CDC or batch processing.
Required skills: SQL, dbt, Python, pandas, Apache Airflow, Trino/Presto or Apache Spark or DuckDB, Apache Iceberg or Delta Lake or Apache Hudi, Microsoft SQL Server, Oracle, Kubernetes, MinIO (S3-compatible storage).
Preferred: experience with EL tools such as Airbyte or Fivetran, and Iceberg REST Catalog implementations such as Apache Polaris.
Preferred: experience with governance tools such as OpenMetadata or DataHub, and semantic layers such as Cube.dev.
Preferred: ability to read Alteryx workflows (.yxmd) and migrate their logic to SQL or dbt.
Preferred: experience developing MCP servers or building LLM, RAG or AI agent pipelines.
Preferred: experience developing applications, APIs or backend services in Java and/or Python.
Preferred: experience building GenAI applications, including LLM integration, retrieval-augmented generation (RAG) and AI agent workflows.
Preferred: hands-on work with LangChain and/or LangGraph for tool-enabled AI agents and multi-step workflows.
Preferred: understanding of retail and home appliance domains, including PSI (Production, Sales, and Inventory) and sales analytics.
Preferred technical skills: Java or Python, Generative AI (GenAI) and LLM integration, LangChain, LangGraph, RAG and AI agent pipelines, MCP server development, Airbyte, Fivetran, Apache Polaris, OpenMetadata, DataHub, Cube.dev, Alteryx, openpyxl.
Conditions
Contract length: 1 year.
Pay: $10,371.64 per month, depending on experience (DOE).
Applicant information is kept confidential under EEO guidelines.