W2PE - Engineer

Description

The company is a Transformative IT Authority that provides technology solutions and consulting services, helping IT executives gain a competitive edge through integrating, automating and innovating.

The company describes its culture as startup-like with the stability of a scalable business, and it has about 1,200 employees across the United States.

The company is headquartered in Irvine, California, with major field offices in Denver, Indianapolis, Grand Rapids, Lexington, Los Angeles, Louisville, Texas and San Francisco.

The team is hiring a Fabric Data Engineer to speed up the enterprise Data Modernization program. The work centers on building and refactoring scalable, metadata-driven ETL pipelines in Microsoft Fabric, and on designing a medallion architecture (Bronze, Silver, Gold) with parameterized Python notebooks. The goal is to move source data from landing through governed, trusted analytical layers, reducing reliance on legacy ETL platforms and getting enterprise reports to insight faster and more reliably.

This is a hands-on delivery role within Phase 1C of the program, where the medallion implementation is already underway. You will also pass architecture, code and operating knowledge to the current data-engineering team as the program matures.

Responsibilities

• Design, build and maintain metadata-driven pipelines in Microsoft Fabric that can be reused across source systems and entities instead of being built one at a time.
• Develop and maintain a metadata and configuration-driven framework that controls ingestion, transformation and loading across the pipeline estate.
• Standardize ingestion using parameterized notebooks to reduce duplicate logic and simplify upkeep.
• Build and refactor the Bronze, Silver and Gold layers in the Fabric Lakehouse and Warehouse, with validation and quality gates that each layer must pass before promotion.
• Keep source fidelity in the landing zone, and build conformed, deduplicated and historized data in Silver to feed Gold transformations.
• Apply warehouse-side transformation logic and support native-service patterns such as Dataflows Gen2 and Fabric Data Factory as part of the platform modernization.
• Develop Python notebooks, including PySpark-based processing, for scalable parallel pipelines that process data faster and shorten time to insight.
• Build restartable, incremental and schema-aware processing that handles growing data volumes and more sources.
• Run data validation and quality checks at landing, Bronze, Silver and Gold, not only at the end of the process.
• Keep operational records for pipeline runs, notebook executions, merges and quality results to support troubleshooting and audits.
• Tune performance, refresh frequency and capacity use in Fabric pipeline design.
• Work with the Director, Data and Analytics Enablement and the current data-engineering team to align pipeline design with governance, metadata and certified-dataset standards.
• Write architecture documents, code and runbooks, and transfer operating knowledge so the current team can run, troubleshoot and extend the pipelines on its own.
• Work with reporting, governance and platform stakeholders so pipeline outputs support trusted, consistent enterprise reporting.

Requirements

• At least 3 years of hands-on experience building production ETL or ELT pipelines.
• Proven experience designing metadata-driven pipelines using parameterized, configuration-based patterns rather than one-off builds.
• Strong Python skills, including building notebook-based processing pipelines with PySpark or equivalent for parallel or distributed work.
• Hands-on experience with Microsoft Fabric and/or Databricks, covering notebooks, Lakehouse and Warehouse objects and pipeline orchestration.
• Practical experience with medallion (Bronze, Silver, Gold) architecture, including validation, deduplication and historization.
• Working knowledge of SQL and relational data warehousing concepts.
• Experience with cloud analytics platforms; Azure is preferred.
• Strong troubleshooting skills and the ability to explain technical designs clearly to both technical and non-technical audiences.
• Nice to have: experience moving pipelines from Azure Data Factory or similar legacy ETL platforms into Fabric-native services.
• Nice to have: familiarity with Power BI semantic models and how downstream reporting consumes them.
• Nice to have: Microsoft Fabric certifications such as DP-600 or DP-700, or equivalent Databricks certifications.
• Nice to have: experience working in a consulting or client-delivery environment.

Conditions

The role involves light physical activity: long periods of sitting, occasional standing and walking, and occasional lifting or moving of items up to 25 pounds. Limited bending, crouching, stooping, stretching and reaching are part of the work.

You need to hear and speak clearly in person and on the phone, and to read printed material and computer screens, including close work and adjusting focus.

Pay depends on location, experience, skill set, performance, licensure and certification, and business needs. Ranges in other locations may differ. Some roles may also include bonuses or commissions that are not part of base salary.

The estimated pay range is $120 to $150 USD.

The company is an equal opportunity employer that makes employment decisions based on qualifications, merit and business needs, without discrimination on protected characteristics. Demographic information is voluntary, confidential and not used in hiring or promotion decisions.

Benefits

• Medical, dental and vision coverage for you and your dependents.
• 401(k) with employer match, 529 college savings plan, health savings account, life insurance and long-term disability coverage.
• Competitive pay.
• Training and development programs.
• Major offices stocked with snacks and drinks.
• A collaborative culture.
• Work-life balance and generous paid time off.