Data Engineer

Description

The company needs a data engineer to design, build and support enterprise data platforms on Microsoft Azure.

The role calls for hands-on data engineering and ETL/ELT work, plus working knowledge of cloud data architecture and Azure data, integration, processing, application and security services.

Experience designing and implementing these capabilities in cloud environments is essential, and Azure is the main focus. You need a firm grasp of architecture, modeling, integration, pipelines, data quality and governance across enterprise platforms.

The company wants someone who goes beyond building pipelines and understands architecture, integration patterns, cloud security, governance, troubleshooting and running a data platform end to end.

The company works on customer missions, including federal government contracts.

Responsibilities

• Design and build enterprise-scale pipelines and ETL/ELT solutions.
• Create data architectures for batch, real-time and event-driven processing.
• Model data, map data flows, define integration patterns and choose storage designs.
• Pull data in from databases, APIs, files, applications and enterprise systems.
• Build and support Azure data solutions using Synapse, Data Factory, ADLS Gen2, Functions, Logic Apps and Event Hubs.
• Deliver data solutions on Azure SQL Database and Cosmos DB.
• Help with governance tasks such as cataloging, classification and lineage.
• Secure data using RBAC, managed identities, Key Vault, private endpoints and Entra ID.
• Monitor, troubleshoot and tune pipelines and production data services.
• Work with architects, developers, analysts, cybersecurity teams and business stakeholders.
• Apply enterprise standards for security, compliance, data quality and governance.

Requirements

• Required: You hold a bachelor's degree in Computer Science, Information Systems, Engineering or a related field, or have equivalent experience.
• Required: You have 7+ years in data engineering, data architecture, data integration or ETL/ELT.
• Required: You have a solid grasp of architecture, data modeling, warehousing, data lakes and integration patterns.
• Required: You have designed and implemented data solutions in cloud environments.
• Required: You have strong SQL skills and work well with relational databases and data warehouses.
• Required: You have hands-on experience building and supporting ETL/ELT pipelines and integration solutions.
• Required: You have hands-on experience with these Microsoft Azure data services: Azure Synapse Analytics, Azure Data Factory or Synapse Pipelines, Azure Data Lake Storage Gen2, Azure Functions and/or Logic Apps, and Azure SQL Database.
• Required: You have integrated data from several enterprise sources, including databases, APIs, files and applications.
• Required: You understand cloud security concepts including RBAC, managed identities, Key Vault, private endpoints and Entra ID.
• Required: You have experience troubleshooting and supporting production data solutions.
• Desired: Skilled with Azure Event Hubs and real-time data processing.
• Desired: Proficient with Cosmos DB and NoSQL data architectures.
• Desired: Knowledgeable in Microsoft Purview, including governance and lineage capabilities.
• Desired: Able to work with Self-Hosted Integration Runtime and hybrid data integration patterns.
• Desired: Familiar with Azure App Service, Power BI and Azure Machine Learning.
• Desired: Adept in Python, PySpark or comparable data engineering languages.
• Desired: Competent with Azure DevOps, Git, CI/CD practices and automated deployment pipelines.
• Desired: Strong understanding of Azure Monitor and Application Insights for observability and performance monitoring.

Conditions

Full time, regular employee.

Up to 10% local travel.

Minimum Secret clearance required to start.

Proposed salary range: $103,800 - $218,100.

Final salary depends on several factors, including geographic location, Federal Government contract labor categories and wage rates, prior experience, specific skills, education and certifications.

Benefits

• Competitive compensation, benefits and learning and development opportunities.
• Flexible time off that lets you balance quality work with personal life.
• Access to robust learning resources.
• Comprehensive benefits including healthcare, wellness, financial, retirement, family support, continuing education and time off.