Data Engineer Consultant

Description

The company is seeking an experienced Data Engineer consultant to design and govern complex end-to-end data architectures.

The work spans ingestion, integration, processing, storage, governance and consumption, and includes weighing architectural options and steering technical decisions.

The company is a European digital services provider. Its portfolio covers consulting, application services, digital engineering, cloud, cybersecurity, platforms and infrastructure services.

Responsibilities

• Design scalable, resilient and secure end-to-end data architectures that match business, functional and non-functional requirements.
• Define data models and architectures for Data Warehouses, Data Lakes, Lakehouses and analytical platforms.
• Design integration approaches for ETL/ELT, batch, streaming, CDC, APIs and event-driven patterns.
• Assess architectural and technology options, and record trade-offs and decisions in ADRs or equivalent.
• Define and evolve reference architectures, blueprints, standards and data architecture principles.
• Build Data Governance, Data Quality, Data Lineage, Metadata Management, Data Catalog, Master Data Management, security and GDPR into the architecture.
• Plan for performance, scalability, availability, recoverability, observability and cost optimisation.
• Guide architects, data engineers and implementation teams on architecture governance and technical direction.
• Write architecture documentation and explain recommendations to technical and business stakeholders.

Requirements

• At least 15 years of professional IT experience, including proven work in Data Architecture, Solution Architecture and complex data solution design.
• A degree in Computer Engineering, Software Engineering or a related field.
• Advanced knowledge of relational and NoSQL databases, data modelling, and Data Warehouse, Data Lake, Lakehouse and Big Data technologies.
• Experience with Azure, AWS or Google Cloud.
• Strong experience with data integration architectures and patterns.
• Solid knowledge of data governance, security, quality, lineage, metadata, data catalogues, Master Data Management and GDPR.
• Experience with reference architectures, technology standards and Enterprise Architecture principles.
• You can analyse complex requirements, weigh trade-offs and make architectural decisions on your own.
• Technical leadership and the ability to shape architectural decisions across multidisciplinary, global teams.
• Knowledge of the Energy & Utilities sector.
• Strong written and spoken English and Portuguese.
• Valued extras: Microsoft Fabric, Azure Databricks, Azure Synapse, BigQuery or Amazon Redshift.
• Valued extras: strategic projects, Agile methodologies, JIRA and Confluence.
• Valued extras: data architectures for Analytics, Machine Learning and AI.
• Valued extras: Portuguese and Spanish.

Conditions

Equal opportunity applies to all candidates.