DATABRICKS Data Architect

Description

The company works with the Databricks Data Intelligence Platform, designing Lakehouse solutions that support analytics, data engineering and artificial intelligence.

The role covers data architecture, platform modernization and digital transformation work for major clients.

The team is looking for someone who thinks in terms of architecture, works independently and keeps the client's needs at the centre.

Responsibilities

• Build Lakehouse and Delta Lake designs that run across one or several clouds.
• Create and tune ETL and ELT pipelines with Apache Spark, Structured Streaming and Lakeflow Declarative Pipelines.
• Set up data governance, security and lineage controls using Unity Catalog.
• Specify AI governance controls with Unity Gateway.
• Plan environments for Machine Learning, Generative AI and advanced analytics built on MLflow and Databricks Genie.
• Improve platform speed and spend by applying FinOps practices.
• Take part in modernization and migration projects that move data platforms to Lakehouse architectures.
• Advise clients on Databricks good practice and work alongside technical and business stakeholders.

Requirements

• A solid track record in data architecture and in designing solutions on Databricks.
• Deep working knowledge of Apache Spark, Delta Lake, Unity Catalog and Photon.
• Hands-on experience with Azure, AWS or GCP.
• An understanding of cloud infrastructure, networking, storage and IAM security.
• Experience building ETL and ELT pipelines and data processing solutions.
• Familiarity with data governance, performance tuning and Lakehouse architectures.
• A clear communicator who works autonomously and focuses on the customer.
• Fluent in English and Spanish, both written and spoken.
• A degree in Computer Science, Information Systems or equivalent professional experience.
• Experience with Lakeflow, MLflow, Genie or Unity Gateway.
• Knowledge of Generative AI and Machine Learning.
• Experience migrating legacy data platforms to Databricks.
• Knowledge of FinOps and cloud cost optimization.
• Databricks Data Engineer Professional certification or Platform Architect accreditations.

Conditions

Fully remote: 100% of the work is done remotely.

Benefits

• A competitive salary that reflects your experience.
• An annual performance bonus tied to individual, team and company objectives.
• A flexible pay package covering transport, childcare, training, health insurance and meals.
• Employee perks including discounts, physiotherapy and free English classes.
• Career development through training, certifications and annual performance reviews.