Regular Data Engineer | ROR

Description

You will join an aviation project that uses modern cloud and Big Data tools to support predictive maintenance for aircraft engines.

The project builds and extends a scalable data platform that handles large amounts of operational and technical data. Once the data is cleaned and structured, the platform supports analysis of engine performance, maintenance needs and operational efficiency.

You will work in an established engineering team with Microsoft Azure, Databricks, Apache Spark, Python and SQL.

The role suits someone who likes hard data problems and wants their work to affect the reliability and upkeep of advanced aviation systems.

The company is part of the global the company Group and supports digital transformation for businesses and public institutions across IT services, including consulting, infrastructure and application management, software implementation and custom software development. It operates in 19 countries, employs over 28,000 people and reported revenues of €2.5 billion in 2023. Its Polish office has teams in Warsaw, Poznan, Katowice, Lublin, Rzeszow and Lodz. Its partners include Microsoft, SAP, Salesforce and ServiceNow.

Responsibilities

• Build and maintain scalable data pipelines with Azure Databricks, Apache Spark, Python and SQL.
• Process and transform large volumes of operational and technical data for predictive maintenance and analytics.
• Create and tune ETL and ELT processes for data ingestion, transformation and storage.
• Set up CI/CD for Databricks applications on Azure, using Terraform and Databricks Asset Bundles (DABs).
• Work with Azure data processing and storage services to build reliable, scalable solutions.
• Improve Spark workloads to raise overall processing performance.
• Add data validation and quality checks that keep datasets consistent, accurate and reliable.
• Work with other data engineers and stakeholders to turn business and data needs into technical solutions.
• Help develop, maintain and improve the existing data platform.
• Investigate data processing failures and make pipelines more stable and faster.
• Write and keep up technical documentation for delivered solutions and data workflows.

Requirements

• Commercial experience in data engineering.
• Hands-on experience with Databricks.
• Experience implementing CI/CD for Databricks applications.
• Practical experience with Microsoft Azure data processing and storage services.
• Strong experience with Apache Spark.
• Good SQL skills.
• Hands-on Python development experience.
• Good understanding of Big Data processing concepts, standards and tools.
• Experience with large-scale data processing pipelines and ETL/ELT processes.
• A bachelor's or master's degree in computer science, data engineering, mathematics or a related technical field.

Conditions

The company has an internal whistleblowing procedure, and details on how to submit a report are available to employees.

The company promotes diversity and equal opportunities for everyone.

Benefits

• A cafeteria system where you choose your own benefits from a range of options.
• Referral bonuses of up to PLN6,000 for referring specialists.
• Revenue sharing for starting partnerships with new clients.
• Training, certifications and technology conference attendance, fully funded by the company.
• Ongoing support from a dedicated Team Manager.
• Technical mentoring from an assigned technical leader, matched to your skills and the project's needs.
• A team-building budget for online and on-site events.
• Chances to join charity projects and local sports programs.
• A supportive, inclusive culture built on mutual respect.