You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Bosch Group

Data Engineer – Unified Data Layer (UDL) (f/m/div.)

  • Hybrid
  • 3-6 years
  • English (C2)
  • Portuguese (C1)

Salary

Not stated

Similar roles pay €60K - 105K a year · our estimate

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The team is Platform and Pipeline Engineering, and this role builds the pipelines that connect lab equipment, high-throughput test benches and edge systems on premises to Microsoft Azure.

You will work directly with scientists, lab engineers and technicians, helping them get raw measurement files decoded, explaining domain terms and automating routine uploads.

Responsibilities

  • Build, automate and keep resilient data pipelines running from on-premises lab equipment, test benches and edge systems into Azure.
  • Reverse-engineer binary, proprietary and undocumented file formats that have no standard connector, and write parsers and normalization code for them.
  • Write parsers for sensor streams, time series and bus telemetry; multi-dimensional scientific arrays, spatial grids and spectral data; nested binary logs and custom ASCII exports; and event logs, metadata and irregular experimental batch runs.
  • Clean, validate and transform fragmented or schema-less raw data into partitioned Delta Lake and Parquet tables that analysts and ML teams can use.
  • Deploy, monitor and maintain Azure pipeline resources with Terraform, Databricks and containerized workflows, following the team's existing templates.
  • Work with solution architects and senior engineers on ingestion patterns, schema cataloguing and governance standards.
  • Write and maintain technical documentation, code comments and onboarding guides so research teams can connect their equipment.
  • Support proof-of-concept work on linking metadata to corporate AI assistants, data discovery catalogs and newer data tools.

Requirements

  • A BSc, MSc or PhD in data engineering, computer science, software engineering, applied physics, electrical engineering or a closely related field.
  • At least 3+ years of professional data engineering experience building automated, reliable pipelines.
  • At least 2 years of hands-on work with heterogeneous, non-standard or binary sources such as sensor logs, lab exports, hardware telemetry or raw byte streams.
  • At least 1+ years of production use of Apache Spark (Databricks preferred) and Microsoft Azure.
  • A track record of decoding, parsing or converting legacy or custom formats into structured data.
  • Strong Python for data work, including binary handling with struct, byte manipulation, NumPy, Pandas and PySpark, plus Bash.
  • Solid knowledge of Delta Lake, distributed processing, SQL and NoSQL or document stores.
  • Proficiency with Git, GNU/Linux and Terraform.
  • Practical experience with transport methods such as REST APIs, SFTP, Kafka or Event Hubs, and IoT or streaming protocols.
  • An analytical mind and genuine curiosity about opening unfamiliar files, reading headers and solving decoding problems.
  • A friendly, patient communication style that helps lab technicians, domain scientists and software teams understand each other.
  • C2 English, written and spoken.
  • Fluent Portuguese.
  • Desirable: experience with scientific or hierarchical file formats such as HDF5, NetCDF, Parquet or Protobuf.
  • Desirable: familiarity with industrial telemetry or historian protocols such as OPC UA or MQTT.
  • Desirable: exposure to Azure analytics tools such as Azure Data Factory, Event Hubs or Azure Data Explorer.
  • Desirable: experience with vector databases.
  • B2 English is required, and B2 German is a plus.

Conditions

Work is based with an international team in Lisbon, at a company focused on sales, marketing, communication, training, nearshoring and shared HR services across Europe.

The company has around 300 specialist staff from roughly 15 nationalities.

The team builds customer experience, mobility and monitoring solutions for companies and their customers.

Equal-opportunity applies.

Benefits

  • Flexible working hours.
  • Medical services, employee discounts, sports and health activities, a canteen, and good public transport access.
  • Room for creative work and the chance to work on international challenges.

Where you’d work

Part of the week in the office

About the company

Bosch Group

Office in Portugal

Also hiring in Hungary, United Kingdom, Poland and 32 more places

14 of their 287 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 20 checks run
  • 1 red flag

Still hiring?

13 checks

No red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details11 facts · Role, Location, Compensation, Employment, Requirements
Tech stack
  • Python
  • SQL
  • Kafka
  • Azure
  • Spark
  • Databricks
Type
Full-time
Specialty
Data Engineering
Region
Europe
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Experience
3+ years
Tech stack
  • Python
  • SQL
  • Kafka
  • Azure
  • Spark
  • Databricks

Location

Work model
Hybrid
Region
Europe
Office
  • Portugal

Compensation

Salary
Salary by agreement
Pay period
Annual

Employment

Type
Full-time

Requirements

Languages
  • English (C2)
  • Portuguese (C1)

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason