Sr Data Engineer

Description

The team designs, builds and tests data engineering processes that produce analytical and reporting outputs, and prepares data for data science work.

You will also manage and maintain metadata structures, and support post-deployment activities when needed.

The role looks for automation, including AI tools where they fit, to cut manual effort and raise process efficiency. Work is delivered on schedule using agile methods.

Responsibilities

• Create technical data dictionaries and help maintain business glossaries to analyse datasets.
• Profile and analyse data from source systems, manually maintained sources, machine-generated sources and target repositories.
• Design logical and physical data models for both OLTP and OLAP solutions.
• Write and keep up data mapping specifications based on analysis results and functional requirements.
• Run a range of data loads and transformations using several tools and technologies.
• Build automated ETL jobs that follow the mapping specifications.
• Maintain the metadata structures used to build reusable ETL components.
• Study reference datasets and get familiar with Master Data Management (MDM) tools.
• Assess how changes affect downstream systems and products.
• Turn in-depth data analysis into solutions and recommendations.
• Design and build the data quality (DQ) rules required.

Requirements

• A bachelor's degree from an accredited university or college plus at least 2 years of professional experience, or an associate degree plus at least 5 years, or a high school diploma plus at least 7 years.
• Military service counts as professional experience.
• You must be legally authorised to work in the U.S. The company will not sponsor employment visas for this role, now or later.
• Exposure to industry-standard data modelling tools such as ERWin or ER Studio.
• Exposure to ETL tools such as Informatica or Talend.
• Exposure to data catalog, automated data discovery and data lineage tools such as Alation, Collibra or TAMR.
• Hands-on programming experience in Java, Python or Scala.
• Hands-on experience writing SQL for Oracle, MySQL, PostgreSQL or HiveQL.
• Experience with big data and NoSQL tools such as Hadoop, Spark, Hive, Cassandra or HBase.
• Experience handling unstructured data, including XML and JSON formats.
• Ability to run exploratory data analysis, produce visual summaries and spot data quality issues early.
• The role needs access to U.S. export-controlled information, so employment depends on proving U.S. Person status: U.S. citizen, U.S. lawful permanent resident, or someone granted asylee or refugee status (a protected individual under 8 U.S.C. 1324b(a)(3)).

Conditions

Only candidates legally authorised to work in the United States are considered for this opening.

Any offer depends on passing a drug screen where applicable. Employees may also be subject to random and reasonable-suspicion drug and alcohol testing.

Relocation assistance is not provided.