Senior Software Engineer-ETL

Description

The company's technology teams are building a new platform on Microsoft Azure that brings data from around the world into one open ecosystem.

Customers across the globe use the platform's data and analytics to make decisions and expand their business.

This is a Data Engineer role, and you would work alongside skilled engineers who enjoy learning newer tools such as Python, Snowflake, Postgres, GitHub Copilot, VS Code, Airflow, Kubernetes and Docker.

The team deploys its work through DevOps pipelines that use Azure, Kubernetes and GitHub Actions.

The company is a consumer intelligence firm that combined with GfK in 2023. It is an Advent International portfolio company, operates in 100+ markets and covers more than 90% of the world's population.

Responsibilities

• Build, test, troubleshoot and enhance applications using Python, FastAPI, Snowflake, Postgres, complex SQL, Azure cloud services, Airflow, GitHub, Kubernetes and Docker.
• Ingest data from many sources, each in a different format.
• Apply complex business transformations to source data and produce reporting datamarts.
• Release application components through CI/CD pipelines, with help from in-house AI agents.
• Write utilities that monitor systems and automate repetitive tasks.
• Work in agile, cross-functional teams with internal staff and external clients in Operations, Infrastructure and Tech Ops.

Requirements

• Required skills: 6-10 years of applicable software engineering experience.
• Strong hands-on ability to write complex SQL.
• Practical use of AI tools such as GitHub Copilot, VS Code and prompts to generate code and automate every SDLC phase.
• Solid grasp of data warehousing concepts, data modelling and reporting datamarts.
• Hands-on experience designing ETL enhancements.
• Strong object-oriented programming for front-end and back-end work, including Python, Airflow and FastAPI.
• You must have cloud experience, preferably with Microsoft Azure.
• Good to have: experience with DevOps tools such as GitHub, Kubernetes, Jenkins and Docker.
• Experience integrating RESTful APIs and an understanding of microservices architecture.
• Strong knowledge of relational databases, preferably Snowflake and PostgreSQL.
• Excellent English communication, with the ability to work across technology teams and with the business.
• Minimum B.S. degree in Computer Science, Computer Engineering or a related field.

Conditions

The role is based in Chennai.

AI tools may support screening, assessments, interview scheduling and job matching, but only humans make final hiring decisions.

Benefits

• Flexible working environment.
• Volunteer time off.
• LinkedIn Learning access.
• Employee assistance program (EAP).