Sr. Data Engineer

Description

The company's media group runs a portfolio of consumer brands across film, television, streaming and news, and the work here supports its streaming and video delivery.

You will join the Content Delivery Engineering team (CDE) in the Global Video Engineering organization, based in New York City, USA.

The role builds and runs systems that take in, process and store large volumes of data from internal and external partners. Those systems must scale, stay reliable and stay within budget, and they feed models, alerts, reports and visualizations.

Responsibilities

• Design, build and maintain data systems and pipelines, prioritizing reliability, testability and ease of use.
• Prepare data for modeling by cleansing it, handling missing values, selecting variables and creating high-quality features.
• Work with business stakeholders to set business requirements, including KPIs and acceptance criteria.
• Pull data from big data, relational and non-relational sources at the right level of detail for each analytics project.
• Keep up to date with the structure of the relevant datasets and help define needed upgrades and changes.
• Work with software and data architects to build real-time and automated batch versions of data science solutions and connect them to the streaming architecture.
• Review code and configuration changes with a consistent, careful approach, using well-organized repositories and CI/CD pipeline deployments.
• Lead or take part in design reviews, architecture discussions and knowledge-sharing sessions with peers and stakeholders.
• Use observability tools and advanced analytics to find issues, diagnose them and develop fixes.

Requirements

• You hold a bachelor's degree in computer science, information technology or a related field.
• You have 5+ years of hands-on work with big data, including ETL, pipeline building, analysis and code, and you are proficient in at least one programming language.
• You have built scalable, distributed, highly available and resilient systems on industry-standard data platforms such as Snowflake, Databricks, GCP or AWS.
• You are skilled with software repositories, CI/CD pipelines and test automation.
• You have experience with data visualization tools and techniques.
• You are strong in SQL data processing.
• You have applied Site Reliability Engineering (SRE) practices to keep cloud environments scalable and reliable.
• You are familiar with Agile methods, including Scrum and Kanban.
• You communicate clearly in design documents, writing, voice and code, with colleagues from many nationalities.
• Desired: experience with Snowflake or a similar data service.
• Desired: experience with data visualizations.
• Desired: experience with multi-billion record datasets and with leading projects that span data science and data engineering.
• Desired: knowledge of enterprise-level digital analytics platforms.
• Desired: a team-oriented, collaborative approach and a demonstrated willingness to learn new methods and tools.
• Desired: ownership of your work and confidence representing your team to other parts of the company.
• Advantageous: knowledge or production use of CDNs for streaming media delivery. Full training can be provided if you lack this.

Conditions

The role is hybrid and requires working from the office at least four days per week. The company may change in-office requirements at any time.

The salary range is $115,000 to $145,000.

The company is committed to an inclusive workforce and equal opportunity.

Benefits

• Company-sponsored medical, dental and vision insurance.
• A 401(k) plan, paid leave and tuition reimbursement.
• A range of discounts and perks.