You will join the Content Delivery Engineering team in the Global Video Engineering organization in New York City, USA, as a Senior Data Engineer.
The company is a large media and entertainment business with several consumer brands, and the team works across them to move faster and improve the customer experience.
You will help build and run systems that take in, process and store large volumes of data from the company's own systems and from partner systems. These systems need to scale, stay reliable and stay within budget.
Your work will feed models, alerts, reports and visualizations built on very large datasets.
Responsibilities
Design, build and maintain new and existing data systems and pipelines, prioritizing reliability, testability and ease of use.
Help clean, transform, impute and select data to produce strong features for modeling.
Work with business stakeholders to set requirements, including KPIs and acceptance criteria.
Pull data from big data, relational and non-relational sources at the level of detail each analytical project needs.
Keep up to date with the structure of relevant datasets and help propose upgrades and changes.
Work with software and data architects to build real-time and automated batch versions of data science solutions and plug them into the streaming architecture.
Review code and configuration changes through peer review, and keep repositories organized and CI/CD deployments consistent.
Take part in or lead design reviews, architecture discussions and knowledge-sharing sessions with peers and stakeholders.
Use observability tools and advanced analytics to find issues, diagnose them and build fixes.
Requirements
A bachelor's degree in computer science, information technology or a related field.
5+ years of hands-on big data work, including ETL, pipeline building, analysis and coding, with deep skill in at least one programming language.
Experience building scalable, distributed, highly available and resilient systems on industry data platforms such as Snowflake, Databricks, GCP or AWS.
Skilled in using source code repositories, CI/CD pipelines and test automation.
Experience with data visualization tools and techniques.
Strong SQL data processing skills.
Experience applying Site Reliability Engineering practices to keep cloud systems scalable and reliable.
Familiarity with Scrum and Kanban.
Able to communicate clearly in design documents, writing, speech and code with people from many different backgrounds.
Knowledge or production experience using CDNs to deliver streaming media is advantageous, but full training can be provided if you lack it.
Desired characteristics:
Experience with Snowflake or a similar data service.
Experience with data visualization.
Experience with datasets of several billion records, and leading projects that span data science and data engineering.
Knowledge of enterprise digital analytics platforms.
A team-oriented, collaborative approach and a clear willingness to learn new methods and tools.
Pride and ownership in your work, and confidence representing your team to other parts of the company.
Conditions
This is a hybrid role requiring work from the office at least four days per week.
The company may change in-office requirements at any time.
Salary range is $115,000 - $145,000.
The company promotes an inclusive workplace and welcomes applicants from all backgrounds.
Benefits
Eligibility for company-sponsored benefits, including medical, dental and vision insurance.
A 401(k) plan, paid leave and tuition reimbursement.
A range of discounts and perks.
Full details are on the benefits page of the company careers site.