Data Engineer

Description

The New York City Department of Sanitation (DSNY) collects and recycles waste, cleans City streets and vacant lots, removes abandoned vehicles, and clears snow and ice. It is the largest municipal sanitation agency in the nation, with nearly 10,000 employees, 59 district garages, and more than 5,000 trucks, cars, and other equipment, covering about 6,500 miles of streets.

This role sits in the Operations Management Division (OMD) and supports the DSNY Operations Management project portfolio. You will handle complex data engineering, integration, and analytics work across a multi-platform enterprise environment, supporting reporting, analytics, and operational projects.

The posting also lists job code 95714 under the title IT Infrastructure Engineer.

Responsibilities

• Build and maintain conceptual, logical, and physical data models that meet current and future operational, analytical, and reporting needs.
• Profile and analyze legacy and newer source systems, find inconsistencies, flag data quality problems, and recommend fixes that improve integrity and governance.
• Run data analysis, profiling, modeling, source-to-target mapping, and reporting for enterprise data and analytics projects.
• Design, build, and support data integration pipelines with business teams, technical staff, and external partners, using tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), or similar.
• Write and upkeep SQL solutions, including complex queries, stored procedures, database objects, and transformation logic.
• Create and maintain documentation: data models, dictionaries, source-to-target mappings, ETL specifications, process flows, and reports.
• Build reports, dashboards, and analytical tools on platforms such as Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, and other enterprise reporting tools.
• Help design data architecture and integration approaches that improve data sharing across DSNY business areas and with other City agencies.
• Keep internal IT systems, applications, and databases reliable, fast, and aligned with agency standards.

Requirements

• Strong SQL and Python skills.
• Experience with data modeling, data analysis, ETL development, and database design.
• Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar.
• Knowledge of modern data platforms and cloud analytics environments.
• Either a bachelor's degree from an accredited college in computer science, engineering, or a related field plus four years of full-time experience in datacenter engineering and operations, cloud engineering and operations, or complex IT infrastructure engineering, or a bachelor's degree from an accredited college plus eight years of that same full-time experience.
• Equivalent education or experience to either option above is accepted.
• Preferred: pySpark experience.
• Highly desirable: Databricks experience.
• Preferred: experience with Microsoft.NET technologies, including ASP.NET, C, TypeScript, React, or another modern web application framework.
• Preferred: Java development experience and related technologies.
• Preferred: familiarity with data warehousing, data governance, cloud platforms, and enterprise data integration best practices.
• Strong analytical and problem-solving skills and clear communication, with the ability to work well with others.

Conditions

You work under general supervision, with considerable room for independent judgment and initiative.

The company is an equal opportunity employer that bars discrimination and harassment based on any legally protected status.