The company needs an ETL Developer for one of its major projects in McLean, VA, which requires a TS/SCI with Polygraph clearance applicable to this customer.
The role builds, runs, and improves data pipelines that move reliable data into a PostgreSQL database for a geospatial visualization platform.
The work centres on large, complex datasets, including geospatial data, and on the ETL and data integration that feeds them.
Responsibilities
Design, build, and manage ETL workflows in Apache NiFi that feed a geospatial visualization platform.
Learn the existing NiFi system and its related AWS and PostgreSQL infrastructure well enough to spot and fix live issues.
Get up to speed on current NiFi flows and work through them with little help from others.
Build new NiFi flows that follow the practices already used in the existing flows.
Apply feedback to NiFi flows and make the changes that are requested.
Take direction and report progress through a ticketing system.
Work with analysts by email, chat, and in-person meetings to understand future data flow needs and turn general requirements into concrete tasks.
Develop in a local containerized environment and manage code with Git and NiFi Registry.
Build geospatial database tables with sound design, indexing, and unique constraints.
Use analyst feedback on data details to support application data layers.
Programmatically manipulate and transform data from several sources.
Query and analyze large datasets with SQL.
Pull and process data from external systems through APIs.
Help keep data quality, integrity, and performance in good shape.
Write Python for data science work or ETL prototypes, and tell experimental prototypes apart from enterprise-grade software requirements.
Requirements
Active TS/SCI with Polygraph Clearance.
A bachelor's degree in computer science, systems engineering, geography, or a related technical field, or equivalent experience.
8 years of experience with a bachelor's degree, 7 years with a master's degree, or 6 years with a doctorate.
Experience building NiFi flows using established best practices.
A solid grasp of ETL concepts and best practices.
Strong experience working with databases for data management.
Proficiency in SQL for querying large datasets.
Experience integrating with APIs and retrieving data through them.
Demonstrated experience manipulating data programmatically.
Ability to quickly become proficient in containerized development.
Ability to quickly become proficient in AWS architecture.
Ability to quickly learn NiFi Registry and Git for code management.
Nice to have: creativity to try new ideas and recommend coding improvements to best practice.
Nice to have: drive to adopt and recommend AI in development work.
Nice to have: ability to design and build custom NiFi processors in Java.
Nice to have: experience with AWS cloud services for data ingestion and processing.
Nice to have: strong experience with PostgreSQL for data management.
Nice to have: hands-on experience with Apache Airflow.
Nice to have: hands-on experience with Apache NiFi.
Nice to have: hands-on experience with NiFi Registry and Git.
Nice to have: hands-on experience with Git, including repository actions and pull requests.
Nice to have: hands-on Python for data manipulation and API interfacing.
Nice to have: experience with geospatial data and related tools.
Nice to have: understanding of basic data science concepts and tools.
Conditions
Based in McLean, VA.
Virginia pay range: $150,000 to $250,000 USD.
Pay depends on factors such as location, federal contract labor category, wage rates, prior experience, skills, education, and certifications.
The company aims for a healthy work-life balance.
Benefits
Robust health plan with medical, dental, and vision coverage.
Health Savings Account with a company contribution.
Annual paid time off and paid holidays.
Paid parental leave.
401k with a generous company match.
Financial wellness, retirement planning, family assistance, and continued education support.