You and the process

With a person
Anna, in-house recruiter
9 years hiring engineers
30 minutes with a real recruiter
They read your CV with you, on a call, and say where the offers are being lost.
Didn’t find what you were looking for? Tell us what to build
Capital One

Data Engineer 4 (Python, Pyspark, AWS)

  • Office
  • 3-6 years

Salary

$197,300 - 225,100/ year

AI summary

For members

The whole posting in a few lines. Sign up to read it here and on every role you open.

Sign Up to Read

Description

The company builds technology and data solutions that solve complex business problems, and the team works in a fast-moving, collaborative, iterative setting.

The role focuses on data engineering and is part of a major transformation across the company, with a focus on connecting data with emerging technologies.

Responsibilities

  • Work with Agile teams to design, build, test, release and support technical solutions across full-stack tools.
  • Guide developers, data analysts and data scientists who have deep experience in machine learning, distributed microservices, lakehouse architecture and full-stack systems.
  • Use Python and Spark, open-source relational and NoSQL databases, and cloud data warehouses such as Databricks and Snowflake.
  • Keep up with data trends, test and learn new technologies, take part in internal and external technology communities, and mentor other data team members.
  • Work with product managers and software engineers to deliver reliable cloud-first data solutions that help millions of Americans improve their financial situation.
  • Design, build and deliver high-quality cloud data solutions and applications on your own, with little or no day-to-day supervision.
  • Set and apply common data engineering design patterns that keep code high quality, easy to maintain and reusable across platforms and pipelines.
  • Represent the data engineering team, explaining technical concepts and data results clearly to internal and external stakeholders.
  • Design and build data pipelines and platforms that scale, recover from failure and run efficiently as data volume and business demands grow.
  • Put data security standards in place, including encryption at rest and in transit and fine-grained access control, in line with data privacy rules.

Requirements

  • Bachelor's degree or higher in Computer Science or a related quantitative field such as Statistics, Economics, Operations Research, Analytics, Mathematics or Engineering.
  • At least 4 years of application development experience. Internship experience does not count.
  • At least 2 years of distributed data experience.
  • At least 2 years of SQL experience.
  • At least 2 years of experience with one of Python, Java or Scala.
  • At least 2 years of experience designing and developing data pipelines.
  • At least 1 year of experience in data modeling and designing end-to-end data solutions across relational and non-relational databases.
  • Preferred: 7+ years of application development experience with proven skill in Python, SQL, Scala or Java.
  • Preferred: 4+ years of hands-on experience designing, deploying and operating data workloads in at least one public cloud (AWS, Microsoft Azure or Google Cloud).
  • Preferred: 4+ years of building or supporting distributed data or compute workloads with tools such as EMR, Spark, Glue or Databricks.
  • Preferred: 4+ years of designing, implementing and operating real-time or streaming data pipelines.
  • Preferred: 2+ years of data observability work (for example Monte Carlo or Splunk) or data orchestration tools (for example Airflow or Dagster).
  • Preferred: 4+ years of working with unstructured or semistructured data in NoSQL databases such as MongoDB, Cassandra or DynamoDB.
  • Preferred: 4+ years of designing and supporting data warehousing solutions such as Snowflake or Redshift.
  • Preferred: 2+ years of working in an Agile development environment.
  • Preferred: 2+ years of developing user-centric reusable data products.

Conditions

The company will not sponsor new applicants for work authorization or provide any immigration-related support for this role, including H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-3, O-1, or any other status that needs employer immigration support.

Full-time annual base salary: McLean, VA $197,300 to $225,100 for Data Engineer 4. Candidates hired in other locations receive the pay range for that location, and the exact offer amount appears in the offer letter. Part-time pay is prorated to agreed hours.

The role may also earn performance-based incentive pay, such as cash bonuses and/or long-term incentives, which can be discretionary or non-discretionary depending on the plan.

Applications will be accepted for at least 5 business days.

No staffing agencies. The company is an equal opportunity employer and does not discriminate, and considers applicants with criminal histories in line with applicable laws.

Benefits

  • Comprehensive health, financial and other benefits. Eligibility depends on full- or part-time status, exempt or non-exempt status, and management level.

Where you’d work

From the office

No visa sponsorship

About the company

Capital One

  • Industry: FinTech

Office in United States

Also hiring in New York, United States, San Jose, United States, San Francisco, United States and 9 more places

18 of their 602 open roles are remote

Your chances

Worth a look before you spend an evening tailoring a CV for it.

  • 21 checks run
  • 4 red flags

Still hiring?

14 checks

3 red flags

How crowded?

7 checks

1 red flag

Fits Me

How well does this role fit you?

Answer a few questions or drop your CV, and every role gets a fit score with the reasons, this one first.

  • Your field
  • Level
  • Stack
  • Work model
  • Salary floor
  • Must-haves
Details12 facts · Role, Location, Compensation, Employment, Company
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • Azure
  • Spark
  • Databricks
  • Snowflake
  • Airflow
Type
Full-time
Industry
FinTech
Specialty
Data Engineering
Region
United States
Pay period
Annual
Show 6 more factsShow less

Role

Category
Data & Analytics
Specialty
Data Engineering
Experience
4+ years
Tech stack
  • Python
  • SQL
  • AWS
  • Google Cloud
  • Azure
  • Spark
  • Databricks
  • Snowflake
  • Airflow

Location

Work model
Office
Region
United States
Office
  • United States
Visa sponsorship
Not sponsored

Compensation

Salary
$197,300 - 225,100 / year
Pay period
Annual

Employment

Type
Full-time

Company

Industry
FinTech

Something wrong with this vacancy?

Similar vacancies

Share this vacancy

What's wrong with it?

The employer never sees who reported.

Reason