Senior Staff Platform Engineer - Federal

Description

The company's Data Platform group builds high-performance platform capabilities for data in motion and backend storage. Its customers run at very large scale, pushing limits on data volume, throughput and concurrency.

The team is hiring an IC5 Senior Staff Engineer with deep distributed systems and Data Lake architecture skills to drive the next generation of the platform.

The role includes supporting the company's US Regulated Markets.

Responsibilities

• Design and build high-performance distributed systems and platform components.
• Create scalable, high-quality data ingestion solutions that run reliably.
• Write clean, modular, reusable code and enforce practices such as code reviews, unit tests, automation and design reviews.
• Develop foundational libraries, frameworks and tools that are modular, extensible, configurable and easy to maintain.
• Work with other engineering teams to clarify requirements and deliver end-to-end solutions.
• Lead technical work on projects with high complexity and risk.
• Assess and adopt new technologies that strengthen the platform.
• Diagnose and resolve complex production problems in distributed systems.

Requirements

• You have experience using AI in engineering work, such as AI coding and operations tools, workflow automation, or thinking through how AI changes the way software and infrastructure get built.
• You have 12+ years of hands-on engineering in distributed systems, data platforms or large-scale backend infrastructure with a Bachelor's degree; or 8+ years with a Master's degree; or 6+ years with a PhD or equivalent work experience.
• You understand distributed systems architecture, design patterns and algorithms well.
• You have deep Java skills, including JVM internals, memory models and garbage collection.
• You have proven experience tuning JVM performance and profiling to find bottlenecks.
• You have deep Helm skills, including authoring charts, templating and managing overlay layering across environments.
• You understand concurrency, networking, sockets, OS internals and performance optimization well.
• You have built and operated large-scale distributed systems.
• You have worked with relational databases such as Oracle, MySQL or PostgreSQL.
• You know security systems, methods and protocols.
• You have run large-scale deployments of distributed systems.
• You know replication, fault-tolerance and high-availability strategies in depth.
• You have worked in DevOps environments to run distributed platforms in production.
• You have experience with GitOps and release engineering for Kubernetes-native distributed services.
• You have strong experience designing platforms with Kubernetes, including workload deployments, upgrades, monitoring and maintenance.
• You have strong experience with Apache Iceberg, including tables, catalogs, data encryption, schema evolution and metadata management.
• You have strong experience with Apache Kafka, including high-scale clusters, topic and partition strategies and high availability.
• You have strong experience with Apache Flink, including stateful stream processing and exactly-once semantics.
• You have strong experience with Apache Spark, including batch and streaming jobs, optimization and partitioning.
• You know data formats such as Parquet, ORC and Avro, plus compaction and governance strategies.
• You can build scalable, fault-tolerant ingestion and transformation workflows.
• You have integrated Data Lakes with analytics engines, query services or ML platforms.

Conditions

This is a flexible hybrid role requiring 2 days per week in a company office. Offices include San Francisco, CA; Pleasanton, CA; Santa Clara, CA; and San Diego, CA.

For positions in this location, base pay is $181,200 to $317,100, plus equity where applicable, variable or incentive pay and benefits. Base pay is a guideline, and individual total compensation varies with qualifications, skill level, competencies and work location. Compensation is subject to change based on work location.

Sales positions generally offer a competitive On Target Earnings (OTE) incentive structure.

Work personas (flexible, remote or required in office) are assigned based on the nature of the work and the employee's work location. The company may use a third-party service to confirm the distance between your primary residence and the nearest company office.

Benefits

• Health plans, including flexible spending accounts.
• 401(k) plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.