Backend Infrastructure Engineer

Description

About the Role

Join the infrastructure team at a growing AI-focused web data extraction company. You will build and operate the systems that help high-volume extraction remain reliable against websites that actively resist automated access.

Responsibilities

• Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.
• Improve extraction success against anti-bot and anti-scraping defenses.
• Build and maintain browser and TLS fingerprinting, CAPTCHA, and challenge-handling infrastructure.
• Monitor the reliability and cost efficiency of the proxy layer.
• Investigate intermittent failures across the stack, resolve root causes, and maintain production systems.

Requirements

• More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in web extraction against active defenses.
• Production experience designing proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
• Experience bypassing major anti-bot systems in production and owning associated success-rate metrics.
• Hands-on experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.
• Proficiency in Go and/or Python, plus networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
• Experience owning end-to-end production systems, including on-call responsibilities and observability tools such as Prometheus and Grafana.
• Comfort working in complex, adversarial problem spaces and shipping, measuring, and iterating quickly.

Conditions

Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.

Hybrid in San Francisco, California.