Senior Backend Infrastructure Engineer, Anti-Bot

About the Role

Join the infrastructure team at a B2B web data company, building systems that keep high-volume web extraction reliable when websites actively resist automated access. You will own production infrastructure end to end, with a focus on proxy operations, browser identity, and challenge handling.

What You'll Do

• Architect and operate proxy rotation, IP and session management, and isolated egress nodes at scale.

• Improve extraction reliability against anti-bot and anti-scraping defenses that change over time.

• Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.

• Monitor proxy-layer health and cost efficiency, and improve its operational economics.

• Investigate intermittent production failures, implement durable fixes, and support systems through on-call ownership.

What We're Looking For

• More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, including production-scale work in the last two years.

• Hands-on experience operating proxy systems for third-party web extraction, managing IP and session behavior, and working with browser or TLS fingerprints and CAPTCHA or challenge handling.

• Experience building data-extraction infrastructure that handles adversarial defenses, rather than general backend, platform, or cooperative-networking systems.

• Proficiency with Go and/or Python, plus networking fundamentals such as TCP/IP, HTTP/2, connection pooling, and proxy orchestration.

• Experience owning production systems and on-call responsibilities, with observability tools such as Prometheus and Grafana.

• Familiarity with relevant tools and systems such as headless browsers, JavaScript, Node.js, Redis, PostgreSQL, Kafka, Kubernetes, Docker, AWS, Terraform, and CI/CD.

Compensation & Benefits

Annual salary range: $235,000 to $260,000 USD. Visa sponsorship is available.

Location

Hybrid in San Francisco, California, United States.