Back to search
About the Role
This role sits at the core of a high-growth AI data infrastructure platform, owning the systems that keep web extraction fast and reliable against websites actively fighting back. You'll work on adversarial web-extraction infrastructure — anti-bot evasion, proxy rotation, browser/TLS fingerprinting, and CAPTCHA handling — so that the platform "just works" where others fail. You'll own real production systems from day one, not a backlog of tickets.
What You'll Do
Architect and manage proxy rotation, IP/session management, and egress-node isolation at scale.
Beat anti-bot and anti-scraping defenses, maintaining high success rates against sites that actively resist automated access.
Build and maintain browser/TLS fingerprint management and CAPTCHA/challenge-solving infrastructure.
Own the health, cost efficiency, and economics of the proxy layer end-to-end.
Debug hard, intermittent adversarial failures across the stack and make them stay fixed.
What We're Looking For
0–3 years of backend infrastructure or distributed systems experience, with demonstrated hands-on work in adversarial web-extraction as a dealbreaker requirement.
Production experience architecting proxy rotation, IP/session management, and egress-node isolation.
Hands-on experience bypassing aggressive anti-bot and anti-scraping defenses at scale.
Strong proficiency in Go and/or Python; TypeScript/Node.js a plus.
Solid networking fundamentals: TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
Experience with Kubernetes, Docker, AWS, and Terraform for service deployment and scaling.
Familiarity with PostgreSQL, Redis, and Kafka in production environments.
Observability experience using Prometheus and Grafana; comfortable with on-call ownership.
Relentless about reliability and at home in messy, adversarial problem spaces.
Authorized to work in the United States without visa sponsorship.
Compensation & Benefits
Salary range: $200,000 – $250,000 USD annually. Visa sponsorship is not available.
Location
Hybrid role based in the San Francisco Bay Area, CA. Candidates in other U.S. locations open to relocating to the SF Bay Area are welcome to apply.
Learn more about this Employer on their Career Site
