Build high-scale crawlers and parsers and deliver custom datasets for clients as part of the Web Intelligence team. The role uses Python or Go and AI-driven development tools.
Multiple years of backend development experience with Python or Go, or strong web scraping expertise driven by AI tools.
Familiarity with web scraping fundamentals, parsing, headless browsers, and databases such as PostgreSQL or BigQuery.
Ability to align on an approach in discussion and independently own delivery.
Business-first approach prioritizing speed and delivery over perfection, and comfort with direct feedback.
Hands-on experience and strong comfort with AI-driven development tools such as Cursor, Claude Code, or Antigravity.
Nice to have:
Experience in data engineering, including ETL/ELT pipelines, Spark, Airflow, or Dagster.
Design and build high-scale crawlers, scrapers, and surrounding infrastructure for thousands to millions of requests.
Own client projects end-to-end, turning requirements into custom solutions built from scratch.
Write functional, reusable code in Python or Go, leveraging AI-driven IDEs.
Work within the data platform to support building and delivering large datasets.
Use internal scraping tools or build new ones as priorities and client routes change.
Justify technical decisions, perform code reviews, and collaborate with the team on quality solutions.
