Senior Software Engineer (Backend & Infrastructure)

Required Experience:

• 5+ years building and operating production backend systems and APIs with strategic technical problem-solving.
• Strong proficiency in Python / Django REST Framework.
• Hands-on experience operating Elasticsearch / OpenSearch at scale including index/mapping design, relevance tuning, cluster management, and migrations.
• Experience building and operating ETL pipelines moving significant data volumes reliably.
• Production experience with PostgreSQL, Redis, and async task systems such as Celery / RabbitMQ or equivalents.
• Core-owner-level comfort with AWS (ECS, S3, CloudWatch), infrastructure-as-code, and CI/CD (e.g., GitHub Actions).
• Experience in production observability, on-call, and incident response.
• Working proficiency with React / TypeScript.
• Strong written communication and documentation skills.

AI & Agentic Workflows (Required):

• Daily use of AI coding tools (e.g., Claude Code, Cursor, Copilot) with validation of generated code before production.
• Experience designing, orchestrating, and debugging multi-step agent workflows.
• Good judgment on appropriate use of AI agents.

Nice to Have:

• Experience with Snowflake or other data warehouses.
• Background in B2B data products including enrichment, contact data, and search/discovery.
• Experience with data privacy and compliance engineering (GDPR/PII, US state privacy regimes).
• Experience building MCP servers.
• Experience with web crawling, data sourcing, or large-scale ingestion systems.
• Open-source contributions or public technical writing.

Backend & API Development:

• Design, build, and operate RESTful APIs including enrichment, search, feeds, and platform workflows.
• Develop scalable backend services such as workers, task queues, waterfall lookups, and data pipelines.
• Build metering, credit-logging, and billing logic for accurate consumption tracking.
• Participate actively in product planning and feature prioritization.

Data Engineering, Search & ETL:

• Own the Elasticsearch/ECK search stack end-to-end (index design, ingestion, relevance tuning, cluster health, scaling, migrations).
• Design and operate ETL applications moving data into searchable stores, bulk feeds, and warehouses including Snowflake and S3.
• Optimize PostgreSQL performance including query performance, indexing, and cache utilization.
• Drive measurable improvements in latency, uptime, error rate, fill rate, and scalability.

DevOps & Infrastructure (Core Owner):

• Own AWS infrastructure including ECS, S3, and infrastructure-as-code.
• Own CI/CD pipelines.
• Manage observability tools such as Grafana, CloudWatch, and Sentry and handle on-call response.
• Drive infrastructure modernization and maintain crawler infrastructure with the team.

Collaboration & Quality:

• Conduct code reviews emphasizing readability, security, and performance.
• Write unit, integration, and E2E tests to ensure test reliability.
• Document features, architecture, and API contracts thoroughly.