Mid Data Platform Engineer

QED is a tech company focused on public health and food security in Sub-Saharan Africa. They build digital infrastructure and AI for aid and scientific inquiry, including surveillance of HIV, malaria, TB, and nutrient analysis of crops and soils at national scale. Funders include the Global Fund, Gates Foundation, and CDC.

• Experience with designing and maintaining data pipelines using ETL and/or ELT
• Understanding of data pipeline reliability (idempotency, backfills, late/corrected data handling)
• Ability to structure data systems into layers with different purposes and guarantees
• Experience deciding between batch, micro-batch, and streaming data approaches
• Strong software engineering skills including version control, readable code, tests, and robust design
• Ability to design logical software architectures and communicate effectively
• Willingness to work on diverse problems and technologies
• Willingness to attend design sessions, code reviews, and collaborate in teams
• Experience developing on UNIX-based or OSX-Darwin platforms
• Working proficiency in English (≥C1) in speaking, reading, and typing
• Emotional resilience and social intelligence

Nice to have:

• Understanding analytical data modeling including analytics-ready datasets and data semantics
• Experience with Python, Django, DBT, Dagster, Luigi, or Clickhouse
• Experience with containerization (Docker), Terraform, Kubernetes, or Nix
• Knowledge of data warehousing, OLAP, metadata management, dimensional modeling, and relational database theory
• Experience in programming and/or math competitions
• Product-oriented mindset
• Domain knowledge or interest in sustainable development goals, public health, agriculture, and developing countries
• Willingness to go on an adventure

• Design and maintain data pipelines using ETL and ELT approaches
• Reason about data pipeline reliability concepts such as idempotency, backfills, and late/corrected data
• Structure data systems into clear layers (raw, cleaned, curated) with appropriate guarantees
• Choose between batch, micro-batch, and streaming approaches based on latency, correctness, and complexity
• Participate in regular design sessions, code reviews, and teamwork
• Develop software with version control, readable code, tests, and robust design
• Work on UNIX-based or OSX-Darwin platforms

Requires full-time physical presence in Warsaw, Poland with a hybrid work model expecting at least 2-3 days per week in the office. Working hours are flexible. Candidates must agree to personal data processing for recruitment purposes according to the legal notice.