Data Engineer - Batch and Streaming Pipelines

Our client is a forward-thinking data-driven organisation based in Warsaw, specialising in building robust data infrastructure and analytics platforms. They design and operate scalable data systems that power critical decision-making. The organisation values technical excellence, collaboration and continuous improvement.

• 8-10 years of experience designing and operating data pipelines.
• Strong proficiency in Python for data engineering tasks.
• Hands-on experience with Apache Spark and distributed data processing frameworks.
• Proven experience with Apache Airflow for workflow orchestration.
• Solid SQL skills and experience with dbt for data transformations.
• Experience building and maintaining data warehouses.
• Understanding of data quality principles and observability practices.
• Ability to collaborate effectively with cross-functional data teams.

Nice to have:

• Experience with Google Cloud Platform or similar cloud data platforms.

• Design and build scalable data pipelines handling both batch and streaming workloads.
• Work with Apache Spark, Apache Beam and Apache Airflow in a hands-on engineering role.
• Collaborate with Analytics and Platform Engineers on data infrastructure projects.
• Develop reliable, well-modelled datasets using SQL and dbt transformations.
• Take ownership of data quality, observability and pipeline performance.
• Orchestrate complex data workflows ensuring reliability and performance.
• Troubleshoot and optimise pipeline performance to meet service level requirements.
• Document data pipelines, transformations and processes for knowledge sharing.