Senior Data Engineer – Hadoop & Spark Leadership

This position is for a leading financial institution based in Krakow, focusing on complex data engineering projects that leverage big data technologies for strategic insights.

• At least 5 years of experience in enterprise data engineering with focus on Hadoop, Spark, and Splunk.
• Strong proficiency in data modelling and building efficient ETL/ELT pipelines using Python.
• Experience handling structured, semi-structured, and unstructured data with SQL and NoSQL.
• Familiarity with CI/CD pipelines and source control management.
• Proven technical leadership and mentoring skills.
• Excellent stakeholder management and communication skills.
• Strong understanding of risk management and governance principles in data projects.

Nice to have:

• Experience with agile methodologies such as Scrum or Kanban.
• Knowledge of industry groups and external vendor collaborations.

• Lead the design and delivery of scalable data engineering solutions leveraging Hadoop, Spark, and Splunk.
• Build and optimise ETL/ELT data pipelines in Python, ensuring robust data ingestion, transformation, and integration.
• Handle raw, structured, semi-structured, and unstructured data (using SQL and NoSQL) within diverse environments.
• Manage the full data lifecycle, including implementing source control and CI/CD pipelines.
• Collaborate closely with BI and Analytics teams in fast-paced, dynamic settings.
• Provide technical leadership and mentoring to junior engineers.
• Ensure high data quality through unit and integration testing supporting continuous integration.
• Maintain service resilience, sustainability, and adherence to governance, emphasizing risk management and compliance.

Only candidates with an existing legal right to work in the European Union will be considered for this role.