Data Engineer (Databricks) | Enterprise Energy Data Platform

Polcode is a global technology partner with almost 100 professionals, working on digital businesses, software platforms, eCommerce, websites, and apps. This role is part of a long-term project in the energy sector focusing on developing and continuously improving a modern data platform with emphasis on data quality, scalable processes, and reliable reporting data.

• Several years of commercial Data Engineering experience
• Hands-on commercial experience with Databricks
• Solid Python and SQL skills
• Experience with data modelling and ETL/ELT processes
• Experience building and orchestrating data pipelines
• Strong understanding of Data Lake and modern data platform concepts
• Understanding of layered data models such as Medallion Architecture (Bronze / Silver / Gold)
• Experience with permissions and access concepts
• Knowledge of continuous ingestion and continuous development practices
• Understanding of deployment processes and data quality practices
• Solution-oriented and structured approach to engineering challenges
• Strong communication skills and ability to work independently with stakeholders
• Experience working in agile projects, particularly Scrum
• Understanding of IT Service Management processes such as ITIL
• English proficiency to work effectively in an international environment

Nice to have:

• Experience with Microsoft Azure in a Databricks / Data Engineering environment
• Experience with Spark or PySpark
• Experience with streaming, CDC, Auto Loader, Structured Streaming, or similar continuous ingestion approaches
• Experience with Machine Learning or LLM solutions in Databricks
• Experience with Jira and Confluence
• Good German language skills

• Design and develop scalable data solutions in Databricks
• Integrate data into an enterprise Data Lake using a Medallion Architecture
• Build and maintain data models supporting reporting
• Develop and orchestrate ETL/ELT processes and data pipelines
• Work with Python and SQL on data transformation and processing
• Support continuous data ingestion and development processes
• Contribute to permissions and access concepts
• Work within multi-tier deployment environments and Quality Gates
• Optimize data processes for better performance, efficiency, and quality
• Document architectural decisions, processes, and project outcomes
• Collaborate with stakeholders in an agile environment

Remote-first (within Poland) or work from the office in Warszawa