Lead Python Data Engineer

• Bachelor's degree in Computer Science or a related IT field, with 7+ years in a comparable position
• Experience with Big Data, Data warehouses and Data lakes
• Demonstrated hands-on experience developing scalable data pipelines that process large volumes of data in both batch and stream modes for near real-time analytics
• Strong skills in Databricks, Python and Spark
• Working knowledge of Delta Lake, DLT and GitLab
• Understanding of Cloud technologies including Azure, Unix/Linux and shell scripting
• Skilled in designing applications that meet non-functional requirements for high throughput and low latency data processing
• Experience creating automated functional tests and CI/CD pipelines using standard industry tools
• Ability to rapidly build prototypes and refine them into robust products using sound engineering practices
• Practical experience applying AI within the engineering SDLC
• English language skills at B2 level or above

Nice to have:

• Skills in database development, including SQL, PL/SQL, PostgreSQL and Azure SQL

• Design, build and maintain data-driven applications, both new and existing
• Deliver end-to-end solutions
• Build reliable data pipelines for sourcing, processing, distributing and storing data
• Create data models capable of supporting growing data volumes
• Participate in all phases of the software development lifecycle
• Offer technical expertise, recommendations and innovative solutions
• Work closely with the product owner and fellow technologists
• Contribute to the engineering culture by sharing knowledge and best practices with colleagues

This role requires 3 days per week on-site at the client's office in Poland.