Senior Data Engineer (Python | Databricks | Cloud)

1dea is a consulting recruitment company providing IT talent acquisition services for its clients. It has been operating in the Polish market for over 8 years and is gradually expanding its services to Western European markets.

• Commercial experience in data engineering and practical knowledge of Databricks
• Strong programming skills in Python for data automation and transformation
• Experience with at least one major cloud platform (AWS, Azure, or GCP)
• Very good English communication skills
• 7 years of experience in a similar role

Nice to have:

• Good knowledge of SQL (data modeling and query optimization)
• Experience with PySpark for distributed data processing
• Knowledge of DevOps (CI/CD pipelines, Infrastructure as Code such as Terraform, Bicep)
• Experience with real-time data streaming (e.g., Kafka, Spark Streaming)
• Familiarity with storage solutions (Data Lake, Snowflake, or Synapse)
• Certifications such as Databricks Certified Data Engineer Associate or cloud certifications

• Design solutions in Databricks for processing large data sets
• Develop and optimize data pipelines using Python and cloud tools
• Collaborate with architects to define and implement best practices
• Maintain infrastructure ensuring data consistency, security, and scalability