Senior Data Engineer (Databricks)

Grape Up is a consulting & technology company that helps enterprises create important applications by leveraging AI & cloud-native technologies. They partner with industry leaders in automotive, aviation, and manufacturing to build sophisticated Data & Analytics platforms providing data storage, management, advanced analytics, machine learning, and AI capabilities.

• Master’s degree in computer science, Data Engineering, AI, or related field
• 5+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines
• Proven experience with the Databricks platform (Azure Databricks or Databricks on AWS), including Unity Catalog and Delta Lake / Lakehouse architecture
• Strong experience with Apache Spark (PySpark), including performance optimization and large-scale data processing
• Proficiency in Python and SQL for data transformations and analytics workloads
• Experience with data pipeline orchestration
• Experience with data governance and quality frameworks
• Strong problem-solving skills and ability to work independently
• Fluency in English and Polish, both written and spoken

Nice to have:

• Data Engineer (Databricks) certificate
• Experience processing high-volume Automotive or IoT data (e.g., telemetry, sensor, event-based data)
• Experience with streaming tools like Kafka, Azure Event Hubs, or similar
• Experience with Infrastructure as Code tools such as Terraform and CloudFormation

• Design and implement a scalable architecture capable of handling high volumes of sensor, telemetry, and simulation data
• Build flexible, extensible data preprocessing pipelines integrated into customer platforms
• Develop and implement best practices for data management and governance
• Optimize system setup and improve data structures following industry best practices
• Collaborate with data engineering team members and partner with analytics and data science teams
• Work with business stakeholders and technical teams to understand data requirements and translate business needs into technical solutions

Information clause for job candidates describing data processing, legal basis, rights, and consent related to personal data during recruitment processes by Grape Up and its capital group companies. Includes details on automated decision-making using Traffit system and rights of candidates under GDPR. Data processing is conducted in compliance with applicable regulations.