Data Engineer

Our Client dominates the Polish e-commerce arena as the market leader since 1999 with a user base of over 20 million. The client has a talented IT team of over 1,000 employees focusing on developing their own cutting-edge technologies. Jit Team has partnered with the client since spring 2021, with multiple autonomous software development teams designing platform components through micro-services. The project involves delivering software at a massive scale with state-of-the-art technologies and tools.

• Minimum 3 years of commercial experience as a Data Engineer working with large-scale data environments
• Strong expertise in SQL and deep understanding of data modeling and Cloud Data Warehouse architecture
• Hands-on experience with ETL/ELT process design, implementation, and maintenance
• Practical experience with public cloud platforms, especially GCP (BigQuery, Dataflow)
• Strong programming skills in Python for Big Data processing, including PySpark and Airflow
• Knowledge of Scala or Java is a plus
• Experience with software engineering best practices: Clean Code, testing, Code Review, and CI/CD
• Good working knowledge of Unix/Linux environments
• High level of autonomy, ownership, and responsibility for delivered solutions
• Understanding of MLOps concepts and machine learning model lifecycle
• Experience preparing data structures for AI/ML model training and production environments

• Design, develop, and maintain scalable ETL/ELT data pipelines
• Build and optimize cloud-based data warehouse architectures and data models
• Process and manage large-scale datasets in Big Data environments
• Develop and maintain solutions using GCP services, especially BigQuery and Dataflow
• Optimize performance and cost efficiency of data processing solutions
• Create and maintain data workflows using Python, PySpark, and Airflow
• Collaborate with cross-functional teams to deliver end-to-end data solutions
• Support AI/ML initiatives by preparing and managing data structures for model training and production deployment
• Ensure software engineering best practices, including Clean Code, testing, code reviews, and CI/CD
• Monitor and maintain data platform reliability, scalability, and performance