Data Engineer

Our Client dominates the Polish e-commerce arena as the market leader since 1999 with over 20 million users. The Client has a talented IT team of over 1,000 employees focused on developing their own technologies. Jit Team has partnered with the Client since spring 2021, providing multiple autonomous software development teams working with micro-services. The project involves delivering software at massive scale with high performance requirements.

• Minimum 3 years of commercial experience as a Data Engineer working with large-scale data environments
• Strong expertise in SQL and deep understanding of data modeling and Cloud Data Warehouse architecture
• Hands-on experience with ETL/ELT process design, implementation, and maintenance
• Practical experience with public cloud platforms, especially GCP (BigQuery, Dataflow)
• Strong programming skills in Python for Big Data processing, including PySpark and Airflow
• Knowledge of Scala or Java is a plus
• Experience with software engineering best practices: Clean Code, testing, code review, and CI/CD
• Good working knowledge of Unix/Linux environments
• High level of autonomy, ownership, and responsibility for delivered solutions
• Understanding of MLOps concepts and machine learning model lifecycle
• Experience preparing data structures for AI/ML model training and production environments

• Design, develop, and maintain scalable ETL/ELT data pipelines
• Build and optimize cloud-based data warehouse architectures and data models
• Process and manage large-scale datasets in Big Data environments
• Develop and maintain solutions using GCP services, especially BigQuery and Dataflow
• Optimize performance and cost efficiency of data processing solutions
• Create and maintain data workflows using Python, PySpark, and Airflow
• Collaborate with cross-functional teams to deliver end-to-end data solutions
• Support AI/ML initiatives by preparing and managing data structures for model training and production deployment
• Ensure software engineering best practices, including Clean Code, testing, code reviews, and CI/CD
• Monitor and maintain data platform reliability, scalability, and performance