Data Engineer (Praca hybrydowa - Kraków)

IT Talento is part of the HICRON Group, an organization supporting companies in technology projects, digital transformations, and SAP and IT solutions development. The group collaborates with around 1000 experts and consultants on projects in Poland and abroad, including SAP implementations, migrations to SAP S/4HANA, dedicated application and system development, integration projects, IT environment modernization, and business automation and transformation initiatives. They work with organizations from various market sectors such as production, automotive, energy, chemistry, and FMCG, providing specialists with experience in diverse technological, business, and project environments.

• Minimum 6 years of overall IT experience
• Minimum 4–5 years of practical experience with PySpark and Python
• Very good knowledge of PySpark (DataFrames, Spark SQL, performance tuning), Python, and SQL
• Experience with Azure Data Factory (ADF)
• Knowledge of Data Engineering architecture and design principles
• Experience with large distributed data processing environments
• Knowledge of data and pipeline performance optimization methods
• Strong analytical and troubleshooting skills
• Knowledge of data modeling
• English language proficiency at minimum B2 level

• Designing, developing, and maintaining scalable data pipelines using PySpark and Python
• Creating and optimizing ETL/ELT processes for high-volume data processing environments
• Processing structured and unstructured data from multiple sources
• Building efficient and scalable solutions following Data Engineering best practices
• Optimizing data processing performance (partitioning, caching, join optimization)
• Creating and managing workflows in Azure Data Factory
• Collaborating with Data Scientists, Architects, Business Analysts, and other stakeholders
• Maintaining data quality, consistency, and reliability
• Troubleshooting performance issues in distributed processing environments
• Contributing to the development of enterprise data architecture

Work model: Hybrid (Kraków) Contract: B2B Long-term project