Tech Lead Data Engineer

GFT Poland is a company specialized in IT engineering and consulting, employing over 1200 skilled experts with a strong focus on sustainable products and deep tech projects. The team for this role builds a cloud-based strategic data platform supporting risk management processes within investment banking, focusing on data integration, process automation, digital transformation, and modernization of large-scale financial services platforms.

• 10+ years of professional software engineering experience
• Recent hands-on experience with Python and PySpark over the last 2-3 years
• Experience with Java or C#
• Strong experience with Unix platforms including file operations, permissions, environments, and data analysis
• Hands-on experience designing and developing ETL and data solutions using Python
• Experience with data ingestion, transformation, cleansing, loading, and reporting
• Experience with Shell scripting
• Experience with Autosys
• Experience working with Oracle databases
• Ability to gather business requirements and convert into implementable technical tasks
• Experience with CI/CD pipelines and GitLab
• Good understanding of software development lifecycle within Agile environments
• Strong knowledge of Azure platform
• Experience with ADLS and Azure Key Vault
• Experience with Databricks

Nice to have:

• Experience with AI-powered development tools such as GitHub Copilot
• Experience creating automation agents and AI-based productivity solutions

• Design and develop ETL and data processing solutions using Python and PySpark
• Build and maintain cloud-based data platforms and pipelines
• Analyze business requirements and translate them into technical solutions and implementation plans
• Develop data ingestion, cleansing, transformation, loading, and reporting processes
• Work with Azure services including ADLS, Azure Key Vault, and Databricks
• Create and maintain CI/CD pipelines using GitLab
• Develop and maintain Shell scripts and scheduling solutions
• Collaborate with stakeholders in an Agile delivery environment
• Support data analysis and troubleshooting on Unix platforms
• Ensure high quality, scalability, and reliability of data solutions