Lead Data Engineer

GFT Poland is a Google Cloud Partner of the Year known for deep tech IT engineering and consulting, employing 1200 skilled experts, with 77% of the team being regular or senior level. The company focuses on delivering innovative solutions and invests in employee growth, working on products contributing to a sustainable world.

• Minimum 10 years experience in software design, data engineering, and development in Agile and DevOps environments
• Strong development and solution design experience with PySpark or Scala
• Hands-on experience with Google Cloud Platform and building data pipelines in GCP
• Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce, and ETL frameworks
• Proficiency in Python, SQL, PL/SQL, and data integration
• Experience with Apache Airflow or similar scheduling tools
• Experience with REST API and RESTful services
• Strong knowledge of Unix and Linux environments
• Experience with Git, GitHub, Jenkins, Ansible, and Jira
• Experience with automated testing, deployment, and monitoring
• Understanding of cloud architecture and cloud design patterns
• Ability to lead an engineering pod and guide other engineers
• Ability to work autonomously as a technical subject-matter expert
• Strong communication and presentation skills for technical, senior, and non-technical audiences
• Strong written and spoken English

Nice to have:

• Experience with Elasticsearch
• Experience developing Java APIs
• Experience with data ingestion solutions
• Experience working with Scrum and Kanban
• Interest in AI-based tools that accelerate engineering workflows

• Provide technical leadership for data migration projects, including solution design, approach, and estimation
• Design and develop scalable data pipelines using Google Cloud Platform, PySpark, and Scala
• Provide guidance on environment setup, system architecture, and cloud design patterns
• Implement solutions focused on performance, scalability, availability, accuracy, and monitoring
• Promote coding standards, conduct code reviews, and support knowledge sharing
• Mentor engineers and oversee the technical delivery of the engineering pod
• Work with Business Analysts to ensure requirements are correctly interpreted and implemented
• Support production environments, troubleshoot issues, and communicate findings to development teams
• Participate in planning sessions, status meetings, sprint reviews, and retrospectives
• Identify opportunities to use AI enablers to improve traditional engineering workflows

Openness to work hybrid from the client's office in Kraków 8 days a month.