Lead Data Consultant

GFT Poland is a Google Cloud Partner of the Year known for deep tech IT engineering and consulting with a team of 1200 skilled experts. The company focuses on delivering innovative, sustainable products and supports employee growth with ambitious projects, trainings, and tools.

• At least 10 years of experience in software design, data engineering, and development in Agile and DevOps environments
• Strong development and solution design experience with PySpark or Scala
• Hands-on experience with Google Cloud Platform and building data pipelines in GCP
• Experience with Apache Spark, Spark SQL, Hadoop, YARN, Hive, MapReduce, and ETL frameworks
• Experience with Python, SQL, PL/SQL, and data integration
• Experience with Apache Airflow or similar scheduling tools
• Experience with REST APIs and RESTful services
• Strong knowledge of Unix and Linux environments
• Experience with Git, GitHub, Jenkins, Ansible, and Jira
• Experience with automated testing, deployment, and monitoring
• Understanding of cloud architecture and cloud design patterns
• Ability to lead an engineering pod and guide other engineers
• Ability to work autonomously as a technical subject-matter expert
• Strong communication and presentation skills for technical, senior, and non-technical audiences
• Strong written and spoken English

Nice to have:

• Experience with Elasticsearch
• Experience developing Java APIs
• Experience with data ingestion solutions
• Experience working with Scrum and Kanban
• Interest in AI-based tools that can accelerate engineering workflows

• Provide technical leadership for data migration projects including solution design, approach, and estimation
• Design and develop scalable data pipelines using Google Cloud Platform, PySpark, and Scala
• Provide guidance on environment setup, system architecture, and cloud design patterns
• Implement solutions focused on performance, scalability, availability, accuracy, and monitoring
• Promote coding standards, conduct code reviews, and support knowledge sharing
• Mentor engineers and oversee the technical delivery of the engineering pod
• Work with Business Analysts to ensure requirements are correctly interpreted and implemented
• Support production environments, troubleshoot issues, and communicate findings to development teams
• Participate in planning sessions, status meetings, sprint reviews, and retrospectives
• Identify opportunities to use AI enablers to improve traditional engineering workflows

Openness to work hybrid from client's office in Kraków 8 days a month