Senior Data Engineer (Python, GCP, Airflow)

GFT Poland is hiring for a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing robust data pipelines and data models to support business decision-making.

• Strong proficiency in Python for backend or data processing
• Hands-on experience with Google Cloud Platform including BigQuery, Cloud Storage, Compute Engine or GKE
• Experience with Apache Airflow for workflow orchestration
• Strong experience with ETL and data integration pipelines
• Experience with Spark
• Knowledge of NoSQL databases
• Strong knowledge of relational databases
• Strong understanding of data architecture
• Good understanding of data quality
• Strong understanding of data integration

Nice to have:

• Familiarity with Apache Beam

• Design, develop, and maintain scalable data pipelines and ETL processes
• Build and manage Apache Airflow DAGs for workflow orchestration
• Develop data processing logic using Python and frameworks like DBT or Spark
• Work with BigQuery and Cloud SQL to store and transform data
• Implement and maintain data architecture and data models
• Ensure data quality, integrity, and reliability
• Collaborate with business stakeholders to translate requirements into data solutions
• Maintain technical documentation and contribute to data standards
• Support deployment and monitoring of pipelines in GCP environments
• Participate in code reviews and improve engineering best practices