Data Engineer GCP

The position is for a Senior Data Engineer (GCP) working on a strategic transformation program "data-driven bank" for a banking sector client. The project involves building a data lakehouse platform on Google Cloud Platform (GCP), integrating reporting, analytics, and data management in a hub & spoke model.

• Minimum 5 years of experience in Data Engineering with at least 2 years practical experience with Google Cloud Platform.
• Knowledge of data lakehouse architecture including medallion architecture and technologies like Delta Lake or Apache Iceberg.
• Proficient in Python and PySpark at a production level.
• Practical experience working with BigQuery.
• Strong practical knowledge of Apache Airflow for building and maintaining data pipelines.
• Ability to work with large data volumes and optimize processing performance.
• Experience building CI/CD processes, especially using GitHub Actions.
• Practical knowledge of Infrastructure as Code and Terraform.
• Communicative English language skills.
• Higher education in a technical discipline.

Nice to have:

• Experience designing access models and security using IAM.
• Experience in banking or financial sector projects.
• Knowledge of FinOps and cloud cost optimization.
• Familiarity with Dataplex, data cataloging, metadata, and data lineage.
• Experience in Data Governance.

• Develop and maintain data lakehouse platform layers (Gold and Platinum) on BigQuery.
• Build and maintain data pipelines using Apache Airflow.
• Design and implement CI/CD processes using GitHub Actions.
• Build and maintain infrastructure as code with Terraform.
• Optimize query performance and data processing costs in BigQuery.
• Develop data governance standards including solutions related to Dataplex and data lineage.
• Implement data security models based on IAM.