Senior GCP Data Engineer – BigQuery & Data Pipeline Development

The position is for a leading financial services organization based in Krakow, focusing on a transformative data integration initiative that supports the global MSS Operations team.

• At least 3 years experience with SQL querying and optimization in BigQuery.
• Proven expertise in SQL Data Transformation and ETL/ELT pipeline development with GCP DataFusion or similar tools.
• Strong experience with Data Vault modeling principles.
• Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
• Proficiency with version control (Git) and CI/CD tools like Jenkins or Ansible.
• Experience in DataOps environment and Agile methodologies.
• Excellent problem-solving, organizational, and multitasking skills.

Nice to have:

• Experience designing data ingestion pipelines with GCP Data Fusion, CDAP or comparable tools handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP.
• Knowledge of Java development for custom Data Fusion plugins.
• Familiarity with continuous testing and deployment tools for cloud data solutions.

• Design, build, test, and deploy GCP data models and transformations in BigQuery including stored procedures, indexes, clusters, partitions, and triggers.
• Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
• Review and implement business and technical requirements ensuring compliance with IT and security standards.
• Monitor data pipelines for failures or performance issues and implement scalable, robust solutions.
• Optimize ETL/ELT processes for large data volumes.
• Integrate data from multiple sources ensuring consistency and accuracy.
• Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform focusing on GCP cloud applications.
• Collaborate in an Agile environment applying DataOps best practices.

Only candidates with an existing legal right to work in the European Union will be considered for this role.