Data ETL Engineer

125 - 160 PLN/ godz.B2B (netto)
MidFull-time·B2B
#308933·Dodano około 2 miesiące temu·38
Źródło: nofluffjobs.com
🚫Oferta wygasła. Ta oferta pracy nie jest już aktywna i rekrutacja została zakończona.

Tech Stack / Keywords

SQLPythonTerraformCloudETLVaultGCPPUBCloud ComposerCD pipelinesBigQuerySFTPCSVJSONXMLJava

Firma i stanowisko

Link Group is hiring a Data ETL Engineer to design, build, and maintain scalable BigQuery data models and ETL/ELT pipelines, turning raw data into structured, business-ready datasets while optimizing performance and ensuring data quality in cloud environments.


Wymagania

  • 3+ years of experience with SQL and complex data transformations (preferably in BigQuery)
  • Experience building ETL/ELT pipelines and working with Data Vault models
  • Hands-on experience with GCP services: Cloud Composer/Airflow, Cloud Run, Pub/Sub
  • Proficiency in Python and Terraform
  • Familiarity with CI/CD pipelines and version control (Git)
  • Experience in Agile and DataOps environments
  • Strong analytical and problem-solving skills

Nice to have:

  • Experience with data ingestion pipelines using Data Fusion/CDAP or similar tools
  • Experience ingesting data from APIs, SFTP, CSV, JSON, or XML
  • Knowledge of modern data contract practices
  • Java development experience (e.g., custom plugins for Data Fusion)
  • Experience with CI/CD for cloud-based data solutions

Obowiązki

  • Design, build, test, and deploy BigQuery data models and transformations
  • Develop and maintain ETL/ELT pipelines based on Data Vault principles
  • Integrate data from multiple sources while ensuring accuracy and consistency
  • Optimize SQL queries and pipelines for performance, scalability, and cost
  • Monitor pipelines and troubleshoot failures or performance issues
  • Implement CI/CD processes and manage code with Git and Jenkins
  • Collaborate in Agile teams and support knowledge transfer to operations
Link Group

Link Group

163 aktywne oferty

Zobacz wszystkie oferty