Data ETL Engineer
125 - 160 PLN/ godz.B2B (netto)
MidFull-time·B2B
#308933·Dodano około 2 miesiące temu·38
Źródło: nofluffjobs.com🚫Oferta wygasła. Ta oferta pracy nie jest już aktywna i rekrutacja została zakończona.
Tech Stack / Keywords
SQLPythonTerraformCloudETLVaultGCPPUBCloud ComposerCD pipelinesBigQuerySFTPCSVJSONXMLJava
Firma i stanowisko
Link Group is hiring a Data ETL Engineer to design, build, and maintain scalable BigQuery data models and ETL/ELT pipelines, turning raw data into structured, business-ready datasets while optimizing performance and ensuring data quality in cloud environments.
Wymagania
- 3+ years of experience with SQL and complex data transformations (preferably in BigQuery)
- Experience building ETL/ELT pipelines and working with Data Vault models
- Hands-on experience with GCP services: Cloud Composer/Airflow, Cloud Run, Pub/Sub
- Proficiency in Python and Terraform
- Familiarity with CI/CD pipelines and version control (Git)
- Experience in Agile and DataOps environments
- Strong analytical and problem-solving skills
Nice to have:
- Experience with data ingestion pipelines using Data Fusion/CDAP or similar tools
- Experience ingesting data from APIs, SFTP, CSV, JSON, or XML
- Knowledge of modern data contract practices
- Java development experience (e.g., custom plugins for Data Fusion)
- Experience with CI/CD for cloud-based data solutions
Obowiązki
- Design, build, test, and deploy BigQuery data models and transformations
- Develop and maintain ETL/ELT pipelines based on Data Vault principles
- Integrate data from multiple sources while ensuring accuracy and consistency
- Optimize SQL queries and pipelines for performance, scalability, and cost
- Monitor pipelines and troubleshoot failures or performance issues
- Implement CI/CD processes and manage code with Git and Jenkins
- Collaborate in Agile teams and support knowledge transfer to operations
Link Group
163 aktywne oferty