Nowa
Senior Data Engineer
25 000 - 29 000 PLN/ mies.B2B (netto)
SeniorFull-time·B2B
#357111·Dodano dziś·0
Źródło: nofluffjobs.comTech Stack / Keywords
SQLBigQueryELT/ETL PipelineGCP Data FusionApache AirflowData modelingData ArchitectureKimballInmonData VaultAPIDataJSONXMLCSVRESTSOAPGitCI/CDData Major
Wymagania
- 3+ years of expert-level SQL and BigQuery hands-on experience including complex optimization, cost control, and data integrity.
- 3+ years of experience in ELT/ETL pipeline development using GCP Data Fusion (highly preferred) or Apache Airflow.
- Strong expertise in Data Modeling and Architecture with deep understanding of Kimball and Inmon concepts and hands-on experience with Data Vault.
- Proven proficiency in API and data ingestion, including ingesting and parsing JSON, XML, and CSV data from REST and SOAP endpoints.
- Practical knowledge of Git and CI/CD tools for version control and continuous testing/delivery in cloud environments.
Nice to have:
- Degree in Data Major.
Obowiązki
- Design, implement, and maintain scalable data models using Star, Snowflake, and Data Vault methodologies.
- Write, refactor, and optimize complex, highly efficient SQL queries with a strong focus on cost reduction, execution time, and concurrency.
- Design, test, and deploy robust data ingestion and transformation pipelines primarily using GCP Data Fusion or Apache Airflow.
- Connect and wrangle data from various sources, including RESTful/SOAP APIs and SFTP servers, handling formats like JSON, CSV, and XML.
- Collaborate within an Agile framework using Git and CI/CD pipelines to ensure automated testing and continuous delivery of data solutions.
linkgroup
414 aktywnych ofert