Senior Data Engineer

25 000 - 29 000 PLN/ mies.B2B (netto)
SeniorFull-time·B2B
#357111·Dodano dziś·0
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

SQLBigQueryELT/ETL PipelineGCP Data FusionApache AirflowData modelingData ArchitectureKimballInmonData VaultAPIDataJSONXMLCSVRESTSOAPGitCI/CDData Major

Wymagania

  • 3+ years of expert-level SQL and BigQuery hands-on experience including complex optimization, cost control, and data integrity.
  • 3+ years of experience in ELT/ETL pipeline development using GCP Data Fusion (highly preferred) or Apache Airflow.
  • Strong expertise in Data Modeling and Architecture with deep understanding of Kimball and Inmon concepts and hands-on experience with Data Vault.
  • Proven proficiency in API and data ingestion, including ingesting and parsing JSON, XML, and CSV data from REST and SOAP endpoints.
  • Practical knowledge of Git and CI/CD tools for version control and continuous testing/delivery in cloud environments.

Nice to have:

  • Degree in Data Major.

Obowiązki

  • Design, implement, and maintain scalable data models using Star, Snowflake, and Data Vault methodologies.
  • Write, refactor, and optimize complex, highly efficient SQL queries with a strong focus on cost reduction, execution time, and concurrency.
  • Design, test, and deploy robust data ingestion and transformation pipelines primarily using GCP Data Fusion or Apache Airflow.
  • Connect and wrangle data from various sources, including RESTful/SOAP APIs and SFTP servers, handling formats like JSON, CSV, and XML.
  • Collaborate within an Agile framework using Git and CI/CD pipelines to ensure automated testing and continuous delivery of data solutions.
linkgroup

linkgroup

414 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz