Senior Data Engineer with Databricks (Warsaw)

Brak informacji o wynagrodzeniu

SeniorOn-site·WarsawFull-time

#465302·Dodano 4 dni temu·0

Źródło: Xebia

Aplikuj teraz

Tech Stack / Keywords

Databricks SQLETL/ELTCI/CDdbtDatabricks Asset BundlesInfrastructure as CodeAWS Azure GCP

Podsumowanie oferty

Design and maintain scalable data ingestion and transformation pipelines and ETL/ELT processes for enterprise data products. Build reusable data-processing frameworks and support data product delivery using Databricks and SQL.

Wymagania

Strong experience building data pipelines and transformation solutions.
Hands-on experience with Databricks.
Strong SQL skills and experience working with large-scale datasets.
Experience implementing ETL/ELT processes in cloud environments.
Experience developing data integration and transformation frameworks.
Familiarity with modern data architecture concepts, including Bronze, Silver, and Gold layers.
Experience with automated testing, reconciliation, and data quality processes.
Knowledge of software engineering best practices, version control, and CI/CD principles.
Ability to work in cross-functional delivery teams.
Strong analytical, troubleshooting, and problem-solving skills.
Effective communication and stakeholder collaboration skills.
Experience delivering solutions in enterprise-scale environments.

Nice to have:

Experience with metadata-driven processing frameworks.
Familiarity with data product-oriented architectures.
Knowledge of dbt or modern analytics engineering practices.
Experience working with Databricks Asset Bundles (DABs) and deployment automation.
Experience with Infrastructure as Code and cloud-native data platforms.
Exposure to GxP-regulated environments.
Experience supporting large-scale data modernization or migration programs.
Knowledge of reconciliation automation and enterprise data governance practices.
Experience mentoring junior engineers and contributing to engineering standards.

Obowiązki

Design, develop, and maintain scalable data ingestion and transformation pipelines.
Build metadata-driven data-processing frameworks and reusable engineering components.
Develop and maintain data flows from landing, Bronze, and Silver layers through analytical consumption layers.
Create and optimize ETL/ELT processes supporting enterprise data products.
Implement reconciliation, data validation, and automated testing capabilities.
Support development of data product delivery frameworks and engineering templates.
Participate in source-focused and domain-focused delivery pods.
Collaborate with data modelers, BI engineers, platform engineers, architects, and client stakeholders.
Support migration of legacy data-processing workloads and analytical assets.
Develop monitoring, logging, and operational support mechanisms for data pipelines.
Contribute to CI/CD-driven engineering practices and automation initiatives.
Support knowledge transfer and handover activities to client engineering teams.
Participate in data quality, troubleshooting, and performance optimization activities.

Inne informacje

Work from the European Union region and a work permit are required.
Recruitment process: CV review, HR call, interview, client interview, and decision.

Xebia sp. z o.o.

113 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz