Senior Data Engineer
170 PLN/ godz.B2B
SeniorFull-time·B2B
#380035·Dodano 26 dni temu·5
Źródło: emagineTech Stack / Keywords
ETLArchitecturePythonSQLApache SparkDatabricksAzureAzure SQL
Firma i stanowisko
This role is within the technology industry, focusing on data engineering and analytics. The project is remote and involves working with modern cloud-based data platforms and architectures.
Wymagania
- 5+ years of experience in data engineering with a strong background in designing and building ETL/ELT pipelines.
- Expert-level Python and SQL skills, including building optimized, scalable data transformations.
- Advanced hands-on experience with Apache Spark & Databricks, including Delta Lake.
- Strong experience with Azure data services (ADF/Synapse Pipelines, ADLS, Azure SQL/Synapse).
- Practical knowledge of Unity Catalog and governance models.
- Deep understanding of modern data architecture patterns.
- Experience designing and implementing cloud-based, large-scale data platforms.
- Strong familiarity with Git, CI/CD, DevOps practices, and automated pipeline deployment.
- Fluency in English (writing and speaking).
Nice to Haves:
- Openness to learning and working with AI technologies (including agentic frameworks, text 2 sql).
- Ability to support or collaborate on ML/DS workflows.
- Exposure to machine learning lifecycle tools (MLflow, Feature Store).
- Interest in contributing to the evolution of the Azure Data & Analytics Platform.
Obowiązki
- Design and build optimized ETL/ELT pipelines for efficient data processing.
- Utilize advanced Python and SQL skills for scalable data transformations.
- Implement and optimize data processing frameworks using Apache Spark and Databricks.
- Work with Azure data services, including ADF/Synapse Pipelines and Azure SQL/Synapse.
- Manage data governance and access control through Unity Catalog.
- Architect modern data models, utilizing concepts such as Medallion and Data Vault.
- Deploy and maintain large-scale cloud-based data platforms.
- Adhere to DevOps practices for CI/CD in automated pipeline deployment.
- Communicate effectively in English, both in writing and speaking.
Inne informacje
The project languages are Polish and English. The position is remote and based in Poland. The contract type is B2B with a rate up to 170 PLN/hour net + VAT.
emagine
228 aktywnych ofert