Senior Data Engineer
Brak informacji o wynagrodzeniu
SeniorFull-time·B2B
#331324·Dodano 20 dni temu·17
Źródło: ExperisTech Stack / Keywords
Azure DatabricksAzureArchitecturePythonData LakeUnitySecurityApache Spark
Firma i stanowisko
Experis is a global leader in recruiting specialists and management staff in key IT areas. They offer competitive employment opportunities and interesting IT projects for both experienced experts and those starting their careers in IT.
Wymagania
- Strong expertise in Azure Databricks, Python, and Apache Spark.
- Solid experience with Azure Data Services, including ADLS Gen2, Azure Data Factory, and Azure Synapse.
- Experience working with APIs (REST or equivalent).
- Solid understanding of ETL processes, data modeling, and fundamental data architecture principles.
- Familiarity with CI/CD pipelines and version control systems (Git).
- Strong problem-solving skills and a structured approach to work in an agile delivery model.
- Excellent communication and collaboration skills; ability to work with business stakeholders and cross-functional teams.
Nice to have:
- Experience with big data processing and structured streaming in Databricks.
- Familiarity with Declarative Automation Bundles (formerly Databricks Asset Bundles).
- Knowledge of data governance, lineage, and security best practices, including Unity Catalog.
- Exposure to Power BI or similar data visualization tools.
- Previous experience as a Tech Lead or in a similar leadership role.
Obowiązki
- Design, develop, and optimize data pipelines and workflows using Azure Databricks and Python.
- Implement and maintain data solutions across the Azure Data Platform (Data Lake, Data Factory, Synapse, etc.).
- Develop and maintain Data Products exposed via Unity Catalog.
- Collaborate closely with business stakeholders to gather requirements and translate them into scalable technical solutions.
- Ensure data quality, security, and compliance across all solutions.
- Integrate data solutions into existing business processes and cross-functional systems.
- Continuously improve performance, cost-efficiency, and scalability of data systems.
- Support architectural decisions and mentor team members (especially valuable if you have Tech Lead experience).
Oferta
- Sports card
- Private medical care
- Group insurance
- Access to professional training and learning platforms
- Long-term, stable cooperation
- Real impact on data architecture and product decisions
Karta sportowa
Opieka zdrowotna
Ubezpieczenie
Szkolenia wewnętrzne
Experis
318 aktywnych ofert