Azure Data Engineering Expert
Tech Stack / Keywords
Firma i stanowisko
Insights & Data delivers state-of-the-art Data solutions with expertise in Cloud & Big Data engineering, developing robust systems for processing extensive datasets using Cloud Data services on AWS, Azure, and GCP. They manage the full Software Development Life Cycle (SDLC) including ETL, programming in Python, Scala, or Java, and DevOps practices. The data is exposed via APIs, interfaces, or dashboards. Their AI Center of Excellence focuses on Data Science and Machine Learning projects in Generative AI, NLP, Anomaly Detection, and Computer Vision. The project integrates and harmonizes data from strategic platforms into a global data platform, focusing on commercial insurance pricing and underwriting.
Wymagania
- Strong experience in data engineering
- Very good experience with Python (Polars, Pandas, Pyspark)
- Very good experience with Microsoft Azure, especially Synapse is a plus
- Solid understanding of cloud architecture ITIL
- Strong analytical skills and customer focus
- Ability to rapidly adapt and respond to changes in environment and priorities
- Advanced English proficiency
- Excellent communication skills with high customer focus
Nice to have:
- ITIL Foundation certification or proven work experience in IT Service Management
- Database knowledge
- PowerBI knowledge
- Experience in BI Projects & DataVault
Obowiązki
- Develop new functionality within the Python-based ETL pipeline
- Maintain and optimize existing data pipelines
- Plan capacity and sizing of service components and manage cloud components proactively
- Initiate planning and setup of new service components
- Coordinate operations and maintenance of software, server infrastructure, and databases (including Synapse, PowerBI, and local environments)
- Maintain service-related documentation according to customer technology standards
- Monitor services and manage SLA performance
- Document, maintain, and optimize processes and configurations related to environments
- Collaborate with development, architecture, rollout, operations teams, and customers for managing releases, upgrades, and changes
Ework Group
68 aktywnych ofert