Webellian
28 aktywnych ofert
You will build and maintain data pipelines and training datasets for a Central Data Platform project for a global insurance company. The role focuses on data engineering using Databricks, Python, SQL and PySpark, with a stack that also includes dbt, PowerBI, GitHub and Terraform on Azure Cloud.
Nice to have:
Goals and challenges:
Contribute by building a training dataset for document processing and decision support.
Design and implement end-to-end data pipelines for ingestion, transformation, storage and consumption.
Prepare and maintain high-quality training datasets for machine learning models.
Work with large-scale data on a modern cloud data platform (Databricks).
Apply best practices in data engineering, testing and deployment.
Collaborate closely with data scientists, engineers and business stakeholders.
Continuously improve the performance, reliability and automation of data workflows.
Ensure that developed ETLs are optimal and technically integral.
