Data Engineer (Databricks)
Brak informacji o wynagrodzeniu
MidFull-time·B2B
#316977·Dodano około miesiąc temu·39
Źródło: In4geTech Stack / Keywords
DatabricksSQL ServerCloudSQLPythonPySpark
Firma i stanowisko
In4ge is a recruitment company focused on connecting talented employees with suitable companies to foster growth and success. The client is an international insurance environment undergoing a long-term data platform transformation project involving migration from SQL Server to a modern Databricks platform and building scalable data engineering processes in the cloud.
Wymagania
- Very good knowledge of Python and PySpark.
- Experience working with Databricks and Delta Lake.
- Very good knowledge of SQL and ability to analyze complex database logic.
- Experience in data engineering projects.
- Knowledge of clean code principles and OOP.
- Experience working with large code repositories.
- Experience in data modeling.
- Very good knowledge of English.
Nice to have:
- Experience with Azure Data Factory.
- Knowledge of CI/CD and Azure DevOps.
- Experience with analytical tools.
- Knowledge of DevOps or infrastructure topics.
Obowiązki
- Analyze and refactor complex SQL logic (stored procedures).
- Implement data transformations using Python and PySpark.
- Design and develop data models in the Medallion architecture (Bronze / Silver / Gold).
- Create scalable data transformation processes in the Databricks environment.
- Maintain code quality, modularity, and maintainability.
- Participate in code reviews and architectural decisions.
- Work with large data volumes in an enterprise environment.
Oferta
- 100% remote cooperation.
- Long-term project in an international environment.
- Cooperation under B2B contract.
- Work on a modern data platform.
- Participation in a large technological transformation project.
in4ge sp. z o.o.
152 aktywne oferty