Data Engineer (Databricks)

Brak informacji o wynagrodzeniu
MidFull-time·B2B
#316977·Dodano około miesiąc temu·39
Źródło: In4ge
Aplikuj teraz

Tech Stack / Keywords

DatabricksSQL ServerCloudSQLPythonPySpark

Firma i stanowisko

In4ge is a recruitment company focused on connecting talented employees with suitable companies to foster growth and success. The client is an international insurance environment undergoing a long-term data platform transformation project involving migration from SQL Server to a modern Databricks platform and building scalable data engineering processes in the cloud.


Wymagania

  • Very good knowledge of Python and PySpark.
  • Experience working with Databricks and Delta Lake.
  • Very good knowledge of SQL and ability to analyze complex database logic.
  • Experience in data engineering projects.
  • Knowledge of clean code principles and OOP.
  • Experience working with large code repositories.
  • Experience in data modeling.
  • Very good knowledge of English.

Nice to have:

  • Experience with Azure Data Factory.
  • Knowledge of CI/CD and Azure DevOps.
  • Experience with analytical tools.
  • Knowledge of DevOps or infrastructure topics.

Obowiązki

  • Analyze and refactor complex SQL logic (stored procedures).
  • Implement data transformations using Python and PySpark.
  • Design and develop data models in the Medallion architecture (Bronze / Silver / Gold).
  • Create scalable data transformation processes in the Databricks environment.
  • Maintain code quality, modularity, and maintainability.
  • Participate in code reviews and architectural decisions.
  • Work with large data volumes in an enterprise environment.

Oferta

  • 100% remote cooperation.
  • Long-term project in an international environment.
  • Cooperation under B2B contract.
  • Work on a modern data platform.
  • Participation in a large technological transformation project.
in4ge sp. z o.o.

in4ge sp. z o.o.

152 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz