Senior Data Engineer (Databricks)

Experis to światowy lider rekrutacji specjalistów i kadry zarządzającej w kluczowych obszarach IT. Z nami znajdziesz konkurencyjne oferty zatrudnienia oraz ciekawe projekty IT skierowane zarówno do ekspertów z wieloletnim doświadczeniem, jak i osób, które dopiero zaczynają swoją przygodę w branży IT.

Mandatory:

• Strong commercial experience as a Data Engineer, preferably in a complex enterprise environment.
• Strong hands-on experience with Databricks.
• Very good Python programming skills.
• Strong experience with Azure Data Factory (ADF).
• Experience with Azure Logic Apps and Azure Functions.
• Advanced SQL skills, including query performance analysis and SQL optimization.
• Experience working with and maintaining production data solutions.
• Ability to troubleshoot complex technical issues and work independently.
• Good communication and collaboration skills.

Should Have:

• Experience with Git repository management, including branching, pull requests, code reviews, and version control best practices.
• Experience working in structured development environments with CI/CD processes.

Nice to Have:

• Experience with SSIS (SQL Server Integration Services) and traditional ETL development.
• Previous experience working with financial applications or financial data.
• Experience maintaining and modernizing existing data/ETL solutions.

• Develop, maintain, and optimize data solutions supporting financial applications.
• Work extensively with Databricks to develop and maintain data processing and engineering solutions.
• Develop and maintain data pipelines and integrations using Python.
• Design, develop, and maintain Azure-based solutions using:
  • Azure Data Factory (ADF)
  • Azure Logic Apps
  • Azure Functions
• Write complex SQL queries and perform SQL optimization to ensure high performance and scalability.
• Analyze and troubleshoot existing data processes, identify performance bottlenecks, and implement improvements.
• Support the maintenance and continuous development of existing financial applications.
• Collaborate with engineers, developers, analysts, and business stakeholders to deliver reliable data solutions.
• Manage and maintain source code using Git repositories.
• Contribute to technical documentation, code reviews, and development best practices.
• Troubleshoot production issues and support the stability and reliability of data solutions.