Azure Databricks Data Engineer - onsite Krakow or Wroclaw

StrategicsIQ is a company hiring for a role focused on designing, building, and optimizing modern data platforms and analytics solutions using Microsoft Azure technologies.

• 8–10 years of hands-on experience in Data Engineering, with extensive experience designing and implementing enterprise data solutions on Microsoft Azure.
• Strong expertise in:
  • Azure Databricks
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage Gen2
  • Azure SQL Database / PostgreSQL
  • Azure Analytics Services
  • Azure Identity (Service Principals, System Assigned Managed Identity, User Assigned Managed Identity)
• Proven experience designing large-scale data integration, data lake, data warehouse, and analytics solutions handling high-volume, multi-format data.
• Strong programming skills in:
  • PySpark / Spark (Python or Scala)
  • SQL
• Experience with scripting using Linux Shell or PowerShell.
• Previous ETL development experience using tools such as Informatica, SSIS, Talend, or similar.
• Experience with Apache Kafka or streaming data technologies is desirable.
• Hands-on experience working with Azure cloud services in an Agile SDLC environment.
• Experience with Docker and version control systems such as Git, GitHub, or GitLab.
• Experience with workflow orchestration tools such as:
  • Apache Airflow (preferred)
  • Control-M
  • AutoSys
• Strong understanding of Git workflows, branching strategies, pull requests, and CI/CD practices.
• Knowledge of DevOps and Infrastructure as Code tools including GitLab CI/CD, YAML, Terraform, ARM Templates, Puppet, Azure Functions, and Logic Apps is advantageous.
• Experience working within Agile frameworks including Scrum, Kanban, or XP.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline (or equivalent professional experience).
• Excellent communication and stakeholder management skills with strong written and spoken English.

Preferred Experience:

• Experience building enterprise HR data platforms and analytics solutions.
• Exposure to Data Mesh architecture and modern data engineering principles.
• Experience implementing cloud-native, scalable, and highly available Azure solutions.
• Familiarity with test-driven development (TDD) and engineering best practices.

• Design, develop, and enhance scalable data platforms, digital products, and technology solutions using Azure services.
• Build, maintain, and optimise end-to-end data pipelines using Azure Databricks, Azure Data Factory (ADF), and other Azure data services.
• Translate business requirements into robust, scalable, and maintainable technical solutions.
• Apply software engineering best practices, including code reviews, automated testing, CI/CD, and infrastructure automation.
• Ensure solutions meet security, reliability, performance, and compliance standards while adhering to enterprise architecture principles.
• Develop observability and monitoring capabilities to proactively identify production issues and support incident resolution.
• Collaborate with architects, product owners, business analysts, and cross-functional engineering teams to deliver high-quality data solutions.
• Continuously evaluate emerging technologies and recommend improvements that enhance scalability, maintainability, and operational efficiency.
• Support Agile delivery by contributing to sprint planning, estimation, development, testing, and production releases.

Please be informed that the data controller is StrategicsIQ_ (hereinafter "controller"). You have the right to request access to your personal data, their rectification, erasure or restriction of processing, the right to object to processing, as well as the right to data portability and to lodge a complaint to the supervisory authority. Personal data will be processed for the purpose of the recruitment process. Provision of data to the extent resulting from the Act of 26 June 1974 Labour Code is mandatory. In the remaining scope, providing data is voluntary. Refusal to provide mandatory data may result in the impossibility to carry out the recruitment process. The Administrator processes mandatory data on the basis of a legal obligation incumbent upon him/her, while with regard to additional data, the basis for processing is consent. Personal data will be processed until the recruitment procedure is completed and for the period of the possibility of asserting potential claims, and in the case of consent to participate in future recruitment procedures - until the withdrawal of such consent. Consent to the processing of personal data can be withdrawn at any time. The recipient of the data is the Just Join IT service and other entities to whom we have entrusted the processing of data in connection with recruitment.