Azure Databricks Data Engineer - Hybrid - Krakow or Wroclaw

1500 - 1800 PLN/ dzień.B2B
MidFull-time·B2B
#399645·Dodano 20 dni temu·1
Źródło: justjoin.it
Aplikuj teraz

Tech Stack / Keywords

AzureDatabricksCI/CDAirflowSQLPythonPySparkScala

Firma i stanowisko

StrategicsIQ is a company focusing on data engineering solutions, leveraging Microsoft Azure cloud services and supporting enterprise data initiatives including HR and analytics platforms.

Wymagania

  • 8–10 years hands-on experience in Data Engineering, specifically with enterprise data solutions on Microsoft Azure.
  • Expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure SQL Database, and PostgreSQL.
  • Proven design experience for large-scale data integration, data lakes, data warehouses, and analytics solutions.
  • Strong programming skills in PySpark, Spark (Python or Scala), and SQL.
  • Experience scripting with Linux Shell or PowerShell.
  • ETL development experience using tools like Informatica, SSIS, or Talend.
  • Familiarity with streaming technologies such as Apache Kafka is desirable.
  • Hands-on experience with Azure cloud services within Agile SDLC.
  • Knowledge of Docker, and version control systems such as Git, GitHub, or GitLab.
  • Experience with workflow orchestration tools like Apache Airflow, Control-M, or AutoSys.
  • Understanding of Git workflows, branching, pull requests, and CI/CD practices.
  • Knowledge of DevOps and Infrastructure as Code tools such as GitLab CI/CD, YAML, Terraform, ARM Templates, Puppet, Azure Functions, and Logic Apps is advantageous.
  • Experience working with Agile frameworks (Scrum, Kanban, XP).
  • Bachelor's degree in Computer Science, IT, Engineering, or related discipline (or equivalent experience).
  • Excellent written and spoken English communication and stakeholder management skills.

Nice to have:

  • Experience building enterprise HR data platforms and analytics solutions.
  • Exposure to Data Mesh architecture and modern data engineering principles.
  • Experience with cloud-native, scalable, highly available Azure solutions.
  • Familiarity with test-driven development (TDD) and engineering best practices.

Obowiązki

  • Design, develop, and enhance scalable data platforms and technology solutions using Azure services.
  • Build, maintain, and optimize data pipelines using Azure Databricks, Azure Data Factory (ADF), and other Azure data services.
  • Translate business requirements into robust, scalable technical solutions.
  • Apply software engineering best practices: code reviews, automated testing, CI/CD, and infrastructure automation.
  • Ensure compliance with security, reliability, performance, and enterprise architecture standards.
  • Develop observability and monitoring capabilities to identify production issues and support incident resolution.
  • Collaborate with architects, product owners, business analysts, and engineering teams.
  • Continuously evaluate emerging technologies to improve scalability, maintainability, and efficiency.
  • Support Agile delivery including sprint planning, estimation, development, testing, and releases.

Inne informacje

Please be informed that the data controller is StrategicsIQ (hereinafter "controller"). You have rights regarding personal data access, rectification, erasure, restriction, objection, portability, and complaint to supervisory authority. Personal data processing is mandatory as per Labour Code for recruitment. Additional data provision is voluntary. Consent to process can be withdrawn anytime. Data will be processed until recruitment completion and potential claims period or until consent withdrawal for future recruitments. Data recipients include Just Join IT service and entrusted entities related to recruitment processing.

Strategicsiq

Strategicsiq

32 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz