Platform Engineer (Azure & Databricks)

Cyclad works with top international IT companies to deliver cutting-edge technologies. The project involves supporting a Revenue Growth Management pricing platform for the Austrian market based on an existing UK and Ireland solution.

• 5 or more years of experience in Azure, cloud, or platform engineering
• At least 2 years of hands-on Azure Databricks experience
• At least 2 years of production Terraform experience
• Strong knowledge of: Azure Data Lake Storage Gen2, Azure Key Vault, Microsoft Entra ID, Azure RBAC and managed identities, Azure networking and private connectivity
• Experience with Azure Monitor and Log Analytics
• Practical Azure Databricks administration experience
• Advanced Terraform skills, including reusable modules, provider management, remote state, imports, drift management, and automated validation
• Strong Bash proficiency for infrastructure and operational automation
• Experience integrating Bash with Azure CLI, Databricks CLI, Terraform, and Azure DevOps
• Knowledge of Bash error handling, input validation, logging, exit codes, secret handling, ShellCheck, and shfmt
• Strong Azure DevOps experience
• Ability to independently troubleshoot complex infrastructure, security, networking, deployment, and platform issues
• Working knowledge of Python for automation, API integration, validation, and platform administration
• Experience with Azure or Databricks Python SDKs and REST APIs
• Experience with Databricks Asset Bundles
• Knowledge of Bicep, Azure Policy, and policy as code
• Experience with enterprise data platforms, analytics workloads, or pricing solutions
• Knowledge of platform monitoring, observability, disaster recovery, and cost optimisation
• Experience with PowerShell and additional automation tooling
• Very good English skills

Project scope:

• Provision and manage Azure data platform infrastructure using Terraform
• Develop reusable Terraform modules and maintain secure remote state
• Deploy and configure Azure Databricks workspaces and supporting Azure services
• Administer Databricks compute, cluster policies, SQL warehouses, permissions, and Unity Catalog resources
• Configure catalogues, schemas, volumes, storage credentials, and external locations
• Implement Azure RBAC and Databricks access controls using Microsoft Entra ID groups, managed identities, and service principals
• Configure secure Azure networking, including virtual networks, private endpoints, private DNS, routing, and firewall controls
• Develop production-quality Bash scripts for provisioning, deployment, validation, and operational automation
• Build and maintain multi-stage Azure DevOps YAML pipelines
• Implement pipeline validation, security scanning, approvals, deployment controls, and rollback processes
• Support platform onboarding and troubleshoot Azure, Databricks, networking, identity, storage, and CI/CD issues
• Maintain operational documentation, runbooks, monitoring, governance, and cost-optimisation standards
• Collaborate with platform, DevOps, data engineering, security, and architecture teams

Only candidates with citizenship in the European Union and residence in Poland