Senior Cloud Data Engineer (Azure)

Future Processing is hiring for a project serving a client from the DACH region in the tourism industry. The team designs, develops, and maintains scalable data solutions within the Azure Data Platform ecosystem including Azure Synapse, Databricks, and Data Lakehouse environments.

• Minimum 5 years IT experience, including at least 3.5 years working with data in Azure cloud (commercial projects in production).
• Experience with Terraform.
• Experience working with Databricks.
• Commercial experience processing large data with JSON.
• Commercial experience with PySpark.
• Advanced expertise in SQL, applied on Microsoft and other technological solutions.
• Proficient in Git and CI/CD methodologies.
• Design and optimize data processing solutions (ETL, ELT) preceded by technical project and solution alternatives design (e.g., Apache Airflow).
• Programming skills in Python using libraries such as Pandas and/or NumPy.
• Familiarity with Azure tools: Azure Data Explorer, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure DevOps, Azure Synapse Analytics.
• Experience with agile practices and software development tools including Azure DevOps.
• Knowledge of secure data storage and processing mechanisms in the cloud.
• Practical use of Generative AI in software development and architectural decisions.
• Language skills: Polish at C1 level, English at B2 level.

• Implement and optimize ETL/ELT processes for data acquisition, transformation, and sharing across multiple business domains including operational, financial, and reporting systems.
• Develop and maintain data processing solutions using Python, SQL, and Apache Spark.
• Support data environment migration and modernization, including implementing Unity Catalog and platform updates.
• Build and maintain workflows in Databricks, including solutions based on Delta Live Tables (DLT), metadata-driven frameworks, and orchestration processes.
• Collaborate with architects, analysts, and business stakeholders to translate business requirements into technical solutions.
• Co-develop and enhance CI/CD pipelines, infrastructure automation, monitoring, logging, and operational best practices.

Wyrażam zgodę na przetwarzanie moich danych osobowych przez Future Processing w celu prowadzenia rekrutacji na aplikowane przeze mnie stanowisko.