Senior Azure Data Engineer

Devire Outsourcing IT is a collaboration form dedicated to IT specialists based on self-employment (B2B), executing projects for clients operating innovative and modern projects. The client is a consulting and technology company specializing in digital transformation, software engineering, cloud, and data.

• Minimum 8 years professional experience in Data Engineering, including responsibility for production data pipelines.
• Very good practical experience with Microsoft Azure.
• Very good practical experience with Databricks.
• Advanced knowledge of Python.
• Advanced knowledge of SQL.
• Extensive experience designing, building, deploying, and maintaining data pipelines and analytical data products.
• Good knowledge of modern data platforms principles and Lakehouse architecture.
• Experience with Medallion Architecture.
• Experience in dimensional modelling for reporting and analytics.
• Very good data modeling skills.
• Experience with DataOps and software engineering practices including:
  • version control
  • automated testing
  • CI/CD
  • deployment
  • monitoring
  • incident management
• Experience applying SRE practices and continuous improvement of operational processes.
• Ability to understand different data domains and business goals before making architecture and development decisions.
• Very good communication and stakeholder management skills.
• Experience collaborating across Data, Architecture, Product, and Engineering teams.
• Ability to work independently, take responsibility, make technical decisions, and document them clearly.

Nice to have:

• Experience with Databricks Unity Catalog.
• Experience in data governance, data lineage tracking, and access control in Databricks.
• Experience working with payment or transaction data.
• Experience working in distributed, international teams.

• Designing, building, testing, and deploying scalable data pipelines for reporting and analytics.
• Building new production-ready data pipelines supporting priority reporting requirements.
• Reviewing, refactoring, and stabilizing existing reporting pipelines.
• Maintaining new and existing pipelines to ensure reliable daily data delivery.
• Increasing reliability, performance, maintainability, and observability of data pipelines.
• Supporting the deployment of Core Products data loads to the Group Data Platform.
• Ensuring pipeline compliance with Group Data Platform standards including architecture, data governance, security, data modeling, code quality, testing, CI/CD, monitoring, and documentation.
• Collaborating with stakeholders from Data, Architecture, Product, and Engineering to translate reporting requirements into technical solutions.
• Taking responsibility for SRE (Site Reliability Engineering) practices related to data pipelines and data products.
• Diagnosing data incidents and pipeline failures, conducting root-cause analysis, and implementing long-term corrective actions.
• Documenting data flows, dependencies, transformation logic, architectural decisions, and operational procedures.
• Sharing engineering knowledge and best practices with the Core Products Data team to support its long-term independence.