Azure Data Engineer

Insights & Data is a dynamic team of over 400 professionals delivering cutting-edge data solutions. They specialize in Cloud & Big Data engineering, building scalable systems for complex datasets across AWS, Azure, and GCP. Their expertise spans the full Software Development Life Cycle (SDLC), utilizing modern data processing tools, advanced programming techniques, and DevOps best practices to create impactful solutions.

• Strong experience in data engineering, including working with Azure.
• Strong Python skills for data processing and automation.
• Hands-on experience with one of the following: Databricks, Snowflake, or Microsoft Fabric.
• Strong communication skills and very good English language skills.

Nice to have:

• Strong SQL skills and experience with database optimization.
• Knowledge of DevOps practices, CI/CD pipelines, and Infrastructure as Code (Terraform, Bicep) tools.
• Familiarity with key Azure services: Data Lake, Event Hub, Data Factory, Synapse Analytics, Azure Functions.
• Exposure to containerization (Docker, Kubernetes) and cloud security best practices.
• Experience in real-time data processing and streaming technologies like Kafka or Spark Streaming.
• Hands-on experience with PySpark.
• Certifications such as DP-900, DP-203, AZ-204, or AZ-400.

• Design and implement Azure-based data solutions for large-scale and unstructured datasets.
• Develop and optimize data pipelines using Azure Data Factory, Databricks, or Snowflake.
• Collaborate with solution architects to define and implement best practices in data engineering.
• Ensure data quality, scalability, and security across all Azure-based solutions.