Senior Data Engineer (PySpark)

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

• 5+ years of experience in Data Software Engineering or related engineering roles
• Solid experience with PySpark and SparkSQL
• Experience with Cosmos DB (NoSQL API)
• Hands-on experience with OneLake or Delta Lake and OpenLake concepts
• Knowledge of DF Gen2 and M-code
• Experience with CI/CD pipelines using Azure DevOps or equivalent
• Good understanding of Azure services
• Experience integrating data solutions with Power BI
• Strong problem-solving and analytical skills
• Ability to work independently on complex tasks
• Experience working in Agile or Scrum environments
• Upper-intermediate proficiency in English (B2+)

Nice to have:

• Experience with Azure Fabric

• Implement data processing and transformation with Python, PySpark and SparkSQL
• Work with OneLake (Delta / OpenLake) for efficient data storage and analytics
• Develop and support solutions using Cosmos DB (NoSQL API)
• Contribute to Fabric workloads including Data Engineering, Data Factory Gen2 and Lakehouse
• Design, develop and maintain scalable data pipelines using Azure Fabric
• Implement and maintain CI/CD pipelines and follow DevOps best practices
• Integrate data solutions with Power BI for reporting and analytics
• Collaborate with AI, data science and product teams to support AI-driven use cases
• Ensure data quality, performance, security and reliability
• Participate in Agile ceremonies and contribute to sprint delivery
• Support production issues and continuous improvements