EPAM Systems

Senior/Lead Data Software Engineer (Python, Spark, Azure)

Brak informacji o wynagrodzeniu

SeniorHybryda·WrocławFull-time

#267721·Dodano 9 miesięcy temu·2

Źródło: EPAM Systems

Aplikuj teraz

Tech Stack / Keywords

Azure Databricks ETL PySpark

Firma i stanowisko

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.

Wymagania

Proficiency in Python and Spark with at least 3 years in data engineering roles
Strong experience with Azure Databricks and PySpark
Proven expertise in designing and implementing ETL/ELT solutions
Experience migrating big data platforms to Azure-native services
Proficiency with Delta tables for model tuning
Knowledge of data governance and regulatory compliance frameworks
Familiarity with Docker, Kubernetes (AKS), and Terraform for infrastructure automation
Ability to manage large data volumes with high efficiency
Excellent problem-solving and analytical skills
Strong communication and collaboration abilities
English proficiency at B2 level or higher

Obowiązki

Migrate and optimize over 500 data jobs using Azure Databricks optimization techniques
Manage and process 12 TB of data efficiently across platforms
Tune machine learning models for Azure environments using Java Spark and Delta tables
Update and maintain libraries to address security vulnerabilities
Develop and maintain ETL/ELT pipelines using PySpark and related technologies
Collaborate with cross-functional teams to integrate GenAI capabilities into data workflows
Monitor data quality and implement improvements to ensure accuracy and reliability
Automate deployment and operational tasks using Terraform and GitLab CI/CD
Support data governance initiatives to comply with regulatory standards
Troubleshoot and resolve performance issues in data processing systems
Document system processes and provide technical guidance to junior engineers
Implement best practices for code quality and data security
Participate in code reviews and knowledge sharing sessions
Optimize costs associated with data storage and processing

Benefity

Hybrid work mode with opportunity to work remotely within Poland
Chance to work abroad for up to 60 days annually
Business-driven relocation opportunities
Career development programs including mentoring and certification (Anthropic, Gemini, GCP, Azure, AWS)
English classes
Stable pay
Participation in Employee Stock Purchase Plan with 15% discount
Benefits package including health insurance, multisport, shopping vouchers
Referral bonuses up to $2,000
Offices featuring entertainment and relaxation zones, table tennis and football, free snacks and coffee
Corporate, social and well-being events

Elastyczne godziny

Opieka zdrowotna

Karta sportowa

Dofinansowanie szkoleń

Budżet konferencyjny

Kursy językowe

Premie

Udziały pracownicze

Spotkania integracyjne

Darmowe przekąski

Napoje w biurze

EPAM Systems

1552 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz