Senior Data Platform Engineer (DevOps)

Brak informacji o wynagrodzeniu

SeniorOn-site·WrocławFull-time

#472662·Dodano 2 dni temu·1

Źródło: Capgemini

Aplikuj teraz

Tech Stack / Keywords

AWS Azure GCP Spark Snowflake SQL Python Scala Docker Kubernetes

Podsumowanie oferty

As a Senior Data Platform Engineer, you will design and develop scalable cloud-based data platforms and build data pipelines for batch and streaming workloads. The work includes integrating data sources and optimizing data models and processing architectures using AWS, Azure or GCP and related data technologies.

Wymagania

Practical experience building data platforms using one or more of AWS, Azure or GCP.
Strong understanding of large-scale data processing with Spark, Hive, Snowflake, Delta Lake or similar.
Excellent SQL skills and experience with relational and/or NoSQL databases.
Programming skills in Python or Scala.
Experience with CI/CD tools such as Azure DevOps, GitHub Actions, GitLab CI or Jenkins.
Hands-on experience with Docker and Kubernetes.
Knowledge of DataOps principles, data testing and monitoring.
Good understanding of data security, encryption and identity/access management.
Very good command of English.

Nice to have:

Familiarity with cloud AI/ML services or generative AI tools.

Obowiązki

Design and develop scalable cloud-based data platforms using AWS, Azure or GCP.
Build, optimize and maintain data pipelines for batch and streaming workloads.
Integrate diverse data sources and expose data through APIs, semantic layers and data warehouses.
Work with cloud orchestration tools, including Dataflow, Data Pipeline, ADF, MWAA and Cloud Composer.
Work with compute and processing services, including Databricks, EMR, Glue, DataProc and Snowflake.
Work with event-driven services, including EventBridge, Pub/Sub and Event Hub.
Design, develop and optimize data models and multi-layered data processing architectures (bronze/silver/gold).
Ensure efficient performance and optimize SQL/NoSQL solutions.
Collaborate with Data Scientists and engineering teams to operationalize ML models.
Document data architectures, workflows and technical processes.
Ensure security, compliance and data governance across the platform.
Participate in architectural discussions and contribute to technology recommendations.

Benefity

Medical care with Medicover.
Private life insurance.
Sports card.
Capgemini Helpline offering therapeutic support.
Access to over 70 training tracks with certification opportunities on the NEXT platform.
Free access to the Education First languages platform, Pluralsight, TED Talks, Coursera and Udemy Business materials and trainings.

Opieka zdrowotna

Ubezpieczenie

Karta sportowa

Capgemini

789 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz