Senior Data Engineer (Databricks+PySpark)

Brak informacji o wynagrodzeniu
SeniorFull-time
#375522·Dodano dziś·0
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

SparkPySparkDatabricksData LakeAWSSQL

Firma i stanowisko

Euvic S.A. is a large IT company with over 5000 employees and 20 years of experience. The company focuses on software development and serves international clients across various industries. The project involves maintaining, developing, and expanding globally used software for real estate investment evaluation and forecasting.

Wymagania

  • Minimum 4 years of experience in Data Engineering
  • At least 2 years of hands-on experience with Databricks platform
  • Minimum 2 years of experience in AWS cloud environment
  • Participation in at least one large data or data platform migration project
  • Very good knowledge of Apache Spark and PySpark
  • Practical experience with Delta Lake features including ACID transactions, partitioning, Z-Ordering, optimize, and vacuum
  • Experience building batch and near real-time data pipelines
  • Knowledge of Databricks components like Workflows, Jobs, and Unity Catalog
  • Ability to create efficient data transformations and troubleshoot performance issues
  • Very good knowledge of Amazon S3 as storage layer
  • Practical experience with AWS security and infrastructure (IAM, KMS, VPC, PrivateLink, Secrets Manager)
  • Experience with AWS Lambda, SNS/SQS, AWS Glue is a plus
  • Ability to design environments and manage account separation and permissions
  • Knowledge of cost and performance optimization in cloud environments
  • Very good SQL skills, preferably with SQL Server and PostgreSQL
  • Strong communication skills and readiness for regular client collaboration
  • English language proficiency at minimum B2/C1 level
  • Availability until 17:00 (to collaborate with US/Canada clients)
  • Immediate availability

Nice to have:

  • Experience with Data Governance, Security, Compliance
  • Databricks Certified Data Engineer Associate/Professional
  • AWS Certified Data Analytics or AWS Solutions Architect
  • Experience with Unity Catalog and governance in enterprise environments
  • Experience working with international teams and various English accents

Obowiązki

  • Maintain, develop, and expand functionalities of globally used real estate investment software
  • Collaborate directly with the client's team in a high-communication environment
  • Build data pipelines for batch and near real-time processing
  • Create efficient data transformations and diagnose performance issues
  • Design environments (dev/test/prod) and manage account separation and permissions
  • Work with Databricks tools such as Workflows, Jobs, and Unity Catalog

Benefity

  • Efficient, fast, and friendly recruitment process
  • Work and development in a reputable IT company with established market position
  • Projects for international clients from various industries
  • Flat structure and open-door policy
  • Small teams within a large company and collegial community
  • Transparent and attractive training program based on competency research
  • Referral bonus program
  • Buddy support during onboarding
  • Internal development opportunities including internal trainings and "Euvic Talks"
  • Participation in social initiatives with The Good People Foundation
  • Cafeteria system including Multisport card and event tickets
  • Medical care
  • Life insurance with optional additional packages such as oncology care
  • Development initiatives
Karta sportowa
Opieka zdrowotna
Dofinansowanie szkoleń
Premie

Inne informacje

  • First working day requires on-site presence at Euvic headquarters in Gliwice, Poland
  • Identity verification required during recruitment process
  • Work model is 100% remote except for the first day
  • Availability until 17:00 to collaborate with clients in USA/Canada
EUVIC S.A.

EUVIC S.A.

24 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz