Senior Data engineer

Brak informacji o wynagrodzeniu
SeniorFull-time·B2B
#433499·Dodano 15 dni temu·1
Źródło: justjoin.it
Aplikuj teraz

Tech Stack / Keywords

DatabricksPythonSparkPySparkClickHouse

Firma i stanowisko

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Founded in 2006, headquartered in Silicon Valley with offices across the Americas, Europe, and India. The role is within a dedicated Grid Dynamics squad focusing on modernizing a global data ecosystem for a global leader in digital payment acceptance solutions, leveraging Databricks on AWS, Medallion Architecture, and ClickHouse.

Wymagania

  • 5+ years of commercial data engineering experience building and maintaining enterprise data platforms.
  • Strong hands-on experience with Databricks, Spark / PySpark, Python, and advanced SQL.
  • Proven experience designing data models and architectures using Medallion Architecture.
  • Practical experience implementing high-volume, low-latency analytics with ClickHouse.
  • Solid background in automated testing methodologies for data pipelines.
  • Ability to translate complex business needs into technical designs and backlog requirements.

Nice to have:

  • Practical experience within the AWS cloud ecosystem.
  • Familiarity with real-time streaming frameworks such as Apache Kafka.
  • Knowledge of payment processing, financial services, or merchant reporting systems.
  • Exposure to MLOps frameworks or integrating AI/ML workflows into Databricks platforms.

Obowiązki

  • Design and build production-grade data pipelines and platform components using Databricks on AWS, PySpark, Python, and SQL.
  • Implement scalable Data Models based on the Medallion Architecture (Bronze, Silver, Gold layers).
  • Architect and optimize low-latency, real-time analytics paths using ClickHouse.
  • Build automated unit, integration, and data quality testing frameworks without dedicated QA.
  • Collaborate with client stakeholders and team leadership to refine backlog and requirements.
  • Conduct design and code reviews to ensure reliability, maintainability, and architecture standards.
  • Provide support and maintenance for legacy Hadoop/Kafka reporting platform (~10% effort).

Benefity

  • Opportunity to work on bleeding-edge projects.
  • Work with a highly motivated and dedicated team.
  • Competitive salary.
  • Flexible schedule.
  • Benefits package including medical insurance and sports.
  • Corporate social events.
  • Professional development opportunities.
  • Well-equipped office.
Elastyczne godziny
Opieka zdrowotna
Karta sportowa
Spotkania integracyjne
Dofinansowanie szkoleń

Inne informacje

INFORMATION ON PERSONAL DATA PROCESSING: The candidate's personal data will be processed according to GDPR by Grid Dynamics Poland sp. z o.o. and associated entities for recruitment purposes, with data transfers within the Grid Dynamics Group, including outside the European Economic Area. Candidates can contact the data controller and have rights as defined by GDPR. Processing is necessary for recruitment and legal obligations. Detailed legal notice is provided.

Grid Dynamics

Grid Dynamics

6 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz