Senior Data Engineer

1300 - 1400 PLN/ dzień./ dzień.B2BB2B (netto)

SeniorHybryda·KrakówFull-time·B2B

#474127·Dodano dziś·0

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

Python SQLNoSQLCI/CD

Podsumowanie oferty

Build and run end-to-end data pipelines for a banking project, covering ingestion, transformation, validation and publication. Design data models and pipeline components using SQL, Python, graph databases and NoSQL stores.

Wymagania

Proven experience as a Senior Data Engineer delivering production-grade data pipelines.
Strong SQL skills, including complex transformations, relational modelling, query-plan analysis and optimisation.
Hands-on experience with graph databases and knowledge graphs, including ontology and entity/relationship modelling.
Practical experience designing NoSQL data models, including partitioning, indexing and consistency trade-offs.
Strong Python skills, or equivalent, for orchestration, transformation and testing.
Experience building reusable pipeline frameworks across multiple sources or domains.
Good understanding of batch and event-driven processing, incremental loads, idempotency and backfill strategies.
Experience with structured and unstructured data, including document content and metadata.
Solid knowledge of data quality, schema evolution, lineage and data lifecycle management.
Experience with cloud data services, orchestration tools, CI/CD and monitoring.
Clear communication and experience working across engineering, architecture and business teams.

Obowiązki

Design, build and run end-to-end pipelines for ingestion, extraction, transformation, enrichment, validation and publication.
Develop reusable connectors and processing components for structured and unstructured sources, including APIs and other interfaces.
Build reliable pipelines with idempotent writes, deduplication, retries, replay, backfills and recovery from partial failures.
Design incremental and full-load patterns suited to each source’s volume and change behaviour.
Develop SQL data models and transformations, focusing on integrity and query performance.
Design graph schemas and translate ontology concepts into implementable models, mapping source data to the knowledge graph.
Build graph loading and query patterns that preserve identifiers, relationships, provenance and lineage.
Design NoSQL models around access patterns, and integrate relational, graph and NoSQL stores.
Implement data quality controls, lineage tracking and operational monitoring for throughput, freshness and failure rates.
Help set standards for security, access control, observability and data lifecycle across pipelines.
Contribute to automated testing, schema migrations, CI/CD and production support.
Work with analysts, architects, engineers and business stakeholders to turn source requirements into technical designs.

Benefity

Private healthcare.
Multisport card.
Personal growth and development opportunities, with the possibility to rotate between projects.
Training budget.
Gym access.
Free coffee and snacks.
Mobile phone.
Bike parking and free parking.

Opieka zdrowotna

Karta sportowa

Dofinansowanie szkoleń

Napoje w biurze

Darmowe przekąski

Telefon

Parking dla rowerów

Parking dla aut

Verita HR

95 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz