SORIGO

Data Engineer (Python / PostgreSQL)

Brak informacji o wynagrodzeniu

SeniorHybryda·WarszawaInne·B2B

#428773·Dodano dwa miesiące temu·1

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

PostgreSQL Python SQL NumPy PandasQuery Optimization / Performance Tuning

Podsumowanie oferty

The Data Engineer role involves working on large-scale data processing projects using Python and PostgreSQL in a hybrid Warsaw location. The candidate will join a new 5-6 person competency hub responsible for a critical banking application managing revenues and stock reconciliation in a multi-cloud setup (AWS and GCP). Responsibilities include optimizing queries, managing PostgreSQL performance, and developing data integration solutions.

Wymagania

Excellent knowledge of PostgreSQL, SQL, and PL/pgSQL with experience working on large databases
At least 5 years of experience as Database Engineer, Data Engineer, SQL Developer, or Database Developer
Experience handling datasets with billions of records and terabytes of data efficiently
Ability to optimize queries and long-running processes, including analyzing execution plans and identifying bottlenecks
Proficiency with stored procedures for data processing logic
Strong practical experience with Python and libraries like Pandas and NumPy for data analysis and transformation
Ability to combine Python and PostgreSQL in data processing and analysis workflows
Experience analyzing data and problems from multiple sources
Experience analyzing system logs and using PostgreSQL extensions such as pg_stat_statements to identify bottlenecks and problematic processes
Knowledge of data partitioning techniques, particularly by date, to optimize large tables
Experience providing L2 production support
Fluent in English (B2/C1 level)

Nice to have:

Experience with BigQuery, Airflow, or dbt
Familiarity with cloud data processing and databases on AWS or Azure
Experience building or maintaining ETL/ELT processes using Python
Knowledge of best practices for efficient large data processing with Pandas/NumPy
Knowledge regarding investment funds (ETFs)

Obowiązki

Work in projects based on PostgreSQL, Python, data warehouses, and systems processing very large data volumes
Join a newly formed 5-6 person competency hub in Poland, taking over full project responsibility from a Spanish team
Co-develop a critical banking application responsible for revenues management and stock reconciliation within a multi-cloud environment (AWS and GCP)
Manage advanced PostgreSQL engine features including MVCC (Xmin/Xmax), Vacuum processes, and non-standard indexes like BRIN
Provide production-level support and problem solving at L2 level
Collaborate on data integration and solutions for data analysis and processing

Benefity

Work on projects involving PostgreSQL, Python, data warehouses, and very large data volumes
Join a new 5-6 person competency hub in Poland with eventual full project responsibility
Contribute to a critical banking application for revenues management and stock reconciliation in a multi-cloud (AWS and GCP) environment
Development of competencies in DWH, data integration, and database solutions
Advanced management of PostgreSQL engine internals including MVCC, Vacuum, and BRIN indexes
Clear career plan and support for professional development at L2 level
Technological and developmental challenges in data and data analysis areas
Social package including medical care, insurance, and sports card
Work with the latest technologies and market trends
Competitive remuneration

Opieka zdrowotna

Ubezpieczenie

Karta sportowa

Inne informacje

Candidates are requested to include a consent clause for personal data processing in their CV as per Polish data protection laws. The data administrator is Sergio Sp. z o.o., Warsaw. Applicants have rights to their data including access, correction, and deletion. Personal data is processed for recruitment purposes only.

SORIGO

42 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz