Tech Stack / Keywords
Podsumowanie oferty
The Data Engineer role involves working on large-scale data processing projects using Python and PostgreSQL in a hybrid Warsaw location. The candidate will join a new 5-6 person competency hub responsible for a critical banking application managing revenues and stock reconciliation in a multi-cloud setup (AWS and GCP). Responsibilities include optimizing queries, managing PostgreSQL performance, and developing data integration solutions.
Wymagania
- Excellent knowledge of PostgreSQL, SQL, and PL/pgSQL with experience working on large databases
- At least 5 years of experience as Database Engineer, Data Engineer, SQL Developer, or Database Developer
- Experience handling datasets with billions of records and terabytes of data efficiently
- Ability to optimize queries and long-running processes, including analyzing execution plans and identifying bottlenecks
- Proficiency with stored procedures for data processing logic
- Strong practical experience with Python and libraries like Pandas and NumPy for data analysis and transformation
- Ability to combine Python and PostgreSQL in data processing and analysis workflows
- Experience analyzing data and problems from multiple sources
- Experience analyzing system logs and using PostgreSQL extensions such as pg_stat_statements to identify bottlenecks and problematic processes
- Knowledge of data partitioning techniques, particularly by date, to optimize large tables
- Experience providing L2 production support
- Fluent in English (B2/C1 level)
Nice to have:
- Experience with BigQuery, Airflow, or dbt
- Familiarity with cloud data processing and databases on AWS or Azure
- Experience building or maintaining ETL/ELT processes using Python
- Knowledge of best practices for efficient large data processing with Pandas/NumPy
- Knowledge regarding investment funds (ETFs)
Obowiązki
- Work in projects based on PostgreSQL, Python, data warehouses, and systems processing very large data volumes
- Join a newly formed 5-6 person competency hub in Poland, taking over full project responsibility from a Spanish team
- Co-develop a critical banking application responsible for revenues management and stock reconciliation within a multi-cloud environment (AWS and GCP)
- Manage advanced PostgreSQL engine features including MVCC (Xmin/Xmax), Vacuum processes, and non-standard indexes like BRIN
- Provide production-level support and problem solving at L2 level
- Collaborate on data integration and solutions for data analysis and processing
Benefity
- Work on projects involving PostgreSQL, Python, data warehouses, and very large data volumes
- Join a new 5-6 person competency hub in Poland with eventual full project responsibility
- Contribute to a critical banking application for revenues management and stock reconciliation in a multi-cloud (AWS and GCP) environment
- Development of competencies in DWH, data integration, and database solutions
- Advanced management of PostgreSQL engine internals including MVCC, Vacuum, and BRIN indexes
- Clear career plan and support for professional development at L2 level
- Technological and developmental challenges in data and data analysis areas
- Social package including medical care, insurance, and sports card
- Work with the latest technologies and market trends
- Competitive remuneration
Inne informacje
Candidates are requested to include a consent clause for personal data processing in their CV as per Polish data protection laws. The data administrator is Sergio Sp. z o.o., Warsaw. Applicants have rights to their data including access, correction, and deletion. Personal data is processed for recruitment purposes only.
SORIGO
34 aktywne oferty