Data Engineer (Python / PostgreSQL)
Brak informacji o wynagrodzeniu
SeniorInne·B2B
#428773·Dodano wczoraj·0
Źródło: justjoin.itTech Stack / Keywords
PostgreSQLPythonSQLNumPyPandasQuery Optimization / Performance Tuning
Firma i stanowisko
Sorigo specializes in implementing innovative IT solutions and has many years of partnership experience with major clients. The company supports employee development and satisfaction, focusing on advanced data engineering projects involving very large data volumes and multi-cloud environments.
Wymagania
- Excellent knowledge of PostgreSQL, SQL, and PL/pgSQL with experience working on large databases
- At least 5 years of experience as Database Engineer, Data Engineer, SQL Developer, or Database Developer
- Experience handling datasets with billions of records and terabytes of data efficiently
- Ability to optimize queries and long-running processes, including analyzing execution plans and identifying bottlenecks
- Proficiency with stored procedures for data processing logic
- Strong practical experience with Python and libraries like Pandas and NumPy for data analysis and transformation
- Ability to combine Python and PostgreSQL in data processing and analysis workflows
- Experience analyzing data and problems from multiple sources
- Experience analyzing system logs and using PostgreSQL extensions such as pg_stat_statements to identify bottlenecks and problematic processes
- Knowledge of data partitioning techniques, particularly by date, to optimize large tables
- Experience providing L2 production support
- Fluent in English (B2/C1 level)
Nice to have:
- Experience with BigQuery, Airflow, or dbt
- Familiarity with cloud data processing and databases on AWS or Azure
- Experience building or maintaining ETL/ELT processes using Python
- Knowledge of best practices for efficient large data processing with Pandas/NumPy
- Knowledge regarding investment funds (ETFs)
Obowiązki
- Work in projects based on PostgreSQL, Python, data warehouses, and systems processing very large data volumes
- Join a newly formed 5-6 person competency hub in Poland, taking over full project responsibility from a Spanish team
- Co-develop a critical banking application responsible for revenues management and stock reconciliation within a multi-cloud environment (AWS and GCP)
- Manage advanced PostgreSQL engine features including MVCC (Xmin/Xmax), Vacuum processes, and non-standard indexes like BRIN
- Provide production-level support and problem solving at L2 level
- Collaborate on data integration and solutions for data analysis and processing
Benefity
- Work on projects involving PostgreSQL, Python, data warehouses, and very large data volumes
- Join a new 5-6 person competency hub in Poland with eventual full project responsibility
- Contribute to a critical banking application for revenues management and stock reconciliation in a multi-cloud (AWS and GCP) environment
- Development of competencies in DWH, data integration, and database solutions
- Advanced management of PostgreSQL engine internals including MVCC, Vacuum, and BRIN indexes
- Clear career plan and support for professional development at L2 level
- Technological and developmental challenges in data and data analysis areas
- Social package including medical care, insurance, and sports card
- Work with the latest technologies and market trends
- Competitive remuneration
Opieka zdrowotna
Ubezpieczenie
Karta sportowa
Inne informacje
Candidates are requested to include a consent clause for personal data processing in their CV as per Polish data protection laws. The data administrator is Sergio Sp. z o.o., Warsaw. Applicants have rights to their data including access, correction, and deletion. Personal data is processed for recruitment purposes only.
SORIGO
22 aktywne oferty