Senior Data Engineer (Research)
17.5k - 22.1k PLN17 500 - 22 100 PLN/ mies.UoP
SeniorFull-time·Umowa o pracę
#442902·Dodano 2 dni temu·1
Źródło: nofluffjobs.comTech Stack / Keywords
PythonETLELTSCDApache SparkPySparkSQLGitLabDatabricksAWSAzureGCPCI/CDKafka
Firma i stanowisko
XTB is a global company from the financial industry, focusing on online trading of financial instruments. It is the largest FinTech in Poland and a leader in Central and Eastern Europe, operating also in Asia and South America. The Senior Data Engineer will join the Data Science Engineering team focusing on building scalable data integration mechanisms and ensuring data quality and consistency.
Wymagania
- At least 4 years of experience as a Data Engineer or in a related software engineering role
- Proficiency in Python and ability to write clean, testable production code
- Hands-on experience with Apache Spark
- Advanced SQL skills including query optimization on large datasets
- Strong understanding of data warehouse design principles and data modeling
- Practical knowledge of ETL/ELT processes
- Familiarity with data quality, monitoring, and pipeline reliability
- Experience working with relational databases including data modeling and optimization
- Understanding of REST and gRPC standards for system integration
- Experience with workflow orchestration tools (e.g., Airflow, Dagster)
- Knowledge of CI/CD pipeline building and maintenance principles
- Strong analytical problem-solving skills and attention to detail
- Effective communication and team collaboration skills
- Openness to learning and exploring new technologies and methodologies
Nice to have:
- Experience with dbt
- Experience with Kafka, Pub/Sub, or other event streaming systems
- Experience building near-real-time / real-time pipelines
- Experience working with Infrastructure-as-Code tools
- Understanding of CDC (Change Data Capture) and data integration from transactional systems
- Experience with Databricks or other lakehouse platforms
Obowiązki
- Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark/PySpark
- Working with raw data and designing methods for its integration into the data platform
- Developing CI/CD pipelines for data engineering solutions
- Creating and maintaining Infrastructure as Code solutions
- Integrating the data platform with other systems and applications
- Participating in architectural decision-making and defining engineering standards
- Conducting code reviews, documenting solutions, and sharing knowledge with team members
Benefity
- Real impact on company and product development
- Work in an experienced team sharing knowledge
- Clear growth path with regular feedback and transparent career development
- Training budget for courses and conferences of choice
- Additional day off on your birthday
- Additional day off for parents
- Equipment tailored to your needs
- Private medical care and group insurance
- Access to e-learning platform for English learning and benefits platform
- Access to wellbeing platform including workshops and private therapy sessions
- Choice of remote work, Warsaw office, or coworking space
- Regular team integration events
- Sport subscription
Karta sportowa
Dofinansowanie szkoleń
Opieka zdrowotna
Płatny urlop
XTB
37 aktywnych ofert