Data Engineer
14k - 18k PLN14 000 - 18 000 PLN/ mies.UoP
MidFull-time·Umowa o pracę
#453616·Dodano 2 dni temu·6
Źródło: nofluffjobs.comTech Stack / Keywords
PythonETLELTApache SparkPySparkSQLGitLabMS SQL ServerSSISDatabricksKafkadbt
Firma i stanowisko
XTB is a global company from the financial industry, focusing on online trading of financial instruments. It is the largest FinTech in Poland and a leader in Central and Eastern Europe, operating in several countries including Asia and South America.
Wymagania
- At least 3 years of experience as a Data Engineer or in a related software engineering role.
- At least 1 year of experience with MS SQL Server, SSIS, and SQL Server Agent technologies, including deployment of new features.
- Analyzing existing legacy code for improvement and transfer to newer technology.
- Flexibility to work on Databricks oriented projects.
- Proficiency in Python and ability to write clean, testable production code.
- Hands-on experience with Apache Spark.
- Advanced SQL skills including query optimization on large datasets.
- Strong understanding of data warehouse design principles and data modeling.
- Practical knowledge of ETL/ELT processes.
- Familiarity with data quality, monitoring, and pipeline reliability.
- Experience working with relational databases including modeling and optimization.
- Understanding of REST and gRPC standards for system integration.
- Experience with workflow orchestration tools (e.g., Airflow, Dagster).
- Knowledge of CI/CD pipeline building and maintenance.
- Strong analytical problem-solving skills.
- Effective communication and teamwork skills.
- Openness to learning new technologies and methodologies.
Nice to have:
- Experience with dbt.
- Experience with Kafka, Pub/Sub, or other event streaming systems.
- Experience building near-real-time/real-time pipelines.
- Experience with Infrastructure-as-Code tools.
- Understanding of CDC (Change Data Capture) and data integration from transactional systems.
- Experience with Databricks or other lakehouse platforms.
Obowiązki
- Implementing, maintaining and support of MS SQL Server warehouse and SSIS processes and jobs on a daily basis.
- Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark.
- Working with raw data and designing methods for its integration into the data platform.
- Developing CI/CD pipelines for data engineering solutions.
- Creating and maintaining Infrastructure as Code solutions.
- Integrating the data platform with other systems and applications.
- Participating in architectural decision-making and defining engineering standards.
- Conducting code reviews, documenting solutions, and sharing knowledge with team members.
Benefity
- Real impact on company and product development.
- Work in an experienced team sharing knowledge.
- Clear growth path with feedback and career development.
- Training budget for courses and conferences.
- Additional day off on birthday.
- Additional day off for parents.
- Equipment tailored to needs.
- Private medical care and group insurance.
- Access to e-learning platform for English and benefits platform.
- Access to wellbeing platform including workshops and private therapy.
- Remote work, office work in Warsaw, or coworking spaces in other cities.
- Regular team integration events.
- Sport subscription.
Karta sportowa
Dofinansowanie szkoleń
Opieka zdrowotna
XTB
36 aktywnych ofert