Data Engineer (Research)

XTB is a global company from the financial industry, focusing on online trading of financial instruments. It is the largest FinTech in Poland and a leader in Central and Eastern Europe, operating also in Asia and South America. The company focuses on employee development and offers various training and development programs.

• At least 3 years of experience as a Data Engineer or related software engineering role.
• Proficiency in Python with ability to write clean, testable production code.
• Hands-on experience with Apache Spark.
• Advanced SQL skills including query optimization on large datasets.
• Strong understanding of data warehouse design principles and data modeling.
• Practical knowledge of ETL/ELT processes.
• Familiarity with data quality, monitoring, and pipeline reliability.
• Experience with relational databases, including data modeling and optimization.
• Understanding of REST and gRPC standards for system integration.
• Experience with workflow orchestration tools like Airflow or Dagster.
• Knowledge of CI/CD pipeline building and maintenance principles.
• Strong analytical and problem-solving skills.
• Effective communication skills and teamwork ability.
• Openness to learning new technologies and methodologies.

Nice to have:

• Experience with dbt.
• Experience with Kafka, Pub/Sub, or other event streaming systems.
• Experience building near-real-time or real-time pipelines.
• Experience with Infrastructure-as-Code tools.
• Understanding of CDC (Change Data Capture) and data integration from transactional systems.
• Experience with Databricks or other lakehouse platforms.

• Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark / PySpark.
• Working with raw data and designing methods for its integration into the data platform.
• Developing CI/CD pipelines for data engineering solutions.
• Creating and maintaining Infrastructure as Code solutions.
• Integrating the data platform with other systems and applications.
• Participating in architectural decision-making and defining engineering standards.
• Conducting code reviews, documenting solutions, and sharing knowledge with team members.