Data Engineer
Brak informacji o wynagrodzeniu
MidFull-time
#434735·Dodano 4 dni temu·1
Źródło: XTBTech Stack / Keywords
MS SQL ServerSSISSQL Server AgentSQLPythonApache SparkPySparkRESTgRPCAirflow Dagster workflow orchestration tools databricks dbt kafka pub/sub CDC Databricks
Firma i stanowisko
XTB is a global company from the financial industry, focusing on online trading of financial instruments. It is the largest FinTech in Poland and a leader in Central and Eastern Europe, operating also in Asia and South America.
Wymagania
- At least 3 years of experience as a Data Engineer or in a related software engineering role.
- At least 1 year of experience with MS SQL Server, SSIS, and SQL Server Agent technologies, including deployment of new features.
- Analyzing existing legacy code for improvement and migration to newer technology.
- Flexibility to be enrolled into the Databricks-oriented project during cooperation.
- Proficiency in Python and ability to write clean, testable production code.
- Hands-on experience with Apache Spark.
- Advanced SQL skills including query optimization on large datasets.
- Strong understanding of data warehouse design principles and data modeling.
- Practical knowledge of ETL/ELT processes.
- Familiarity with data quality, monitoring, and pipeline reliability.
- Experience working with relational databases, including data modeling and optimization.
- Understanding of REST and gRPC standards for system integration.
- Experience with workflow orchestration tools like Airflow or Dagster.
- Knowledge of CI/CD pipeline building and maintenance.
- Strong analytical problem-solving skills and attention to detail.
- Effective communication skills and ability to collaborate in a team.
- Openness to learning and exploring new technologies and methodologies.
Nice to have:
- Experience with dbt.
- Experience with Kafka, Pub/Sub, or other event streaming systems.
- Experience building near-real-time or real-time pipelines.
- Experience working with Infrastructure-as-Code tools.
- Understanding of CDC (Change Data Capture) and data integration from transactional systems.
- Experience with Databricks or other lakehouse platforms.
Obowiązki
- Implementing, maintaining and supporting MS SQL Server warehouse and SSIS processes and jobs daily.
- Designing, building, and maintaining scalable data processing pipelines using SQL, Python, and Apache Spark/PySpark.
- Working with raw data and designing methods for its integration into the data platform.
- Developing CI/CD pipelines for data engineering solutions.
- Creating and maintaining Infrastructure as Code solutions.
- Integrating the data platform with other systems and applications.
- Participating in architectural decision-making and defining engineering standards.
- Conducting code reviews, documenting solutions, and sharing knowledge with team members.
Benefity
- Real influence on the development of the company and product.
- Work in an experienced team that shares knowledge.
- Clear vision of development with regular feedback and career paths.
- Regular team-building meetings.
- Training budget for courses and conferences.
- An extra day off on your birthday and for parents.
- Equipment tailored to your needs.
- Private medical care and group insurance.
- Access to e-learning platform for English and benefits platform.
- Access to a wellbeing platform with workshops and private therapy sessions.
- Remote work option from Warsaw office or coworking space in your city.
Dofinansowanie szkoleń
Płatny urlop
Opieka zdrowotna
Ubezpieczenie
Elastyczne godziny
XTB
37 aktywnych ofert