Data Engineer

Scalo is involved in projects related to the banking industry, focusing on designing architecture and implementing modern data processing systems in the Big Data area.

• Minimum 3 years of experience as a Big Data Developer
• Knowledge of Big Data, Data Warehousing, and Data Management
• Minimum 2-3 years of experience programming Spark processes in Python (or Scala)
• Experience working with various data formats: JSON, PARQUET, ORC, AVRO
• Understanding of database types and their use cases (e.g., Hive, Kudu, HBase)
• Knowledge of SQL
• Experience integrating data from multiple sources
• Practical knowledge of Agile processes and tools (Jira, Confluence, Kanban, Scrum) is a plus
• Applying best practices for processing large data sets, including coding, documenting, testing, and deployment standards is a plus
• Knowledge of Kubeflow platform and practical experience in CI/CD automation is a plus

• Participation in projects related to the banking industry
• Designing architecture and implementing modern data processing systems in the Big Data area
• Ensuring high quality of the development and deployment process
• Maintaining high quality of technical documentation
• Searching for and implementing new solutions (R&D)
• Collaborating with other teams to support development
• Working in a hybrid model: 2 times a month in the office in Warsaw

Work in a hybrid model: 2 times a month in the office in Warsaw.