Data Engineer (DataBricks)

Scalo provides software projects and supports partners in business development. Their services include technology consulting, software development, embedded systems, cloud solutions, data management, and dedicated project teams.

• Higher education in STEM
• 5–8 years of experience in data processing and analysis projects
• Very good knowledge of Databricks, including solution design and implementation
• Practical experience with PySpark
• Experience in ETL process design and migration
• Ability to model and process data in data warehouse environments
• Experience in data parsing
• Experience integrating processes with API and batch data sources
• Very good command of Python
• Practical knowledge of SQL, especially Teradata
• Highly developed analytical skills
• Ability to cooperate in project teams
• Communication skills and openness to teamwork

• Collaborate within analytics and modeling teams with Data Analysts and Developers
• Develop and migrate AML data layers involving data centralization from multiple sources
• Migrate existing ETL processes to a new analytical environment
• Adapt data architecture and processes for the Databricks environment
• Design, model, recommend, and implement solutions in PySpark using Databricks
• Develop data layers at the gold level in a data warehouse
• Integrate processes with various data sources, including APIs and batch sources
• Provide services remotely with quarterly office visits in Warsaw, Wroclaw, or Poznan

Work performed remotely with quarterly office visits in Warsaw, Wroclaw, or Poznan.