Data Engineer

The client is an international bank.

• Minimum 5 years experience in Spark and Scala
• Minimum 7 years experience in Python
• Minimum 5 years experience in Linux
• Experience with distributed data processing engines like Spark
• Experience with Hadoop and related tools (Hive, Oozie, MapReduce, etc.)
• Strong/Advanced SQL skills
• Previous experience in creating data flows
• Expertise in BitBucket and Git
• Unit testing experience (JUnit 5, Mockito, Spark testing)
• Advanced English skills (minimum B2)

Nice to have:

• Code versioning strategy & branching strategy
• Familiarity with Agile/SAFe framework

• Building a distributed and highly parallelized Big Data processing pipeline which processes massive amounts of data (both structured and unstructured) in near real-time
• Leveraging Spark and Scala to transform corporate data to enable data products to be built
• Continuous delivery on Hadoop and other Big Data platforms
• Automating processes where possible to ensure they are repeatable and reliable

• Workplace: 100% remote
• Notice period: 30 days
• Form of cooperation: B2B contract with ITFS