Senior Data Engineer

Experis is a global leader in recruitment of specialists and management staff in key IT areas. They offer competitive employment opportunities and interesting IT projects for both experienced experts and those starting their careers in IT.

• Minimum 5 years of experience with Spark & Scala
• Minimum 7 years of experience with Python
• Minimum 5 years of experience with Linux
• Hands-on experience with distributed data processing engines (e.g. Spark)
• Experience with Hadoop ecosystem tools (Hive, Oozie, MapReduce, etc.)
• Strong to advanced SQL skills
• Experience with version control systems: Bitbucket and Git
• Unit testing experience (JUnit 5, Mockito, Spark testing)
• Advanced English skills
• Strong collaboration and communication skills
• High level of self-motivation
• Curiosity, responsiveness, and ability to understand business and technical needs
• Focus on quality and continuous improvement

• Building a distributed and highly parallelized Big Data processing pipeline to process massive amounts of data (both structured and unstructured) in near real-time
• Leveraging Spark & Scala to transform corporate data and enable data products to be built
• Ensuring continuous delivery on Hadoop and other Big Data platforms
• Automating processes where possible to ensure they are repeatable and reliable
• Creating and maintaining efficient data flows
• Collaborating with team members and stakeholders to deliver expected results