Software Data Engineer - Spark & Python

Our client is an established organisation operating across the technology and data sectors. They focus on building robust data platforms and distributed systems that process information at scale. The company values strong engineering fundamentals and collaborative ways of working, bringing together cross-functional teams across different locations to deliver technical solutions.

• Strong Python development skills with proven professional experience
• Hands-on experience with Apache Spark, specifically PySpark
• Java knowledge from current or previous professional roles
• Solid understanding of software engineering fundamentals and development best practices
• 6-8 years of relevant experience in software or data engineering
• Ability to work effectively in hybrid, cross-functional teams
• Experience collaborating with virtual teams across different locations

Nice to have:

• Experience with Scala
• Experience with distributed data processing and large-scale data platforms
• Experience with Databricks (not required)

• Develop data processing solutions using Python and Apache Spark (PySpark)
• Build and maintain scalable data pipelines for large-scale data platforms
• Apply software engineering best practices to ensure code quality and reliability
• Collaborate with cross-functional teams across different locations in a hybrid model
• Design and implement distributed data processing systems
• Work with Java-based systems and integrate data solutions where required
• Contribute to technical decisions and architecture discussions
• Support the development and improvement of data platform capabilities