Big Data Developer Spark

Our partner is one of the European leaders in the banking industry. The projects concern B2B and B2C banking platforms for large loans, professional loans, and applications supporting digital transformation.

• Minimum 4 years of commercial experience in Data Engineering or Software Engineering in Big Data environments.
• Advanced knowledge and practical experience with Apache Spark, Hive, and SQL.
• Deep understanding and experience in writing testable code following TDD.
• Solid programming experience in Scala (strongly preferred) or Java.
• Higher education in Computer Science, Software Engineering, or related fields.
• Very good command of English (minimum C1).

Nice to have:

• CI/CD (Jenkins, GitLab CI, or similar), Git flow, branching strategies.
• Python (especially in the context of Airflow and pipeline orchestration).
• Experience with Azure (ADF, ADLS, Databricks, or related services).
• Experience in SAFe/release train environments.
• Knowledge of microservice architecture and REST API.

• Designing and implementing pipelines for ingestion, transformation, and processing of large data volumes.
• Industrializing data processing solutions focusing on scalability, reliability, and fault tolerance.
• Developing and optimizing Spark/Scala jobs (batch processing, data mapping, performance tuning).
• Participating in Big Data architecture design and recommending technological solutions.
• Analyzing data sources and translating business requirements into technical specifications.
• Conducting code reviews and maintaining code quality, TDD/BDD standards, and DevOps best practices.
• Providing production support (L3), troubleshooting, and identifying technical risks.
• Creating documentation and test plans in an Agile/Scrum environment.