Big Data Developer Spark

The project is conducted with a European banking industry leader, focusing on banking B2B and B2C in the C-Profit domain responsible for consolidating and providing sales teams with transaction data on financial products of the investment bank. It involves modernizing the data platform based on Big Data technologies alongside migration to Azure.

• Minimum 4-5 years of software development experience.
• Practical experience with TDD (Test-Driven Development).
• Higher education in computer science or software engineering.
• Expert knowledge of Spark, Java, Hive, and SQL.
• Fluent English language skills.

Nice to have:

• Experience with DevOps, CI/CD, and microservices and API architecture.
• Knowledge of Big Data tools and version control system Git.
• Knowledge of Python, including usage with Airflow.

• Deliver technical documentation, test plans, and project deliverables in accordance with the project timeline.
• Design and implement data collection, transformation, and processing solutions using Spark, Java, Hive, and SQL.
• Develop data processing and mapping jobs using Spark/Scala according to business requirements.
• Analyze data from multiple sources and develop technical specifications based on results.
• Provide Big Data architecture strategy recommendations based on stakeholder discussions.
• Industrialize data processing for reliability, resilience, and performance.
• Provide application support and resolve production issues.