Middle Backend Developer – Big Data

Brak informacji o wynagrodzeniu

MidHybryda·WarszawaFull-time·B2B

#461564·Dodano 7 dni temu·0

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

Scala Apache SparkETL/ELTSQL CI/CD

Podsumowanie oferty

Join the Financial Reporting team within SCIB IT to build global data solutions supporting regulatory reporting. You will develop scalable backend and Big Data solutions, including ETL/ELT pipelines, primarily with Scala and Apache Spark.

Wymagania

Bachelor's degree in Computer Science, Software Engineering, or a related field.
At least 3 years of experience in backend development, data engineering, or a similar technical role.
Hands-on experience with Scala and Apache Spark.
Strong understanding of ETL/ELT processes and data pipeline development.
Good knowledge of SQL and experience with databases and Big Data technologies.
Understanding of APIs, system integration, and microservices.
Experience with Git/GitHub and CI/CD tools such as Jenkins.
Good analytical and problem-solving skills.
English proficiency at B2 level or above.

Nice to have:

Experience with Python or Bash scripting.
Familiarity with Apache Airflow or Control-M.
Experience with Databricks, Azure, AWS, Amazon S3, or AWS EMR.
Knowledge of Docker and Kubernetes.
Familiarity with code quality and security tools such as SonarQube.
Experience with HP ALM or similar software lifecycle management tools.
Previous experience in banking, financial services, or regulatory reporting.

Obowiązki

Design, develop, and maintain scalable backend and Big Data solutions for regulatory reporting.
Build and optimize Apache Spark applications, primarily using Scala.
Develop and maintain end-to-end ETL/ELT pipelines, including data ingestion, transformation, validation, and business logic.
Integrate data from multiple sources and support API- and microservices-based solutions.
Collaborate with Product Owners, Architects, Analysts, and development teams across different locations.
Participate in Agile/Scrum ceremonies and contribute to continuous delivery.
Ensure high code quality through unit testing, automation, code reviews, and CI/CD practices.
Document technical solutions and development activities using JIRA, Confluence, and ALM.
Identify opportunities to improve data processing performance, scalability, and reliability.

Inne informacje

The role requires one day in the Warsaw office every 1–2 months.

DCV Technologies

59 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz