Link Group

Big Data Engineer Scala,spark

21k - 25k PLN21 000 - 25 000 PLN/ mies./ mies.B2BB2B (netto)

MidZdalnieFull-time·B2B

#391266·Dodano 4 miesiące temu·26

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

Big data Scala Spark Hadoop Kafka SQLNoSQLGit ETLCloud platformAWS Azure GCP Docker Kubernetes CI/CD Pipelines

Firma i stanowisko

Link Group specializes in building tech teams for Fortune 500 companies and exciting startups. The project involves building a high-performance data platform for the finance/stock exchange industry, focusing on processing massive datasets to enable real-time analytics and decision-making.

Wymagania

At least 3+ years of experience in big data engineering.
Proficiency in Scala and experience with Apache Spark.
Strong understanding of distributed data processing and frameworks like Hadoop.
Experience with message brokers like Kafka.
Hands-on experience with SQL/NoSQL databases.
Familiarity with version control tools like Git.
Solid understanding of data architecture and ETL processes.
Good command of English.

Nice to have:

Experience with cloud platforms such as AWS, Azure, or GCP.
Knowledge of containerization tools like Docker and orchestration with Kubernetes.
Familiarity with CI/CD pipelines for big data workflows.
Experience in optimizing Spark jobs for large-scale data processing.
Academic background in Computer Science, Data Engineering, or a related field.

Obowiązki

Design, implement, and optimize big data processing pipelines using Scala and Spark.
Work with massive datasets, ensuring scalability and performance.
Collaborate with data scientists and analysts to develop data solutions.
Monitor and troubleshoot data workflows to ensure reliability and efficiency.
Integrate with data sources and ensure proper data ingestion and transformation.
Research emerging big data technologies to improve the architecture.

Benefity

Tailored opportunities to match your professional interests and goals.
A leadership role in a dynamic and collaborative work environment.
Access to exciting and diverse projects for global clients.
Competitive compensation aligned with your expertise.
Ongoing opportunities for professional growth and development.

Link Group

545 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz