Antal

Data Engineer

185 - 215 PLN/ godz./ godz.B2BB2B (netto)

MidHybryda·KrakówFull-time·B2B

#316442·Dodano 7 miesięcy temu·5

Źródło: Antal

Aplikuj teraz

Tech Stack / Keywords

Big Data ETL Hadoop Spark Hive AgileArchitecturePySpark

Firma i stanowisko

Antal is a leading recruitment and HR advisory company, present in Poland since 1996 and later expanded to the Czech Republic and Hungary. Across the CEE region, we employ around 150 professionals who deliver a full range of services – from specialist and executive recruitment, employee outsourcing and HR consulting, to employer branding and market research.

Our division-based structure combines deep industry expertise with functional specialisation, enabling us to provide tailored solutions for companies in every sector. We act as a trusted partner for both employers and candidates, sharing our knowledge and guiding them through every stage of the talent journey. We connect exceptional people with the right opportunities and help organisations build successful teams.

Wymagania

5+ years of experience in software design and development, preferably in Pyspark or Scala.
Hands-on experience building data pipelines using Hadoop ecosystem components (Hive, Spark, Spark SQL).
Experience with scheduling tools such as Airflow.
Strong knowledge of Unix/Linux platforms.
Experience with big data frameworks: Apache Hadoop, Apache Spark, YARN, Hive, Python, ETL frameworks, MapReduce, SQL, RESTful services.
Familiarity with version control (Git/GitHub), automated deployment tools (Ansible, Jenkins), and requirement management (Jira).
Strong analytical and debugging skills.

Nice to have:

Experience with Elasticsearch and Java API development.
Knowledge of cloud platforms and cloud design patterns.
Experience with data ingestion processes.
Exposure to DevOps and Agile methodologies (Scrum, Kanban).

Obowiązki

Collaborate with Engineers, Data Analysts, and Business Analysts to design, develop, and operate data pipelines and systems.
Implement tools and processes to handle performance, scale, availability, accuracy, and monitoring of data platforms.
Build and maintain ETL processes, using Hadoop, Spark, Hive, and other big data components.
Ensure requirements are correctly interpreted and implemented by liaising with BAs.
Promote development standards through code reviews, mentoring, and knowledge sharing.
Participate in Agile ceremonies, including sprint planning, reviews, and retrospectives.
Provide production support, troubleshoot issues, and contribute to improving system reliability.
Contribute to system architecture and design decisions.

Benefity

Long-term cooperation on an enterprise-scale international project.
Exposure to modern technologies and microservices-based architectures.
Real influence on the development of internal engineering platforms.
Private medical care (LuxMed) & Multisport card.

Opieka zdrowotna

Karta sportowa

Antal

827 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz