GFT Poland

Senior Data Consultant (Hadoop, Spark)

125 - 163 PLN/ godz./ godz.B2BB2B (netto)

SeniorHybryda·KrakówFull-time·B2B

#369914·Dodano 4 miesiące temu·30

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

PySpark Scala Airflow Hadoop Spark Hive Yarn ETL SQL REST Unix LinuxData pipelinesGit GitHub Jenkins Ansible Jira Big data ElasticsearchJava APIsDevOpsSpark StreamingApache Airflow Python PL/SQL

Firma i stanowisko

GFT Poland is hiring for a senior data consultant role based in Kraków, Poland, working on international projects involving big data technologies and scalable data solutions.

Wymagania

Experience with PySpark or Scala development and design
Experience using scheduling tools such as Airflow
Knowledge of Hadoop ecosystem including Spark, Hive, YARN, and ETL frameworks
Strong SQL and RESTful services knowledge
Experience working on Unix or Linux platforms
Hands-on experience building data pipelines using Hadoop components
Experience with Git, GitHub, Jenkins, Ansible, and JIRA
Understanding of big data modelling using relational and non-relational techniques
Experience debugging code and communicating findings to development teams

Nice to have:

Experience with Elasticsearch
Experience developing Java APIs
Experience in data ingestion processes
Understanding of cloud design patterns
Exposure to DevOps and Agile methodologies such as Scrum and Kanban
Experience with Spark streaming
Experience with Apache Airflow in production
Experience with Hadoop ecosystem in enterprise environments
Knowledge of Python backend services
Experience with Scala for high performance systems
Experience in data integration and ETL processes
Knowledge of PL/SQL
Experience with Linux and Unix system operations

Obowiązki

Define and contribute to software design and development using PySpark
Automate testing of new and existing components
Promote development standards through code reviews and mentoring
Provide production support and troubleshooting
Implement tools and processes ensuring performance, scalability, and monitoring
Collaborate with Business Analysts to interpret and implement requirements
Participate in planning, sprint reviews, and retrospectives
Contribute to system architecture and design

Benefity

Home office
Knowledge sharing
Life insurance
Sport subscription
Training budget
Private healthcare
International projects
Integration events
Free coffee
Playroom
Free snacks
Free beverages
In-house trainings
In-house hack days
Modern office
Free fruits

Karta sportowa

Ubezpieczenie

Dofinansowanie szkoleń

Opieka zdrowotna

Spotkania integracyjne

Napoje w biurze

Darmowe przekąski

Szkolenia wewnętrzne

Inne informacje

Openness to work 2 days a week from our client's office (Kraków)

GFT Poland

91 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz