Nowa
Data Engineer
150 - 170 PLN/ godz.B2B (netto)
SeniorFull-time·B2B
#347284·Dodano wczoraj·0
Źródło: itfs.elevato.netTech Stack / Keywords
Big DataSparkScalaHadoopPythonLinuxHiveSQL
Firma i stanowisko
ITFS is a company offering a stable market position and additional benefits such as medical and sports packages and free accounting services (up to 3 entries per month).
Wymagania
- Minimum 5 years of commercial experience in Data Engineering or Big Data
- Very good knowledge of Spark and Scala for processing large data volumes
- Advanced knowledge of Python for building and maintaining data pipelines
- Proficiency in Linux environment
- Experience with distributed data processing systems and Big Data platforms
- Practical knowledge of Hadoop ecosystem including Hive, Oozie, and MapReduce
- Very good knowledge of SQL and working with databases
- Ability to design, create, and develop data flows
- Very good knowledge of version control systems Git and Bitbucket
- Experience with unit testing (JUnit 5, Mockito, Spark testing)
- Ability to work in an environment requiring high code quality and process automation
- English language proficiency enabling fluent communication (minimum B2+)
Nice to have:
- Knowledge of code versioning strategies and branching
- Experience working in Agile/SAFe environments
- Knowledge of Continuous Delivery in Big Data environments
- Additional experience with Java combined with Spark and Python
Obowiązki
- Build and develop distributed Big Data pipelines for processing large volumes of structured and unstructured data in near real-time
- Develop and maintain data processing workflows using Spark and Scala
- Create and develop data flows supporting decision-making processes and data products
- Maintain and develop solutions based on Hadoop and Big Data platforms
- Automate processes ensuring their repeatability and reliability
- Collaborate with technical teams to deliver and maintain data engineering solutions
Oferta
- Transparent cooperation conditions in a company with a stable market position
- Access to additional benefits including medical and sports packages
- Free accounting services (up to 3 entries per month)
ITFS
147 aktywnych ofert