Senior Python Developer & Data Engineer | Krakow

Brak informacji o wynagrodzeniu

SeniorHybryda·KrakówFull-time·B2B

#466087·Dodano 2 dni temu·1

Źródło: justjoin.it

Aplikuj teraz

Tech Stack / Keywords

Python PySpark Databricks Oracle Java C#

Podsumowanie oferty

Design and maintain scalable data processing solutions and ETL pipelines, with a focus on performance, reliability, and data quality. The role combines Python and PySpark development with data engineering using Databricks and Oracle.

Wymagania

10+ years of overall experience in software development, data engineering, or a related technical role.
Strong hands-on experience in Python development.
Solid experience with PySpark and distributed data processing.
Proven experience developing and maintaining ETL pipelines and data integration solutions.
Practical experience with Databricks and large-scale data processing.
Strong knowledge of Oracle databases and SQL.
Experience working in Unix/Linux environments, including shell scripting.
Hands-on experience with AutoSys job scheduling and workflow monitoring.
Previous software development experience in Java or C#, with a solid understanding of object-oriented programming and software engineering principles.
Strong analytical, problem-solving, and debugging skills.
Experience working in Agile teams and collaborating with cross-functional stakeholders.
Excellent communication skills and the ability to work independently in a senior engineering role.

Nice to have:

Experience optimizing Spark jobs and processing large volumes of data.
Knowledge of data modelling, data warehousing, and data quality practices.
Experience with production support, incident management, and performance tuning.
Familiarity with CI/CD, Git, automated testing, and code review practices.
Experience working on enterprise-scale data platforms.

Obowiązki

Design, develop, and maintain scalable data processing applications using Python and PySpark.
Build, enhance, and optimize ETL/ELT pipelines for large-scale data integration and transformation.
Develop and maintain data engineering solutions using Databricks.
Work with Oracle databases, including complex SQL queries, data extraction, and performance optimization.
Develop and maintain Unix/Linux shell scripts to support data processing and automation.
Schedule, monitor, and troubleshoot batch jobs and workflows using AutoSys.
Analyze complex technical requirements and translate them into efficient, maintainable solutions.
Optimize application and pipeline performance, ensuring data accuracy, consistency, and reliability.
Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
Collaborate with data engineers, developers, architects, business analysts, and other stakeholders.
Participate in code reviews, technical design discussions, testing, and documentation.
Follow software development best practices, coding standards, and established delivery processes.

DCV Technologies

59 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz