Data Engineer ze znajomością przetwarzania danych niestrukturalnych
Brak informacji o wynagrodzeniu
MidFull-time
#368576·Dodano dziś·0
Źródło: nofluffjobs.comTech Stack / Keywords
Data LakePythonRustKafkaPUBGCPOraclePostgreSQLLinuxBigDataAirflowApache SparkInformatica
Firma i stanowisko
PKO Finat Sp. z o.o. is expanding its team within PKO BP bank, focusing on data engineering with unstructured data processing such as audio, images, and text documents.
Wymagania
- Experience in building and designing Data Lake solutions
- Programming skills in Python and/or Rust
- Knowledge of event-driven architecture technologies like Kafka and Pub/Sub
- Good knowledge of GCP databases, especially Big Query (design, build, tuning)
- Knowledge of Oracle and PostgreSQL databases (design, build, tuning)
- Advanced user knowledge of Linux operating system
Nice to have:
- Experience with BigData solutions using GenAI for unstructured data processing (audio transcriptions, document and image conversions)
- Knowledge of Automate Now
- Experience with AirFlow
- Experience with Apache Spark, preferably GCP Data Proc
- Experience with Apache Beam, preferably GCP DataFlow
- Knowledge of Informatica Power Center
Obowiązki
- Build and design Data Lake solutions
- Program in Python and/or Rust
- Work with event-driven architecture technologies such as Kafka and Pub/Sub
- Design, build, and tune databases in GCP Big Query, Oracle, and PostgreSQL
- Use Linux at an advanced user level
Oferta
- B2B contract
- Hybrid work mode (Warsaw office and remote)
Inne informacje
- Work authorization: B2B contract
- Work mode: hybrid (Warsaw, Chmielna 89) or remote, to be agreed
PKO Finat Sp. z o.o.
24 aktywne oferty