Data Engineer Data Lake

MakeITRight is executing a strategic project for one of the largest banks in Poland, focusing on modern data platforms and unstructured data processing such as audio recordings, text documents, and images. The project involves Big Data, Google Cloud Platform, and AI technologies including Generative AI.

• Experience designing and building Data Lake solutions.
• Strong knowledge of Python and/or Rust.
• Experience with event-driven architectures, especially Apache Kafka or Google Pub/Sub.
• Practical knowledge of Google BigQuery (design, build, optimization).
• Experience with Oracle and PostgreSQL databases.
• Strong Linux system knowledge.
• Ability to design efficient solutions for processing large data volumes.

Nice to have:

• Experience processing unstructured data using Generative AI technologies (audio transcription, text document analysis, image processing).
• Knowledge of Apache Spark, especially Google Cloud Dataproc.
• Experience with Apache Beam and Google Cloud Dataflow.
• Knowledge of Airflow.
• Experience with AutomateNow.
• Knowledge of Informatica PowerCenter.

• Design, develop, and maintain Data Lake solutions.
• Create efficient pipelines for processing structured and unstructured data (audio, images, text documents).
• Design and optimize databases in Google Cloud Platform.
• Develop data integration processes and event-driven architecture.
• Collaborate with Data Science, AI, and Software Engineering teams to build modern data platforms.
• Optimize ETL/ELT processes and Big Data environments.
• Co-develop solutions supporting Generative AI technologies.