Data Engineer (Google Cloud)
140 - 150 PLN/ godz.B2B
MidFull-time·B2B
#369507·Dodano dziś·0
Źródło: nofluffjobs.comTech Stack / Keywords
Google Cloud PlatformGCPBig dataBigQueryPythonRustKafkaETLData LakeDWHPUBsubGenAIAIKubernetesOpenShiftOraclePostgreSQLApache AirflowApache SparkApache BeamAutomateNowGCP DataFlowInformatica PowerCenterGCP Data Proc
Wymagania
- Knowledge of building ETL/ELT pipelines
- Experience in building and designing Data Lake and Data Warehouse solutions
- Knowledge of event-driven architecture technologies such as Kafka and Pub/Sub
- Knowledge of Big Data solutions utilizing GenAI capabilities
- Knowledge of Google BigQuery
- Knowledge of Kubernetes, preferably Google Kubernetes Engine and OpenShift
- Knowledge of relational databases Oracle and PostgreSQL (design, building, and tuning)
- Proficient knowledge of Python and/or Rust
- Good knowledge of Apache Airflow
Nice to have:
- Knowledge of data mesh concepts, vector and graph databases
- Knowledge of Apache Spark (preferably GCP Data Proc), Apache Beam (preferably GCP DataFlow), AutomateNow, Informatica PowerCenter
Obowiązki
- Building Data Lake and Data Warehouse solutions and data feeding processes both online and offline
- Designing and implementing IT solutions in the area of data feeding
- Analyzing data and preparing logical and physical models
- Tuning SQL queries on relational and warehouse databases in on-premises and GCP environments
- Creating offline and online data flows using on-premises and GCP tools
- Developing data loading solutions in Python and Rust for structured and unstructured data
- Preparing thematic datamarts on relational and columnar databases
- Developing concepts and implementing solutions based on business requirements
- Incident removal and participation in problem resolution
- Supporting testing and deployment of changes in data feeding processes
- Supporting maintenance of deployed software
- Working according to the DevSecOps model
Oferta
- Private healthcare
- Sports card co-financing
- Trainings
- Continuous support from a consultant
- Employee referral program
- Sport subscription
Opieka zdrowotna
Karta sportowa
Dofinansowanie szkoleń
DCG
360 aktywnych ofert