Expert GCP Data Engineer – Cloud Data Pipeline & ETL Specialist
~19.9k - 23k PLN19 900 - 23 000 PLN/ mies.B2B
Brak informacji o wynagrodzeniu
SeniorFull-time·B2B·Umowa o pracę
#399840·Dodano 3 dni temu·0
Źródło: ITDSTech Stack / Keywords
PLSQL (Oracle)PythonSQL
Firma i stanowisko
Leading organization in cloud data solutions.
Wymagania
- Over 10 years of IT experience focusing on Data Engineering
- Hands-on experience with GCP services: Dataflow, BigQuery, Cloud SQL, Cloud Storage, Cloud Composer/Airflow, Pub/Sub
- Proficiency in Python programming
- Expertise in Apache Beam and data pipeline performance tuning
- Solid database skills in PostgreSQL and PL/SQL
- Understanding of Google Cloud SDK, APIs, and scripting
- Experience with performance optimization of data pipelines and SQL
- Knowledge of DevOps concepts, CI/CD pipelines, and version control (Git)
Nice to have:
- Experience with Dataproc
- Exposure to large-scale distributed datasets and event-driven architectures
- Strong communication skills for engagement with clients and business stakeholders
Obowiązki
- Design, develop, and maintain batch and streaming data pipelines using GCP services
- Build ETL/ELT workflows leveraging Dataflow (Apache Beam) and Python
- Develop and optimize data models and queries in PostgreSQL and PL/SQL
- Implement orchestration workflows with Airflow/Cloud Composer
- Integrate data from multiple sources into BigQuery and Cloud SQL for analytics and reporting
- Ensure data quality, validation, monitoring, and pipeline reliability
- Collaborate with business, analytics, and application teams to translate requirements into technical solutions
- Follow Agile and DevOps practices for CI/CD, testing, deployment, and support using tools like Git and Jenkins
Inne informacje
Only candidates with an existing legal right to work in the European Union will be considered for this role.
ITDS
303 aktywne oferty