Data Engineer with GCP
145 - 165 PLN/ godz.B2B
SeniorInne·B2B
#430511·Dodano 7 dni temu·0
Źródło: justjoin.itTech Stack / Keywords
GCPPythonPostgreSQLPL/SQLApache Beam
Firma i stanowisko
Clurgo is a company created by developers for developers, offering a range of IT projects across various industries, focusing on software development, infrastructure, analysis, testing, and strategic product and process management.
Wymagania
- Minimum 10 years of IT industry experience including strong background in Data Engineering
- Practical experience with Google Cloud Platform (GCP) services
- Proficiency in Python programming
- Strong knowledge of SQL, PostgreSQL, and PL/SQL
- Experience with Apache Beam
- Good understanding of Google Cloud SDK, APIs, and scripting
- Basic DevOps knowledge including Git, CI/CD, and release processes
Nice to have:
- Knowledge of Dataproc
- Experience working with large distributed data sets
- Experience with streaming and event-driven architectures
- Experience collaborating directly with clients and business stakeholders
Obowiązki
- Design, develop, and maintain batch and streaming data pipelines using GCP services
- Build ETL/ELT processes with Dataflow, Apache Beam, and Python
- Design and optimize data models and queries in PostgreSQL and PL/SQL
- Create and maintain orchestration workflows in Airflow / Cloud Composer
- Integrate data from multiple sources for analytics and reporting in BigQuery and Cloud SQL
- Ensure data quality, validation, monitoring, and pipeline reliability
- Optimize processing performance and SQL query efficiency
- Collaborate with business, analytics, and application teams to translate requirements into technical solutions
- Apply Agile and DevOps practices including CI/CD, testing, deployment, and maintenance
- Work with Git and Jenkins in DevOps processes
Benefity
- B2B contract
- Hybrid work schedule: 8 days per month onsite in Kraków
- Professional recruitment process with feedback regardless of outcome
Inne informacje
Administrator of personal data is Clurgo sp. z o.o based in Warsaw. Candidates have rights regarding their personal data under applicable law. Data is processed for recruitment purposes, with certain data mandatory under labor law. Personal data processing complies with legal obligations and consent. Data will be processed until recruitment ends or consent is withdrawn. Data recipients include Rocket Jobs and subcontractors related to recruitment.
Clurgo
89 aktywnych ofert