Data Engineer
do 180 PLN/ godz.B2B (netto)
SeniorFull-time·B2B
#342661·Dodano miesiąc temu·0
Źródło: RITS Professional ServicesTech Stack / Keywords
Google CloudBigQuerySQLETLCI/CDGitJenkinsGCP
Firma i stanowisko
RITS Software House is a dynamic company within RITS Group that creates innovative IT solutions for clients in Poland and worldwide. The role involves working with Google Cloud BigQuery and modern technologies in a collaborative team environment.
Wymagania
- 3+ years of advanced SQL query writing and optimization experience in BigQuery, focusing on cost, time, and data integrity
- 3+ years of experience creating, testing, and deploying ETL/ELT pipelines, preferably using GCP Data Fusion
- Knowledge of Data Vault modeling and application
- Experience with Cloud Composer/Airflow, Cloud Run, Pub/Sub
- Programming skills in Python and Terraform
- Proficient use of Git for version control and collaboration
- Experience designing and maintaining CI/CD processes in DevOps tools (Ansible, Jenkins) for cloud applications
- Familiarity with DataOps and Agile methodologies
Nice to have:
- Designing and implementing data pipelines in GCP Data Fusion, CDAP, or similar tools, including parsing CSV, JSON, XML from various sources (REST, SOAP, SFTP)
- Knowledge of best practices for data contracts and ability to negotiate and document them independently
- Programming skills in Java, especially creating plugins for Data Fusion
- Experience with CI, CD, and continuous testing tools, especially for cloud solutions
Obowiązki
- Designing, building, testing, and deploying data models and transformations in BigQuery (including SQL, stored procedures, indexes, clusters, partitions, triggers, and more)
- Creating and managing ETL/ELT pipelines to model raw and unstructured data in a universal Data Vault model
- Reviewing, interpreting, and implementing business and technical requirements
- Ensuring non-functional requirements, IT standards, and developer tools support secure and scalable applications
- Monitoring data pipelines for failures and performance, responding quickly and optimizing ETL/ELT processes
- Integrating data from multiple sources ensuring data consistency and accuracy
- Managing code artifacts and CI/CD processes using tools such as Git, Jenkins, and Google Secrets Manager
- Debugging and improving during development and transferring knowledge to the support team
Oferta
- 100% remote work
- Hourly rate up to 180 PLN
- Dynamic work environment in one of the fastest-growing technology companies
- Opportunities for continuous development of technical and soft skills
- Collaboration with a supportive and engaged team
RITS Professional Services
109 aktywnych ofert