Lead Data Engineer / DataOps – Snowflake & AWS Data Platform

140 - 170 PLN/ godz.B2B
SeniorFull-time·B2B
#384022·Dodano wczoraj·0
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

DataData engineeringGitLab CI/CDCI/CD PipelinesAutomationPythonData manipulationAutomation scriptingData processing workflowsSQLSnowflakeAmazon RedshiftGoogle BigQueryBashAutomated testingETLData integrationTalenddbtData mesh priciplesMonte CarloCollibraImmuta

Firma i stanowisko

Square One Resources is recruiting an experienced Data Engineer / DataOps Specialist to join a data engineering team responsible for building and automating modern data products within a cloud-based data platform.

Wymagania

  • Minimum 3–4 years experience as a Data Engineer, DataOps Engineer, or similar role.
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or related technical field.
  • Strong hands-on experience with modern data engineering practices and cloud-based data platforms.
  • Strong experience with GitLab CI/CD pipelines and workflow orchestration.
  • Proficiency in Python for data manipulation, automation scripting, and data workflows.
  • Advanced SQL skills with experience in analytical databases.
  • Experience with Snowflake, Amazon Redshift, or Google BigQuery.
  • Experience writing and maintaining Bash scripts.
  • Ability to design and implement automated tests ensuring data quality and reliability.
  • Experience with ETL and data integration processes; experience with Talend or similar ETL platforms is an advantage.

Nice to have:

  • Experience with dbt (Data Build Tool).
  • Understanding of Data Mesh principles.
  • Familiarity with data governance tools: Monte Carlo, Collibra, Immuta.
  • Experience in enterprise-scale data environments.
  • Previous experience as a technical lead or driving technical decisions.

Obowiązki

  • Design, develop, and maintain data products using Snowflake and AWS S3.
  • Build and optimize scalable data pipelines orchestrated via GitLab CI/CD.
  • Automate data workflows and integrations based on SAP HANA views.
  • Develop Python scripts and automation solutions for data processing and operations.
  • Write efficient and optimized SQL queries for analytical data processing.
  • Implement data quality frameworks, validation processes, and automated testing.
  • Collaborate with business stakeholders and technical teams to deliver effective data solutions.
  • Act as a technical leader, defining engineering standards, reviewing solutions, and promoting best practices.
  • Evaluate and recommend new technologies and tools to improve data platform capabilities.
  • Support continuous improvement of data delivery, automation, and operational excellence.

Benefity

  • Sport subscription
  • Private healthcare
Karta sportowa
Opieka zdrowotna
SQUARE ONE RESOURCES

SQUARE ONE RESOURCES

132 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz