Lead Data Engineer / DataOps – Snowflake & AWS Data Platform
140 - 170 PLN/ godz.B2B
SeniorFull-time·B2B
#384022·Dodano wczoraj·0
Źródło: nofluffjobs.comTech Stack / Keywords
DataData engineeringGitLab CI/CDCI/CD PipelinesAutomationPythonData manipulationAutomation scriptingData processing workflowsSQLSnowflakeAmazon RedshiftGoogle BigQueryBashAutomated testingETLData integrationTalenddbtData mesh priciplesMonte CarloCollibraImmuta
Firma i stanowisko
Square One Resources is recruiting an experienced Data Engineer / DataOps Specialist to join a data engineering team responsible for building and automating modern data products within a cloud-based data platform.
Wymagania
- Minimum 3–4 years experience as a Data Engineer, DataOps Engineer, or similar role.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related technical field.
- Strong hands-on experience with modern data engineering practices and cloud-based data platforms.
- Strong experience with GitLab CI/CD pipelines and workflow orchestration.
- Proficiency in Python for data manipulation, automation scripting, and data workflows.
- Advanced SQL skills with experience in analytical databases.
- Experience with Snowflake, Amazon Redshift, or Google BigQuery.
- Experience writing and maintaining Bash scripts.
- Ability to design and implement automated tests ensuring data quality and reliability.
- Experience with ETL and data integration processes; experience with Talend or similar ETL platforms is an advantage.
Nice to have:
- Experience with dbt (Data Build Tool).
- Understanding of Data Mesh principles.
- Familiarity with data governance tools: Monte Carlo, Collibra, Immuta.
- Experience in enterprise-scale data environments.
- Previous experience as a technical lead or driving technical decisions.
Obowiązki
- Design, develop, and maintain data products using Snowflake and AWS S3.
- Build and optimize scalable data pipelines orchestrated via GitLab CI/CD.
- Automate data workflows and integrations based on SAP HANA views.
- Develop Python scripts and automation solutions for data processing and operations.
- Write efficient and optimized SQL queries for analytical data processing.
- Implement data quality frameworks, validation processes, and automated testing.
- Collaborate with business stakeholders and technical teams to deliver effective data solutions.
- Act as a technical leader, defining engineering standards, reviewing solutions, and promoting best practices.
- Evaluate and recommend new technologies and tools to improve data platform capabilities.
- Support continuous improvement of data delivery, automation, and operational excellence.
Benefity
- Sport subscription
- Private healthcare
Karta sportowa
Opieka zdrowotna
SQUARE ONE RESOURCES
132 aktywne oferty