Acaisoft

Data Engineer with Snowflake

120 - 160 PLN/ godz./ godz.B2BB2B (netto)

MidZdalnie·WarszawaFull-time·B2B

#467103·Dodano 8 dni temu·2

Źródło: nofluffjobs.com

Aplikuj teraz

Tech Stack / Keywords

Python Snowflake AWS SQLAILLMs Databricks

Podsumowanie oferty

Build and optimise a Snowflake data evaluation pipeline for a financial data analytics project, assessing the quality and added value of new credit card transaction datasets. Own the pipeline end to end, from data processing and ground truth collection to quality validation and ongoing evaluations.

Wymagania

3+ years of experience in Data Engineering, with Snowflake as a primary data platform.
Hands-on experience optimising Snowflake warehouses and storage for performance and cost efficiency in production environments.
Experience building and optimising pipelines processing very large datasets, including full transaction-level histories rather than samples.
SQL and Python skills, with the ability to own data pipelines end to end.

Nice to have:

Experience working with financial, market, transaction-level, or time-series data.
Familiarity with accuracy and tracking metrics such as correlation and mean absolute error (MAE).
Experience integrating and maintaining third-party data feeds or working with data licensing and data-sharing arrangements.
Practice with dbt or similar data transformation frameworks on Snowflake.

Obowiązki

Build and maintain a Snowflake-based evaluation pipeline to measure the accuracy of new datasets, both independently and combined with existing data.
Implement evaluation metrics such as correlation and mean absolute error (MAE) to compare estimated company revenue against reported results.
Optimise Snowflake performance and compute costs through warehouse sizing, clustering, materialisation, query optimisation, and data pruning.
Develop automated processes for collecting, mapping, validating, and maintaining ground truth company revenue data.
Implement data quality checks, reconciliation rules, and monitoring to identify inconsistencies before they affect downstream reporting.
Evaluate new datasets as they become available and investigate data quality issues.
Own the pipeline end to end, making technical decisions and adapting the implementation as project requirements evolve.
Build on existing prototypes and previous work to deliver a reliable, production-ready solution.

Inne informacje

Availability between 5:00 PM and 10:00 PM CET is essential during onboarding; afterwards, working hours end between 5:00 PM and 7:00 PM CET, depending on the day.

Acaisoft

27 aktywnych ofert

Zobacz wszystkie oferty

Aplikuj teraz