Data Engineer

130 - 200 PLN/ godz.B2B
MidFull-time·B2B
#427504·Dodano 26 dni temu·5
Źródło: Develocraft
Aplikuj teraz

Tech Stack / Keywords

PythonSQLTerraformAWS Glue

Firma i stanowisko

Develocraft is looking for a Data Engineer for a client operating in the financial services sector. The project involves rebuilding the data platform behind the UK’s leading automotive marketing products, focusing on campaign, vehicle, and dealership data flow.

Wymagania

  • 3–5 years of experience building data pipelines and managing production databases with end-to-end ownership.
  • Expert-level SQL skills with production experience in SQL Server (T-SQL) and at least one columnar data warehouse such as Redshift, Snowflake, or BigQuery.
  • Hands-on experience with dbt or similar data transformation frameworks, Python for data engineering, and orchestration/ETL tools like AWS Glue, Airflow, or Step Functions.
  • Experience with infrastructure as code tools such as Terraform, CloudFormation, or CDK, and CI/CD pipelines.
  • Proven experience migrating data workloads between platforms with safe execution including validation and reconciliation.
  • Comfortable working in English with UK-based stakeholders and documenting data pipelines for operational use.

Obowiązki

  • Re-engineer the marketing data pipeline using a modern analytics stack, including ingestion, dbt-based transformations, and Redshift warehouse models.
  • Take ownership of the production database estate, managing performance, integrity, security, and costs.
  • Introduce CI/CD for database development with version-controlled, tested, and deployable schema changes.
  • Build automated data-quality processes and migrate legacy SFTP workflows to AWS Transfer Family.
  • Develop repeatable ingestion templates and validation processes for automated client onboarding.
  • Use AI tooling such as Claude daily for query optimization, pipeline debugging, and documentation.
Develocraft

Develocraft

29 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz