Data Engineer
130 - 200 PLN/ godz.B2B
MidFull-time·B2B
#427504·Dodano 26 dni temu·5
Źródło: DevelocraftTech Stack / Keywords
PythonSQLTerraformAWS Glue
Firma i stanowisko
Develocraft is looking for a Data Engineer for a client operating in the financial services sector. The project involves rebuilding the data platform behind the UK’s leading automotive marketing products, focusing on campaign, vehicle, and dealership data flow.
Wymagania
- 3–5 years of experience building data pipelines and managing production databases with end-to-end ownership.
- Expert-level SQL skills with production experience in SQL Server (T-SQL) and at least one columnar data warehouse such as Redshift, Snowflake, or BigQuery.
- Hands-on experience with dbt or similar data transformation frameworks, Python for data engineering, and orchestration/ETL tools like AWS Glue, Airflow, or Step Functions.
- Experience with infrastructure as code tools such as Terraform, CloudFormation, or CDK, and CI/CD pipelines.
- Proven experience migrating data workloads between platforms with safe execution including validation and reconciliation.
- Comfortable working in English with UK-based stakeholders and documenting data pipelines for operational use.
Obowiązki
- Re-engineer the marketing data pipeline using a modern analytics stack, including ingestion, dbt-based transformations, and Redshift warehouse models.
- Take ownership of the production database estate, managing performance, integrity, security, and costs.
- Introduce CI/CD for database development with version-controlled, tested, and deployable schema changes.
- Build automated data-quality processes and migrate legacy SFTP workflows to AWS Transfer Family.
- Develop repeatable ingestion templates and validation processes for automated client onboarding.
- Use AI tooling such as Claude daily for query optimization, pipeline debugging, and documentation.
Develocraft
29 aktywnych ofert