Senior Data Engineer

IG Group is a FTSE 100 fintech company operating globally, serving over 1.4 million customers and focusing on scalable, trusted financial technology solutions. The Data Engineering team supports analytics, reporting, compliance, and client-facing data products, and powers AI and machine learning use cases across the firm.

• Proven hands-on experience building and operating production-grade data pipelines on GCP, including BigQuery, Cloud Composer/Airflow, GCS, and Cloud Run with strong SQL and Python skills.
• Solid experience with Apache Kafka or equivalent streaming technologies, including designing event-driven ingestion patterns and operational troubleshooting.
• Familiarity with modern transformation tooling, particularly dbt, and understanding of Medallion (Bronze/Silver/Gold) architecture patterns.
• Experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring.
• Comfortable working in regulated financial services environments with knowledge of data governance (lineage, access control, audit trails) and discipline in change control processes.

• Design and build robust batch and real-time data pipelines on GCP, including Kafka-based event streams, BigQuery transformations, and Airflow-orchestrated workflows.
• Own data quality by defining and implementing data contracts, quality checks, and observability instrumentation.
• Develop and maintain in-house connectors and third-party native integrations for data ingestion.
• Contribute to engineering standards and best practices, including code review, dbt modelling patterns, CI/CD pipeline hygiene, and change control.
• Support feature engineering and model data pipelines for Data Science and AI readiness, including lineage, reproducibility, and freshness guarantees for ML workloads.