Data Engineer (Stores/Customer Order)

Brak informacji o wynagrodzeniu

NieokreśloneHybryda·KrakówFull-time

#471104·Dodano 5 dni temu·5

Źródło: Tesco Technology

Aplikuj teraz

Tech Stack / Keywords

Apache Spark Scala PythonApache HDFSCEPH S3Apache YarnApache HiveAirflow Apache Kafka Kubernetes

Podsumowanie oferty

As a Data Engineer, you will expand and refine data and data pipeline architecture supporting Tesco’s stores and customer order operations. You will optimize data flow and collection and build data infrastructure for cross-functional teams, using Apache Spark with Scala or Python.

Wymagania

Data processing: Apache Spark — Scala or Python.
Data storage: Apache HDFS, CEPH S3, or a respective cloud alternative.
Resource manager: Apache Yarn or a respective cloud alternative.
Lakehouse: Apache Hive/Kyuubi or an alternative.
Workflow scheduler: Airflow or an alternative.

Nice to have:

Functional programming.
Apache Kafka.
Kubernetes.
Stream processing.
CI/CD.

Obowiązki

Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional and non-functional business requirements.
Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
Build infrastructure for extracting, transforming, and loading data from a wide variety of data sources.
Build analytics tools that use the data pipeline to provide insights into customer acquisition, operational efficiency, and other business performance metrics.
Work with stakeholders, including the Executive Product Data and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
Keep data separated and secure.
Create data tools for analytics and data scientist team members to help them build and optimize the product.
Work with data and analytics experts to improve the functionality of data systems.

Tesco Technology

22 aktywne oferty

Zobacz wszystkie oferty

Aplikuj teraz