Data Engineer (Fulfillment)

The Data Engineering department at Tesco Technology drives data processing across retail and technology operations, analyzing order and delivery data to optimize logistics, managing critical information on customers, suppliers, and products, and safeguarding data integrity and security throughout fulfillment.

Mandatory skills:

• Data Processing: Apache Spark with Scala or Python
• Data Storage: Apache HDFS, CEPH S3, or respective cloud alternative
• Resource Manager: Apache Yarn or respective cloud alternative
• Lakehouse: Apache Hive/Kyuubi or alternative
• Workflow Scheduler: Airflow or alternative

Nice to have skills:

• Functional programming
• Apache Kafka
• Kubernetes
• Stream processing
• CI/CD

• Create and maintain optimal data pipeline architecture
• Assemble large complex data sets that meet functional and non-functional business requirements
• Identify, design, and implement internal process improvements such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
• Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Keep data separated and secure
• Create data tools for analytics and data scientist team members to assist them in building and optimizing the product
• Collaborate with data and analytics experts to strive for greater functionality in data systems

This role requires you to be based in or near Kraków, as you will spend 60% (3 days) of your week collaborating with colleagues at office locations or local sites and the rest remotely.