Data Engineer (Stores/Customer Order)

The Data Engineering department at Tesco Technology focuses on data processing in the retail and technology industry. The team analyzes order and delivery data to optimize logistics and manage critical data related to customer orders, suppliers, and products to ensure smooth fulfillment operations. The department also maintains data integrity and security for order and delivery information. The role involves expanding and refining data pipeline architecture to optimize data flow for cross-functional teams.

• Experience with data processing using Apache Spark in Scala or Python
• Knowledge of data storage technologies such as Apache HDFS, CEPH S3, or cloud alternatives
• Familiarity with resource managers like Apache Yarn or cloud equivalents
• Experience with lakehouse technologies such as Apache Hive or Kyuubi
• Competence with workflow schedulers like Airflow or alternatives

Nice to have:

• Functional programming
• Experience with Apache Kafka
• Familiarity with Kubernetes
• Stream processing knowledge
• CI/CD experience

• Create and maintain optimal data pipeline architecture
• Assemble large complex data sets meeting functional and non-functional business requirements
• Identify and implement internal process improvements such as automating manual processes and redesigning infrastructure for scalability
• Build infrastructure for extraction, transformation, and loading of data from various sources
• Develop analytics tools leveraging data pipelines to provide insights into customer acquisition and operational efficiency
• Collaborate with stakeholders including Executive, Product, Data, and Design teams to resolve data-related technical issues
• Ensure data is separated and secure
• Create data tools to assist analytics and data scientist teams in optimizing products
• Work with data and analytics experts to enhance data system functionality

This role requires the candidate to be located in or near Kraków, Poland, as approximately 60% of time is spent onsite in the office or local sites with the rest remote.