Data Engineer - Data Platform

Allegro is developing the Vento service, which standardizes and validates all clickstream events to ensure high-quality data for AI agents and core business dashboards. The team works with a large-scale data ecosystem including over 1000 microservices, an open-source data bus (Hermes), and production machine learning.

• Solid, production-proven experience in Big Data ecosystems and building stable data pipelines.
• Proficiency in Python and Spark; Scala is a nice to have.
• Openness to navigating or aligning with Java backend applications.
• Understanding of data quality principles, event contract validation, anomaly detection, and data processing within streaming environments (Clickstream).
• Proactive communication skills and high autonomy in task ownership.
• Broad technical perspective on Big Data, Backend, and Frontend interconnections.
• Enthusiasm for utilizing AI coding tools to automate repetitive tasks.
• Polish language proficiency at minimum C1 level.
• English language proficiency at minimum B2 level.

• Designing, scaling, developing, and maintaining data validation pipelines for high-volume clickstream data within the Vento service.
• Implementing robust anomaly detection mechanisms to ensure data integrity and quality processing before ingestion into the core Data Assets layer.
• Collaborating with cross-functional stakeholders to reconcile data requirements.
• Actively participating in engineering discussions, code reviews, and cross-team initiatives.