Flink Data Engineer

Xebia is a global tech company with over 1,000 experts delivering cloud, data, and software solutions. Originating from two Polish companies, PGS Software and GetInData, Xebia works on projects across fintech, e-commerce, aviation, logistics, media, and fashion. Their clients include McLaren, Aviva, Deloitte, Spotify, Disney, ING, UPS, Tesco, Truecaller, and others. They use modern open-source stacks and are partners of Databricks, dbt, Snowflake, Azure, GCP, and AWS.

• Strong hands-on experience with Apache Flink, including development using the DataStream API
• Proven experience maintaining and upgrading Flink environments, ideally including exposure to Flink 2.0
• Deep understanding of streaming pipeline architecture, performance tuning, state management, and fault tolerance
• Experience migrating large-scale datasets from BigQuery to Data Cloud Storage
• Strong proficiency in data format conversion, particularly Avro to Parquet
• Ability to design, scale, and automate migration workflows ensuring data integrity and minimal service disruption
• Solid knowledge of Google Cloud Platform (GCP) and its data services
• Good understanding of distributed systems, schema evolution, and storage optimization strategies
• Ability to break down complex migration and platform challenges into clear, actionable steps
• Proactive mindset with strong ownership of solutions and risk identification
• Clear and effective communication skills, especially with non-technical stakeholders
• Understanding of how machine learning or intelligent automation can optimize and monitor data workflows
• Practical experience using AI-powered assistants (e.g., Claude Code, GitHub Copilot, Cursor) to improve productivity and quality

Nice to have:

• Experience working on high-scale, consumer-facing data platforms
• Background in long-running migration programs involving multiple data sources and formats
• Familiarity with observability, monitoring, and alerting for streaming systems
• Interest in and familiarity with emerging AI-driven practices and willingness to explore beyond standard approaches

• Developing and enhancing real-time streaming pipelines using Apache Flink
• Migrating existing Flink jobs using the DataStream API and adapting them to newer platform standards
• Leading and executing the upgrade of the Flink platform to version 2.0
• Designing, optimizing, and maintaining high-throughput, fault-tolerant streaming architectures
• Migrating large-scale datasets from BigQuery (BQ) to Data Cloud Storage (DCS)
• Scaling and automating ongoing data migration processes to support growing data volumes
• Converting datasets from Avro to Parquet format, with attention to performance, schema evolution, and storage optimization
• Leveraging AI-powered tools to accelerate migration, validation, and transformation workflows
• Ensuring data quality, integrity, and minimal downtime during migrations
• Collaborating with cross-functional teams and clearly communicating technical concepts to non-technical stakeholders

Work from the European Union region and a work permit are required.