Senior Software Engineer with Data Quality

The team is responsible for developing and maintaining a key data processing platform with a focus on DevOps initiatives and R&D. The candidate will take ownership of the Data Quality area, impacting data quality delivered to clients. The role involves analysing and eliminating data quality issues and building solutions to prevent recurrence, working in a high-autonomy environment alongside experienced engineers. The project emphasizes offline solutions for data quality that do not affect production performance.

• Strong experience with SQL and BigQuery.
• Proficiency in JVM backend development with Kotlin, Java, and Spring Boot.
• Experience or mindset focused on data quality, observability, and preventative monitoring.
• Ability to build automation for data remediation and monitoring, beyond running queries.
• Fluent English for direct cooperation with the US team.
• Comfortable working with legacy systems and ambiguous requirements.

Nice to have:

• Knowledge of Apache Beam, Dataflow, Kafka, Snowflake, and Bigtable.
• Experience with statistical validation and anomaly detection techniques.

• Find data cohorts in BigQuery, identify data quality issues, and fix them at scale.
• Build remediation tooling and automated checks on the JVM backend using Kotlin, Java, and Spring Boot.
• Develop data quality monitors, tests, or anomaly detection systems.
• Take vague tickets, scope, deliver solutions, and propose next steps with ownership and autonomy.
• Work directly with a remote US team using fluent English.
• Manage legacy, latency-sensitive systems with statistical validation offline.

Challenges:

• Handle high-performance data processing and large-scale systems.
• Work with modern cloud technology stacks.

Team:

• Collaborate as the third member of the Data Quality team focused on improving data quality.