Big Data Engineer (Spark or Flink + Scala/Kotlin/Java)

Comscore is a global leader in media analytics, focusing on insights into consumer behavior, media consumption, and digital engagement. They measure and analyze audiences across diverse digital platforms and collaborate with major industry players like Facebook, Disney, and Amazon, empowering businesses in media, advertising, e-commerce, and technology sectors.

• Strong experience debugging and optimizing big data pipelines with tools like Spark or Flink
• Solid understanding of performance characteristics and bottlenecks in big data
• Expertise in JVM languages: Scala, Java, or Kotlin
• Experience building systems in AWS or other cloud environments
• Proficiency in English for effective communication in an international team
• Ability to communicate technical design concepts and decisions clearly

• Design and build end-to-end big data processing pipelines and client-facing HTTP APIs
• Develop and debug petabyte scale systems using Scala ZIO/Tapir, Spark, AWS EMR, Airflow, Iceberg, Trino, Superset, PostgreSQL, and Redis
• Conduct proofs of concept for system enhancements