Lead Distributed Data Platform Engineer

Relativity is a diverse workplace committed to competitive, fair, and equitable compensation practices.

• Proven experience leading technical teams in data engineering or platform development
• Strong programming skills in Python and SQL
• Hands-on experience with Apache Spark for distributed data processing
• Expertise in Delta Lake and/or Apache Iceberg for lakehouse architecture
• Familiarity with dbt, Databricks, and Snowflake for analytics workflows
• Solid understanding of software engineering principles, CI/CD, and automated testing
• Familiarity with Kubernetes, Docker, and infrastructure-as-code tools
• Understanding of performance tuning, scalability strategies, and cost optimization for large-scale systems
• Strong communication and stakeholder management skills
• Ability to drive architectural decisions and mentor engineers

Nice to have:

• Exposure to event-driven architectures and advanced analytics platforms
• Experience enabling self-service analytics for internal stakeholders
• Experience in any of the following languages: Java, Scala, Rust
• Exposure to service mesh and advanced orchestration patterns

• Lead and mentor a team of data platform engineers, promoting collaboration, knowledge sharing, and professional growth.
• Drive architectural decisions for distributed systems and lakehouse platforms using Spark, Delta Lake, and Iceberg.
• Oversee design and implementation of scalable data pipelines and analytics workflows.
• Ensure adherence to software engineering best practices: clean code, modular design, CI/CD, automated testing, and code reviews.
• Collaborate with stakeholders to align technical solutions with business objectives and analytics needs.
• Champion governance, observability, and compliance frameworks across all data platforms.
• Manage performance tuning, scalability strategies, and cost optimization in cloud-native environments.
• Facilitate architecture reviews and contribute to design decisions for fault-tolerant, future-ready systems.
• Communicate effectively with leadership and cross-functional teams to provide updates, resolve blockers, and ensure timely delivery.
• Participate in on-call rotations as part of a team responsibility.