Senior Data Engineer

This role supports a long-term engagement focused on simulation data processing for Autonomous Vehicle (AV) development, working with high-volume multimodal sensor data collected from a test AV fleet in collaboration with a leading global automotive OEM.

• 4+ years of experience in Data Engineering or similar role
• Strong software engineering mindset
• Advanced SQL skills (ability to write complex queries)
• Advanced Python skills
• Advanced Spark / PySpark skills
• Hands-on experience with Databricks
• Experience working with large-scale or complex datasets
• Experience in advanced data analytics, including time series analysis
• Understanding of ML workflows (data preparation for training/validation)
• Solid understanding of data pipelines and distributed data processing

Nice to have:

• Experience in the Autonomous Vehicle (AV) or ADAS domain
• Exposure to sensor data (camera, LiDAR, radar)
• Understanding of real-world driving edge cases
• University degree in Computer Science or a related technical field

• Analyze large-scale real-world sensor datasets to identify edge cases such as hard braking, close-proximity vehicles, and unusual road behavior
• Design and write advanced SQL, Python, and Spark/PySpark queries for data filtering, transformation, and preparation
• Work with internal platforms for data search, labeling, and auto-labeling workflows
• Process structured and semi-structured data, including object detection and perception outputs
• Select and prepare relevant data for AV simulation environments and ML pipelines
• Contribute to improvements in data discovery and curation processes
• Build and maintain data mining scripts and ETL pipelines
• Develop internal tools to enhance analytics capabilities and streamline engineering workflows
• Collaborate closely with engineers and researchers to support development and validation of safety-critical AV features