Senior Data Engineer

100 - 150 PLN/ godz.
SeniorFull-time
#344784·Dodano dziś·0
Źródło: Spyrosoft
Aplikuj teraz

Tech Stack / Keywords

PythonNetworkSQLSparkPySparkETLSOLID

Firma i stanowisko

This role supports a long-term engagement focused on simulation data processing for Autonomous Vehicle (AV) development, working with high-volume multimodal sensor data collected from a test AV fleet in collaboration with a leading global automotive OEM.


Wymagania

  • 4+ years of experience in Data Engineering or similar role
  • Strong software engineering mindset
  • Advanced SQL skills (ability to write complex queries)
  • Advanced Python skills
  • Advanced Spark / PySpark skills
  • Hands-on experience with Databricks
  • Experience working with large-scale or complex datasets
  • Experience in advanced data analytics, including time series analysis
  • Understanding of ML workflows (data preparation for training/validation)
  • Solid understanding of data pipelines and distributed data processing

Nice to have:

  • Experience in the Autonomous Vehicle (AV) or ADAS domain
  • Exposure to sensor data (camera, LiDAR, radar)
  • Understanding of real-world driving edge cases
  • University degree in Computer Science or a related technical field

Obowiązki

  • Analyze large-scale real-world sensor datasets to identify edge cases such as hard braking, close-proximity vehicles, and unusual road behavior
  • Design and write advanced SQL, Python, and Spark/PySpark queries for data filtering, transformation, and preparation
  • Work with internal platforms for data search, labeling, and auto-labeling workflows
  • Process structured and semi-structured data, including object detection and perception outputs
  • Select and prepare relevant data for AV simulation environments and ML pipelines
  • Contribute to improvements in data discovery and curation processes
  • Build and maintain data mining scripts and ETL pipelines
  • Develop internal tools to enhance analytics capabilities and streamline engineering workflows
  • Collaborate closely with engineers and researchers to support development and validation of safety-critical AV features
Spyrosoft

Spyrosoft

134 aktywne oferty

Zobacz wszystkie oferty
Aplikuj teraz