Senior Data Engineer

100 - 150 PLN/ godz.B2B (netto)
SeniorFull-time·B2B
#325112·Dodano 21 dni temu·22
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

Data engineeringSQLPythonSparkPySparkDatabricksData analyticsData pipelinesAVLiDARDegree

Firma i stanowisko

Spyrosoft is an authentic, cutting-edge software engineering company, established in 2016. In 2021 and 2022, it was among the fastest growing technology companies in Europe, according to the Financial Times. The company was founded by a group of tech experts with established backgrounds in software engineering, creating an ‘engineer-to-engineer’ workplace. Spyrosoft specializes in technology solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education, and financial services industries.


Wymagania

  • 4+ years of experience in Data Engineering or similar role
  • Strong software engineering mindset (not a traditional DBA profile)
  • Advanced SQL (ability to write complex queries)
  • Advanced Python
  • Advanced Spark / PySpark
  • Hands-on experience with Databricks
  • Experience working with large-scale or complex datasets
  • Experience in advanced data analytics, including time series analysis
  • Understanding of ML workflows (data preparation for training/validation)
  • Solid understanding of data pipelines and distributed data processing
  • Availability for daily 1-hour overlap with US team (around 6 PM CST)

Nice to have:

  • Experience in the Autonomous Vehicle (AV) or ADAS domain
  • Exposure to sensor data (camera, LiDAR, radar)
  • Understanding of real-world driving edge cases
  • University degree in Computer Science or a related technical field

Obowiązki

  • Analyze large-scale real-world sensor datasets to identify edge cases (e.g., hard braking, close-proximity vehicles, unusual road behavior)
  • Design and write advanced SQL, Python, and Spark/PySpark queries for data filtering, transformation, and preparation
  • Work with internal platforms for data search, labeling, and auto-labeling workflows
  • Process structured and semi-structured data, including object detection and perception outputs
  • Select and prepare relevant data for AV simulation environments and ML pipelines
  • Contribute to improvements in data discovery and curation processes
  • Build and maintain data mining scripts and ETL pipelines
  • Develop internal tools to enhance analytics capabilities and streamline engineering workflows
  • Collaborate closely with engineers and researchers to support development and validation of safety-critical AV features
Spyrosoft

Spyrosoft

113 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz