Tech Stack / Keywords
Podsumowanie oferty
As a Senior Data Engineer, you will design and build scalable data platforms and processing pipelines for projects in aerospace, energy management, and automotive. The work uses Databricks, Azure, Apache Spark, and other data engineering technologies.
Wymagania
- At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
- Strong programming skills in Python, including clean code and object-oriented design.
- Strong SQL skills, including performance tuning and query optimization, and experience with data warehousing solutions.
- Experience designing and implementing data governance and data management processes.
- Deep expertise in Big Data technologies, including Apache Airflow, Dagster, and Databricks, and other modern data orchestration and transformation tools.
- Experience implementing and deploying solutions in cloud environments, preferably Azure.
- Knowledge of building and deploying Power BI reports and dashboards for data visualization.
- Excellent understanding of dimensional data and data modeling techniques.
- Consulting experience and the ability to guide clients through architectural decisions, technology selection, and best practices.
- Ability to work independently and take ownership of project deliverables.
- Familiarity with Spark, Azure Event Hub, or Kafka.
- Master’s or Ph.D. in Computer Science, Big Data, Mathematics, Physics, or a related field.
Obowiązki
- Design and optimize scalable streaming and batch data processing pipelines using Big Data technologies such as Databricks, Apache Airflow, and Dagster.
- Architect and implement end-to-end data platforms, ensuring high availability, performance, and reliability.
- Lead the development of CI/CD and MLOps processes to automate deployments, monitoring, and model lifecycle management.
- Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources.
- Collaborate with Data Science teams on Machine Learning projects, including text and image analysis, feature engineering, and predictive model deployment.
- Design and manage complex data transformations using Databricks, DBT, and Apache Airflow.
- Translate business requirements into technical solutions while ensuring performance and data quality.
- Ensure data security, compliance, and governance best practices across data pipelines.
Benefity
- Language classes.
- Sponsored training and conferences, including training materials and certifications through partnerships with Databricks and Anthropic.
- Team-building events and an integration budget.
- Medical and sports packages, eye care, and well-being support services, including psychotherapy and coaching.
- Full work equipment, including a laptop and other necessary devices.
Kursy językowe
Dofinansowanie szkoleń
Budżet konferencyjny
Spotkania integracyjne
Opieka zdrowotna
Karta sportowa
Inne informacje
- Applications are collected and processed through Addepto’s official recruitment system. Verify that recruitment communications come from an official Addepto channel.
Addepto
68 aktywnych ofert