Data Engineer (Databricks)
Tech Stack / Keywords
Firma i stanowisko
Addepto is a leading AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for some of the world's largest enterprises and pioneering startups, including Rolls Royce, Continental, Porsche, ABB, and WGU. With an exclusive focus on Artificial Intelligence and Big Data, Addepto helps organizations unlock the full potential of their data through systems designed for measurable business impact and long-term growth. The company has developed its own product - ContextClue - and actively contributes open-source solutions to the AI community. Addepto is part of KMS Technology, a US-based global technology group, combining AI specialization with enterprise-scale delivery capabilities.
Wymagania
- At least 3+ years of commercial experience implementing, developing, or maintaining Big Data systems.
- Strong programming skills in Python: writing clean code, OOP design.
- Experience in designing and implementing data governance and data management processes.
- Familiarity with Big Data technologies like Airflow, Dagster, Databricks, Spark, and DBT.
- Experience implementing and deploying solutions in cloud environments (preference for Azure).
- Knowledge of building and deploying Power BI reports and dashboards for data visualization.
- Excellent understanding of dimensional data and data modeling techniques.
- Excellent communication skills and consulting experience with direct client interaction.
- Ability to work independently and take ownership of project deliverables.
- Bachelor’s or Master's degree in Computer Science, Data Science, Mathematics, Physics, or a related field.
Obowiązki
- Design scalable data processing pipelines for streaming and batch processing using Big Data technologies like Databricks, Airflow, and/or Dagster.
- Contribute to the development of CI/CD and MLOps processes.
- Develop applications to aggregate, process, and analyze data from diverse sources.
- Collaborate with the Data Science team on Machine Learning projects, including text/image analysis and predictive model building.
- Develop and organize data transformations using Databricks/DBT and Apache Airflow.
- Translate business requirements into technical solutions and ensure optimal performance and quality.
Benefity
- Work in a supportive team passionate about AI & Big Data.
- Engage with top-tier global enterprises and cutting-edge startups on international projects.
- Flexible work arrangements with options to work remotely or from modern offices and coworking spaces.
- Career development paths, knowledge-sharing initiatives, language classes, and sponsored training and conferences.
- Partnerships with Databricks and Anthropic providing access to leading training materials and certification programs.
- Team-building events and integration budget.
- Celebration of work anniversaries, birthdays, and milestones.
- Access to medical and sports packages, eye care, and well-being support including psychotherapy and coaching.
- Full work equipment including a laptop and necessary devices.
- Opportunities to boost personal brand through conferences, blogging, and meetups.
- Smooth onboarding with a dedicated buddy and a supportive, autonomous culture.
Inne informacje
Applicant consent to the processing of personal data is required for recruitment processes, in compliance with legal information clauses and data protection standards.
Addepto
39 aktywnych ofert