Senior Data Engineer (Python, Databricks)

Craftware is a technology company of over 500 experts, empowering large organizations to solve complex business challenges with modern IT solutions - from sales systems and automation to data platforms and AI. We operate where technology must be reliable, secure, and scalable. We deliver end-to-end projects: from analysis and architecture through implementation to development and maintenance. We are a trusted partner of industry leaders such as Salesforce, Veeva, UiPath, and Databricks.

• Senior hands-on experience with Azure Databricks & PySpark: jobs, clusters, Unity Catalog, transformation logic, unit testing
• Knowledge of Delta Lake: schema evolution, MERGE, time travel; DAB: YAML config and bundle deployment
• Advanced SQL skills; able to read 10-year-old stored procedures unaided
• Experienced with CI/CD: Azure DevOps, Git branching strategy, PR discipline, practiced not theoretical
• Ability to profile source data, define acceptance criteria, and manage data problem resolution from assessment to UAT sign-off independently
• Comfortable working with incomplete documentation and evolving scope; documents decisions to avoid handover calls

• Build and maintain DAB pipelines and YAML-based transformation configuration; migrate toward native Databricks Asset Bundle patterns
• Keep DEV / QAS / PRD environments consistent and drift-free across delivered markets
• Assess new data sources before sprint commitment — shape, volume, quality risks — and write feasibility notes that gate scope entry
• Develop PySpark transformations across Raw, Quality Integration, and Curated zones following CDA layer standards
• Define and run data reconciliation and acceptance criteria so business users aren't the primary quality gate at UAT

Zgodnie z art. 13 ust. 1 i 2 rozporządzenia Parlamentu Europejskiego i Rady (UE) 2016/679 z dnia 27 kwietnia 2016 r. w sprawie ochrony osób fizycznych w związku z przetwarzaniem danych osobowych i w sprawie swobodnego przepływu takich danych oraz uchylenia dyrektywy 95/46/WE (ogólne rozporządzenie o ochronie danych, dalej: RODO) (Dz. Urz. UE L119/1) informujemy, że:

1. Administratorem Pana/Pani danych osobowych jest Craftware Sp. z o.o. al. Jerozolimskie 134, 02-305 Warszawa; wpisana do Krajowego Rejestru S5dowego pod nr KRS 0000328647; NIP 527-260-22-47.
2. Pana/Pani dane osobowe b9d1 przetwarzane zgodnie z RODO... (full legal information as provided)