Lead Data Engineer (EU)
Tech Stack / Keywords
Firma i stanowisko
Andersen is hiring a Lead Data Engineer for a project building a scalable enterprise data and analytics platform and modernizing financial reporting capabilities. The customer is an established financial services provider focused on long-term financial planning and investment needs, aiming to improve customer experience, operational efficiency, and accessibility through digital capabilities. The project focuses on modernizing retail technology with a secure, scalable, governed enterprise data and analytics platform to support advanced analytics and regulatory reporting.
Wymagania
- Commercial experience in Data Engineering for 6+ years.
- Experience designing a greenfield data-platform framework.
- Strong hands-on Azure DevOps experience including YAML pipelines and CI/CD design.
- Experience designing and developing enterprise-scale data pipelines and platforms.
- Strong experience with Microsoft Azure data services.
- Advanced hands-on experience with Azure Databricks and Apache Spark.
- Strong experience with Azure Data Factory.
- Practical experience with Microsoft Fabric and modern cloud analytics platforms.
- Experience working with Azure Data Lake and cloud data storage.
- Strong SQL skills with relational and analytical data.
- Experience with ETL/ELT development and data integration patterns.
- Strong understanding of medallion architecture and modern data platform design.
- Familiarity with Data Vault and Kimball dimensional modeling methodologies.
- Experience designing scalable, reusable, production-ready data engineering frameworks.
- Experience with data quality, validation, reconciliation, and monitoring.
- Experience with CI/CD and DevOps practices using Azure DevOps.
- Understanding of data governance, metadata, lineage, security, and access control.
- Experience working in Agile delivery environments.
- Strong problem-solving and analytical skills.
- Ability to work effectively with Business Analysts, Architects, Data Analysts, and technical stakeholders.
- Associate certification strongly preferred.
- English level from Intermediate+ and above.
Obowiązki
- Leading the design, development, and operationalisation of scalable data engineering solutions for the Sunrise programme.
- Designing and implementing robust data ingestion pipelines from enterprise source systems like Sapiens and IRIS.
- Developing scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Microsoft Fabric.
- Building and maintaining data solutions across Azure Data Lake and cloud data platforms.
- Implementing medallion architecture and reusable data engineering patterns using Data Vault and Kimball dimensional modeling.
- Developing curated datasets, analytical data products, and trusted business views.
- Implementing data transformation, cleansing, validation, and reconciliation processes.
- Supporting integration as Sapiens replaces IRIS, working with Business Analysts, Data Architects, and engineers.
- Ensuring data pipelines meet requirements for scalability, reliability, performance, security, and quality.
- Implementing automated data quality and validation checks.
- Supporting regulatory and operational reporting capabilities ensuring data accuracy and traceability.
- Implementing monitoring, logging, and operational controls for pipelines and platform services.
- Contributing to CI/CD and DevOps practices using Azure DevOps.
- Supporting engineering automation for pipelines and code generation.
- Developing reusable frameworks, components, and engineering standards.
- Contributing to data governance, lineage, metadata, and security requirements, including handling PII.
- Working with platform and architecture teams to align solutions with enterprise standards.
- Exploring and implementing AI-enabled approaches to data engineering and SDLC automation.
- Supporting development of data foundations for AI and agentic AI use cases.
- Participating in technical design, code reviews, troubleshooting, and production support.
- Mentoring engineers and contributing to engineering best practices.
- Setting engineering patterns and standards.
- Collaborating directly with client's architects and Principal Data Engineer.
Benefity
- Opportunity to work with leaders in FinTech, Healthcare, Retail, Telecom and other industries.
- Possibility to change projects or develop expertise in interesting business domains.
- Flexible job conditions: fully remote, office, or hybrid options.
- Guarantee of professional, financial, and career growth with mentoring and adaptation systems.
- Opportunity to earn up to 1,000 EUR monthly as part of annual bonus through company activities.
- Access to corporate training portal with extensive and updated knowledge base.
- Bright corporate life including parties, snacks, coffee, and entertainment.
- Certification compensation (e.g., AWS, PMP).
- Referral program.
- Private health insurance and sports compensation dependent on employment type.
Inne informacje
Informujemy, że administratorem danych jest Andersen Soft UAB z siedzibą w Krakow, ul. Al. Pokoju 18, 31 - 564 dalej jako "administrator"). Masz prawo do żądania dostępu do swoich danych osobowych, ich sprostowania, usunięcia lub ograniczenia przetwarzania, prawo do wniesienia sprzeciwu wobec przetwarzania, a także prawo do przenoszenia danych oraz wniesienia skargi do organu nadzorczego. Dane osobowe przetwarzane będą w celu realizacji procesu rekrutacji. Podanie danych w zakresie wynikającym z ustawy z dnia 26 czerwca 1974 r. Kodeks pracy jest obowiązkowe. W pozostałym zakresie podanie danych jest dobrowolne. Odmowa podania danych obowiązkowych może skutkować brakiem możliwości przeprowadzenia procesu rekrutacji. Administrator przetwarza dane obowiązkowe na podstawie ciążącego na nim obowiązku prawnego, zaś w zakresie danych dodatkowych podstawą przetwarzania jest zgoda. Dane osobowe będą przetwarzane do czasu zakończenia postępowania rekrutacyjnego i przez okres możliwości dochodzenia ewentualnych roszczeń, a w przypadku wyrażenia zgody na udział w przyszłych postępowaniach rekrutacyjnych - do czasu wycofania tej zgody. Zgoda na przetwarzanie danych osobowych może zostać wycofana w dowolnym momencie. Odbiorcą danych jest serwis Just Join IT oraz inne podmioty, którym powierzyliśmy przetwarzanie danych w związku z rekrutacją.
Andersen
54 aktywne oferty