Senior Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Webellian is a Digital Transformation and IT consulting company working across sectors such as insurance, banking, healthcare, retail, and manufacturing. The company is involved in a large-scale data transformation project for a leading insurance company, building a Central Data Platform hosted on Microsoft Azure. The international project includes over 80 specialists in engineering, data, analytics, and business teams.
Wymagania
- Proven senior-level experience in Data Engineering or Data Architecture roles.
- Strong hands-on experience with Databricks.
- Advanced knowledge of Python and practical experience with PySpark.
- Strong experience designing and optimizing ETL and ELT pipelines.
- Very good knowledge of SQL and relational databases.
- Experience in data architecture, data modelling, and scalable data platform design.
- Practical experience with dbt.
- Experience with Microsoft Azure or other cloud-based data platforms.
- Knowledge of CI/CD practices and tools, particularly GitHub.
- Understanding of cloud infrastructure, orchestration, deployment, and data security.
- Ability to translate complex requirements into scalable technical solutions.
- Experience working in large, distributed, or multi-team environments.
- Fluent English and strong communication skills.
- Proactive attitude, ownership, and a DevOps mindset.
Nice to have:
- Experience with Oracle databases.
- Experience with dltHub.
- Experience with Azure Data Services.
- Experience supporting Power BI reporting environments.
- Knowledge of data governance, lineage, and metadata management.
- Experience building enterprise-level data platforms or data lakes.
- Experience in the insurance or financial services industry.
- Bachelor’s or Master’s degree in a technical field.
Obowiązki
- Design and develop the architecture of a large-scale Central Data Platform.
- Build and maintain end-to-end data pipelines covering ingestion, transformation, storage, and consumption.
- Integrate data from multiple systems into a consistent data platform.
- Design scalable data models aligned with business and analytical requirements.
- Develop and optimize ETL and ELT processes using Databricks, Python, PySpark, and dbt.
- Prepare reliable datasets for analytics, reporting, and business intelligence.
- Ensure data quality, consistency, lineage, security, and performance.
- Develop reusable data components and standardize data workflows.
- Support automated deployment and infrastructure processes using GitHub and Terraform.
- Collaborate with data engineers, architects, analysts, Power BI developers, and business stakeholders.
- Translate complex requirements into scalable technical solutions.
- Continuously improve the reliability, automation, and maintainability of the platform.
Benefity
- Contract under Polish law: B2B or Umowa o Pracę.
- Benefits such as private medical care, group insurance, and Multisport card.
- English language classes available.
- Hybrid work with at least one day on-site every 2-3 months in Warsaw (Mokotów).
- Opportunity to work with excellent professionals.
- High standards of work with a focus on code quality.
- Use of new technologies.
- Opportunities for continuous learning and growth.
- International team.
- On-site entertainment including Pinball and PlayStation.
Inne informacje
By submitting an application, candidates agree voluntarily to participate in the recruitment process conducted by Webellian. The recruitment may include interviews and assessments. Personal data will be processed according to GDPR and applicable national data protection laws exclusively for recruitment purposes.
Webellian
11 aktywnych ofert