Senior Data Platform Engineer (AWS)
20.9k - 30.9k PLN20 900 - 30 900 PLN/ mies.B2B
SeniorFull-time·B2B
#383338·Dodano wczoraj·0
Źródło: justjoin.itTech Stack / Keywords
AWSTerraformApache IcebergDBT
Firma i stanowisko
Xebia sp. z o.o. is recruiting for a senior data platform engineer role focused on designing and provisioning data lakehouse foundations and infrastructure on AWS, including S3, Apache Iceberg, Glue Data Catalog, Athena, and Lake Formation, with infrastructure as code managed via Terraform.
Wymagania
- Strong experience with AWS data and platform services: S3, Glue (Data Catalog and Jobs), Athena, Lake Formation, IAM, VPC networking, DMS, DynamoDB, Aurora PostgreSQL
- Experience with infrastructure as code using Terraform including modular design and YAML-driven configuration
- Knowledge of Apache Iceberg and open table formats on S3
- Experience with security and access control mechanisms
- Knowledge of CI/CD engineering with GitHub Actions, trunk-based development, and environment promotion
- Solid skills in Python and SQL
- Experience with dbt on AWS, including dbt-athena and dbt-glue adapters and analytics-engineering workflows
- Previous exposure to Apache Airflow orchestration, ideally with Astronomer Cosmos
- Skills in data lineage and observability tools such as OpenLineage and dbt-elementary and data quality tooling (dbt tests, dbt-expectations)
- Experience with CDC and streaming ingestion patterns
Nice to have:
- Exposure to BI serving layers such as QuickSight or Sigma
- Experience with Snowflake
Obowiązki
- Designing and provisioning the lakehouse foundation on AWS: S3 lake zones (raw, canonical, curated), Apache Iceberg tables, Glue Data Catalog, Athena, and Lake Formation
- Delivering infrastructure as code with Terraform in isolated environments (ci, dev, staging, prod)
- Building and enforcing tenant-isolation security features including Lake Formation row-level security and IAM roles
- Implementing upstream entitlement mapping for access control
- Setting up ingestion infrastructure for CDC from DynamoDB Streams, AWS DMS extracts from Aurora PostgreSQL, and bulk Parquet exports
- Standing up workflow orchestration with Apache Airflow and Astronomer Cosmos
- Building CI/CD pipelines with GitHub Actions including dbt compile, SQLFluff linting, DAG validation, and environment promotion
- Configuring governance and observability with catalog and data contracts, OpenLineage capture, and audit through CloudTrail
- Managing cost governance and monitoring through resource tagging and usage alerts
- Collaborating with Data Platform Architect, Data Engineers, and Analytics Engineer and supporting client team knowledge transfer
Benefity
- Development budgets of up to 6,800 PLN
- Funding for certifications such as AWS and Azure
- Access to Udemy, O'Reilly, and other learning platforms
- Events and technology conferences
- Technology Guilds and internal training (Xebia Upskill)
- Private medical healthcare
- MultiSport card subsidy
- Mental health support
- Flexible contract options: B2B or employment contract, with contract for an indefinite period
Dofinansowanie szkoleń
Budżet konferencyjny
Szkolenia wewnętrzne
Opieka zdrowotna
Karta sportowa
Elastyczne godziny
Inne informacje
Work from the European Union region and a work permit are required. Candidates must have an active VAT status in the EU VIES registry.
Xebia sp. z o.o.
46 aktywnych ofert