Senior Data Engineer
Tech Stack / Keywords
Firma i stanowisko
Exadel is an AI-first global tech company with over 25 years of engineering leadership, 2,000+ team members, and 500+ active projects serving Fortune 500 clients including HBO, Microsoft, Google, and Starbucks. The client is a marketplace platform connecting people with local experiences, events, and travel options, supporting local businesses and enriching communities at a global scale.
Wymagania
- Strong experience with cloud data warehousing technologies: Google BigQuery, GCP
- Hands-on expertise with data orchestration tools, especially Apache Airflow (Cloud Composer)
- Solid background in working with relational and analytical databases: BigQuery, AlloyDB / PostgreSQL, Teradata (legacy)
- Proven experience in data integration: SQL-based ELT, SFTP, API integrations (NetSuite, PSPs)
- Knowledge of data governance frameworks and tooling: OpenMetadata (lineage, catalog), IAM/RBAC
- Strong understanding of CI/CD and DevOps practices using GitHub, Jenkins, Flyway, Terraform
- Experience building and maintaining data quality frameworks, ideally metadata-driven (BigQuery + Airflow)
Obowiązki
- Develop and maintain data pipelines (Bronze, Silver, Gold) using SQL-based ELT patterns
- Implement data ingestion from multiple sources (SFTP, APIs, databases) into BigQuery (raw, append-only)
- Build and optimize transformation logic for the curated Mart (Silver) layer using dimensional modeling principles
- Create fact and dimension tables, including Slowly Changing Dimension handling and surrogate key logic
- Implement data quality checks integrated with pipeline execution (row counts, reconciliation, validations)
- Support Airflow DAG development for orchestration, scheduling, and monitoring of pipelines
- Enable reprocessing and idempotency for reliable pipeline reruns from Bronze
- Collaborate on schema evolution and deployments using CI/CD tools (Git, Flyway, Jenkins)
- Optimize BigQuery performance and cost via partitioning, clustering, and query tuning
- Implement and maintain data integrations with downstream systems such as ERP and reporting tools
- Contribute to metadata management, lineage, and documentation in the data catalog
- Support testing, reconciliation, and parallel run validation during migration from legacy systems
- Troubleshoot pipeline failures and support monitoring and alerting processes
Benefity
- International projects
- In-office, hybrid, or remote flexibility
- Medical healthcare
- Recognition program
- Ongoing learning & reimbursement
- Well-being program
- Team events & local benefits
- Sports compensation
- Referral bonuses
- Top-tier equipment provision
Inne informacje
Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more. Reasonable accommodations are available to individuals with disabilities. The job description is not exhaustive and may evolve. Compensation details are shared early in recruitment. The offer is not binding until contract signing.
Exadel
45 aktywnych ofert