Senior Data Engineer
Brak informacji o wynagrodzeniu
SeniorFull-time
#411427·Dodano 2 dni temu·0
Źródło: ExadelTech Stack / Keywords
AISQLDatabasesBigQueryAirflowCI/CDGitJenkins
Firma i stanowisko
Exadel is an AI-first global tech company with over 25 years of engineering leadership, more than 2,000 team members, and 500+ active projects serving Fortune 500 clients such as HBO, Microsoft, Google, and Starbucks. The client is a marketplace platform connecting people with local experiences, events, and travel options, supporting local businesses and vibrant communities at a global scale.
Wymagania
- Strong experience with cloud data warehousing technologies: Google BigQuery, GCP
- Hands-on expertise with data orchestration tools, especially Apache Airflow (Cloud Composer)
- Solid background in working with relational and analytical databases: BigQuery, AlloyDB / PostgreSQL, Teradata (legacy)
- Proven experience in data integration: SQL-based ELT, SFTP, API integrations (NetSuite, PSPs)
- Knowledge of data governance frameworks and tooling: OpenMetadata (lineage, catalog), IAM/RBAC
- Strong understanding of CI/CD and DevOps practices using GitHub, Jenkins, Flyway, Terraform
- Experience building and maintaining data quality frameworks, ideally metadata-driven (BigQuery + Airflow)
Nice to have:
- Upper-Intermediate English proficiency
Obowiązki
- Develop and maintain data pipelines (Bronze, Silver, Gold) using SQL-based ELT patterns
- Implement data ingestion from multiple sources (SFTP, APIs, databases) into BigQuery (raw, append-only)
- Build and optimize transformation logic for curated Mart (Silver) layer using dimensional modeling principles
- Create fact and dimension tables, including Slowly Changing Dimension handling and surrogate key logic
- Ensure data quality checks are implemented and integrated with pipeline execution (row counts, reconciliation, validations)
- Support Airflow DAG development for orchestration, scheduling, and monitoring of pipelines
- Enable reprocessing and idempotency, ensuring pipelines can be reliably rerun from Bronze
- Collaborate on schema evolution and deployments using CI/CD tools: Git, Flyway, Jenkins
- Optimize BigQuery performance and cost (partitioning, clustering, query tuning)
- Implement and maintain data integrations with downstream systems (e.g., ERP, reporting tools)
- Contribute to metadata, lineage, and documentation in the data catalog
- Support testing, reconciliation, and parallel run validation during migration from legacy systems
- Troubleshoot pipeline failures and support monitoring and alerting processes
Benefity
- International projects
- In-office, hybrid, or remote flexibility
- Medical healthcare
- Recognition program
- Ongoing learning and reimbursement
- Well-being program
- Team events and local benefits
- Sports compensation
- Referral bonuses
- Top-tier equipment provision
Opieka zdrowotna
Spotkania integracyjne
Karta sportowa
Premie
Inne informacje
- Exadel is an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more.
- Reasonable accommodations are available to enable individuals with disabilities to perform essential functions.
- The job description is not exhaustive; duties and responsibilities may evolve based on business needs.
- Compensation details are shared with candidates early in the recruitment process.
- The offer is not binding until a signed contract is in place.
Exadel
49 aktywnych ofert