Senior Data Engineer | Data Harmonization & BigQuery

Join an international project for a global e-commerce and marketplace platform operating across multiple markets, including North America and other international regions. The project focuses on harmonizing and standardizing financial and operational data coming from different regional systems and data models to build a consistent, scalable, and high-quality data environment that will improve reporting, financial processes, and migration from legacy systems.

• Experience with Google BigQuery, GCP, and cloud data warehouse environments.
• Proficiency in SQL and SQL-based ELT processes.
• Experience with orchestration tools, specifically Apache Airflow (Cloud Composer).
• Knowledge of databases such as PostgreSQL (AlloyDB), Teradata (legacy).
• Familiarity with APIs, SFTP, and data integration techniques.
• Understanding of data governance, lineage, catalog (OpenMetadata), and IAM/RBAC.
• Experience with CI/CD and DevOps tools including GitHub, Jenkins, Flyway, and Terraform.
• Ability to implement and maintain metadata-driven data quality frameworks using BigQuery and Airflow.

• Develop and maintain scalable ETL/ELT data pipelines (Bronze → Silver → Gold) using SQL and BigQuery.
• Ingest and integrate data from multiple sources, including SFTP, APIs, and databases.
• Build and optimize data models, fact and dimension tables, including SCD and surrogate key logic.
• Develop and support Airflow DAGs for orchestration, scheduling, and monitoring.
• Implement data quality checks, reconciliation, validation, and idempotent processing.
• Optimize BigQuery performance and costs through partitioning, clustering, and query tuning.
• Support CI/CD, schema evolution, data lineage, and documentation using Git, Jenkins, Flyway, and OpenMetadata.
• Troubleshoot pipeline issues and support data migration from legacy systems and integration with downstream systems.