Data Engineer (ETL/ELT )

• 10+ years of overall IT experience with strong exposure to Data Engineering.
• Hands-on experience with GCP services including Dataflow, BigQuery, Cloud SQL, Cloud Storage.
• Experience with Cloud Composer/Airflow and Pub/Sub.
• Good to have experience with Dataproc.
• Strong coding skills in Python.
• Strong experience with Apache Beam.
• Strong database skills in PostgreSQL and PL/SQL.
• Good understanding of Google Cloud SDK, APIs, and scripting.
• Experience in performance tuning and optimization of data pipelines and SQL.
• Knowledge of DevOps concepts including Git, CI/CD pipelines, and release processes.

Nice to have:

• Experience in handling large-scale distributed datasets.
• Exposure to streaming use cases and event-driven architectures.
• Good communication skills and ability to work directly with client/business stakeholders.

• Design, develop, and maintain batch and streaming data pipelines using GCP services.
• Build ETL/ELT workflows using Dataflow (Apache Beam) and Python.
• Develop and optimize data models and queries in PostgreSQL and PL/SQL.
• Implement orchestration workflows using Airflow/Cloud Composer.
• Integrate data from multiple sources into BigQuery/Cloud SQL for analytics and reporting.
• Ensure data quality, validation, monitoring, and pipeline reliability.
• Collaborate with business, analytics, and application teams to translate requirements into technical solutions.
• Follow Agile and DevOps practices for CI/CD, testing, deployment, and support.
• Work with DevOps tools such as Git and Jenkins.