Data Engineer

Our client operates in the pharmaceutical industry and is seeking a Senior Data Engineer to support their data platforms by building, maintaining, and migrating data pipelines and AWS Cloud infrastructure.

• Strong experience in building and maintaining ETL/data pipelines using Databricks, Python, SQL, and AWS
• Hands-on experience with data migration, cloud-based data processing, and pipeline monitoring
• Good knowledge of CI/CD, Infrastructure as Code (CDK), and AWS security concepts including IAM
• Understanding of data quality, reliability, and observability best practices
• Ability to work independently and collaborate with cross-functional teams

Nice to have:

• Prior experience in regulated environments such as healthcare or pharma
• Knowledge of data science and insights generation
• Experience with AI and agentic coding

• Lead the design, development, and maintenance of data pipelines, including ingestion, transformation orchestration, and monitoring
• Re-write ETL flows using Databricks
• Integrate and configure connectivity to Databricks for data processing and pipeline execution
• Support data migration from decommissioned sources to new data sources and data lakes
• Build and optimize AWS cloud infrastructure related to data ingestion and processing
• Ensure data quality, reliability, and observability (logging/monitoring, error handling, retries)
• Implement and manage networking and access patterns for secure data movement, including IAM roles and policies
• Collaborate with engineering and stakeholders to validate end-to-end data flows and delivery timelines
• Contribute to documentation and knowledge transfer
• Work independently