Data Engineer (AWS, Databricks)

This role is within the pharmaceutical industry focusing on data engineering.

• Experience with AWS Cloud for data platforms
• Strong scripting/programming skills in Python and SQL
• Hands-on experience with Databricks
• Experience in designing and maintaining data pipelines
• Knowledge of CI/CD processes and infrastructure as code (CDK)

Nice to have:

• Experience in regulated environments such as healthcare/pharma
• Knowledge in data science and insights generation
• Experience with AI and agentic coding

• Lead the design, development, and maintenance of data pipelines including ingestion, transformation orchestration, and monitoring
• Re-write ETL flows using Databricks
• Integrate and configure Databricks for data processing and pipeline execution
• Support data migration from decommissioned sources to new data lakes
• Build and optimize AWS cloud infrastructure related to data ingestion and processing
• Ensure data quality, reliability, and observability including logging, monitoring, and error handling
• Work with CI/CD and infrastructure-as-code tools
• Implement secure data movement and access patterns
• Collaborate with engineering and stakeholders to validate data flows
• Contribute to documentation and knowledge transfer
• Work independently