DataBricks Developer (Digital Engineering)

Our client is a leading life insurance company and part of a global financial services group. Founded in 1896 and headquartered in North America, the company offers a wide range of products, including annuities and life insurance, through a nationwide network of agents.

• 3+ years of professional experience in data engineering
• Strong communication and collaboration skills with technical and non-technical stakeholders
• Hands-on experience designing and developing data solutions in Databricks, including architecture, Unity Catalog, Delta tables, data lineage, access permissions, Databricks Genie, and notebooks
• Advanced SQL skills, including complex queries and data transformations
• Proficiency in Python for data processing, automation, and solution development
• Professional experience with Microsoft Azure cloud services and data platforms

Nice to have:

• Experience with Databricks AI capabilities including Agent Bricks, Generative AI, and RAG solutions
• Experience with Azure data services: Azure Synapse, Synapse pipelines, Azure Data Factory, Azure SQL pools
• Experience setting up CI/CD for Databricks solutions using Azure DevOps, Databricks Asset Bundles, and Infrastructure as Code
• Experience in performance tuning for Databricks, SQL queries, and data pipelines
• Databricks Certified Data Engineer Professional certification
• Databricks Certified Generative AI Engineer Associate certification

• Collaborate with a team of three engineers to develop and support data solutions in Databricks
• Develop and maintain data processing workflows using Databricks, SQL, Python, and Delta Lake
• Work with Unity Catalog to manage data access permissions, data lineage, and governance
• Support the existing production system and participate in the implementation of new features and enhancements
• Investigate and troubleshoot issues in Databricks data workflows and production processes
• Collaborate with team members and stakeholders to deliver reliable data engineering solutions

Candidate must be able to work in a timezone up to 11am CST.