Databricks Data Engineer

SoftServe is a global digital solutions company headquartered in Austin, Texas, founded in 1993. The Big Data & Analytics Center of Excellence is the data consulting and data engineering branch at SoftServe, designing and delivering end-to-end Data & Analytics solutions across Healthcare, Finance, Manufacturing, Retail, and Energy industries. They have partners with major cloud providers and serve clients globally across North America, EMEA, APAC, and LATAM.

• Over 5 years of experience as a Data Engineer designing data models and ETL pipelines on Databricks Lakehouse
• Advanced skills in PySpark, Python, and SQL
• Experience with performance tuning and cost optimization on Databricks
• Proficient in Databricks clusters and SQL Warehouses management
• Knowledge of Unity Catalog governance features
• Experience delivering end-to-end solutions and CI/CD pipelines
• Familiarity with bronze–silver–gold Lakehouse architecture and Delta Lake
• Experience exposing data via Databricks SQL and BI tools such as Power BI
• Communicative in English with technical and business stakeholders
• Familiarity with Azure services: Azure Data Factory, Synapse, ADLS, Azure DevOps, Microsoft Fabric is a plus
• Familiarity with modern Databricks AI/BI capabilities like Dashboards, Metric Views, MLflow, and agents is advantageous

• Design data models and scalable batch and streaming ETL pipelines on the Databricks Lakehouse
• Perform performance tuning and cost optimization
• Manage Databricks clusters and SQL Warehouses
• Implement Unity Catalog governance including fine-grained access, ABAC policies, lineage, and cross-workspace sharing
• Deliver end-to-end solutions using Databricks Asset Bundles, deploying jobs, pipelines, dashboards, and model serving via CI/CD
• Design bronze–silver–gold Lakehouse architectures using Delta Lake
• Expose data through Databricks SQL and BI tools like Power BI