Senior Databricks Engineer (Data Architecture & Design Focus)

Entrada is a company focused on empowering Databricks users to unlock their data's full potential. They offer expert services in modernizing data platforms to drive business objectives and monetize data-centric services, aiming to enhance business agility and innovation.

• Minimum 5+ years of experience in Big Data with a focus on Data Design and Data Warehouse rather than pure ETL.
• Expert-level proficiency in Databricks ecosystem including Delta Lake, PySpark, and Spark SQL.
• Deep understanding of Medallion Architecture and data movement from Bronze to Conformed Silver/Gold layers.
• High comfort with Star Schema, Snowflake, or Data Vault modeling patterns.
• Familiarity with Unity Catalog and data governance/access at scale.
• Fluent English in both written and spoken forms for explaining complex data design decisions.

• Build the Conformed Silver Layer, ensuring unified, schema-enforced data ready for business logic.
• Implement refined data models translating complex business rules into DWH structures like Star Schemas and Medallion Gold tables.
• Develop and operationalize feature sets to support Data Science and ML workflows.
• Build and maintain reusable, metadata-driven ETL/ELT frameworks in PySpark.
• Optimize Spark jobs for minimal latency and maximum reliability through partitioning, bucketing, and caching.
• Implement automated reconciliation and validation gates at the Silver-to-Gold boundary to ensure data integrity.