Senior Data Engineer (Databricks)

Procter & Gamble is a global company producing recognized brands such as Always®, Ariel®, Gillette®, and more, operating in approximately 70 countries worldwide. The role is based in Warsaw, Poland, with an additional location in Manila. The position involves working on SAP data replication platforms used across analytics, finance, supply chain, and operations.

• 5+ years in data or platform engineering, with 3+ years in streaming/CDC pipelines preferred.
• Hands-on production experience with CDC tools (e.g., HVR, Debezium).
• Hands-on production experience with Apache Kafka or Confluent Platform (topics, partitions, consumer groups, Schema Registry).
• Strong SQL skills (HANA, Spark SQL, or T-SQL) and understanding of SAP table structures.
• Proficiency in Python for automation, REST clients, and data tooling.
• Linux administration and shell scripting (Bash/PowerShell).
• Kubernetes/AKS workload deployment and troubleshooting.
• Cloud experience, preferably Azure (Storage, Key Vault, Monitor, Event Hubs); AWS/GCP acceptable.
• Experience with observability tools: Grafana, Prometheus, ELK/Splunk/Log Analytics.
• Experience with Git and CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins).
• Knowledge of CDC concepts: log-based vs trigger-based, exactly-once vs at-least-once semantics.
• Understanding of schema evolution, backward/forward compatibility, and contract testing.
• Familiarity with event-driven and lakehouse (medallion) architecture patterns.
• Strong written communication and documentation skills.
• Comfortable with on-call and production-incident ownership.
• Experience collaborating cross-functionally in regulated enterprise environments.

Nice to have:

• Experience with Fivetran HVR6 (REST API, Hub/Agent, channel design).
• SAP S/4HANA/ECC functional knowledge or basic ABAP/CDS view literacy.
• Databricks/Delta Lake/Unity Catalog development experience.
• Kafka Streams, ksqlDB, or Apache Flink.
• Terraform/Bicep infrastructure-as-code.
• Snowflake or other cloud data warehouse experience.
• Data quality frameworks (Great Expectations or custom engines).
• Scala/Java for stream-processing internals.
• Experience operating 24/7 mission-critical replication for finance or supply-chain systems.

Pipeline Engineering:

• Design, build, and continuously improve pipelines from SAP to downstream systems.
• Develop and improve Kafka/Confluent topics, connectors, schemas (Avro/Schema Registry), and stream-processing jobs.
• Build automation for deployment, validation, refresh, and reconciliation.
• Tune capture and integrate jobs for throughput, lag, and resource efficiency.

Platform & DevOps:

• Deploy and manage Kafka and HVR components on AKS/Kubernetes and Azure infrastructure.
• Maintain CI/CD pipelines (GitHub Actions/Azure DevOps) and Infrastructure as Code (Terraform/Bicep).
• Enforce security, RBAC, secrets management (Key Vault), and network segmentation.

Collaboration & Governance:

• Partner with SAP Basis, Network, and Security teams.
• Author runbooks, architecture diagrams, and knowledge-base articles.
• Contribute to data-quality and contract-testing frameworks.

Employment is exclusively extended on the basis of an "Umowa o Pracę" (Full-time Employment Contract). Apply only if you agree to these conditions. The employer is an equal opportunity employer and does not discriminate based on legally protected factors.