SeniorDataEngineer(Databricks)

**Job Location** WARSAW PLANT & GO **Job Description** We are seeking a **Senior Data Engineer (Databricks)** to design, operate, and continuously improve our SAP data replication platform. The platform streams change data from SAP S/4HANA / ECC sources into downstream like Databricks. This is used across analytics, finance, supply chain, and operations. You will own end-to-end pipeline engineering roadmap. **Key Responsibilities** **Pipeline Engineering** * Design, build, and continuously improve pipelines from SAP to downstream * Develop and continuously improve on Kafka / Confluent topics, connectors, schemas (Avro / Schema Registry), and stream-processing jobs. * Build automation for deployment, validation, refresh, and reconciliation. * Tune capture and integrate jobs for throughput, lag, and resource efficiency. **Platform & DevOps** * Deploy and manage Kafka and HVR components on AKS / Kubernetes and Azure infrastructure. * Maintain CI/CD pipelines (GitHub Actions / Azure DevOps) and IaC (Terraform / Bicep). * Enforce security, RBAC, secrets management (Key Vault), and network segmentation. **Collaboration & Governance** * Partner with SAP Basis, Network, Security * Author runbooks, architecture diagrams, and knowledge-base articles. * Contribute to data-quality and contract-testing frameworks. Experience * 5+ years in data engineering or platform engineering, with 3+ years in streaming / CDC pipelines preferred * Hands-on production experience with CDC tool preferred (ex. HVR, Debezium) * Hands-on production experience with Apache Kafka or Confluent Platform (topics, partitions, consumer groups, Schema Registry). **Job Qualifications** **Experience** * 5+ years in data engineering or platform engineering, with 3+ years in streaming / CDC pipelines preferred * Hands-on production experience with CDC tool preferred (ex. HVR, Debezium) * Hands-on production experience with Apache Kafka or Confluent Platform (topics, partitions, consumer groups, Schema Registry)