Quantiphi
Healthcare
SeniorDataEngineer
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Data Engineer at Quantiphi. Skills: Data Engineering, Python, SQL, Healthcare Data Standards. Build ingestion pipelines. Operate ingestion pipelines”
Industry & Context.
Problem-solving skills; Debugging discipline; Root cause analysis
On-call rotations
What They're Looking For.
Must Have
Bachelor's or Master's degree, 3+ years data engineering experience, Proficiency in Python and SQL, Production experience with dbt, Production experience with Apache Iceberg, Experience with Apache Kafka, Experience with streaming data processing, Familiarity with healthcare data standards, Experience with version control (Git), Experience with CI/CD pipelines, Experience working with AI coding assistants
Nice to Have
PySpark and PyFlink familiarity, Java or Kotlin exposure, Dataproc Flink optional component a plus, dbt-trino adapter experience a plus, Reading/writing Iceberg from multiple engines valuable, Confluent Cloud experience preferred, Apache Spark Structured Streaming acceptable, Hands-on parsing experience preferred, FHIR-Repository or HAPI FHIR experience, Informatica MDM experience, Atlan experience, Java or Kotlin proficiency, Apache Flink production operational experience, Experience with FHIR profile validation tools, Experience with spec-driven development workflows, Experience with Iceberg's Polaris, Nessie, or Snowflake Open Catalog
What You'll Do.
Build ingestion pipelines
Operate ingestion pipelines
Build dbt transformation layer
Build FHIR serialization pipelines
Build FHIR-Repository integration components
Implement source-format parsers
Write fixture-driven tests
Implement synchronous Informatica MDM call pattern
Implement asynchronous MDM event consumer
Build dbt transformation layer end to end
Write dbt YAML schemas
Write dbt documentation
Implement shared dbt macro library
Build FHIR serialization layer
Build PySpark bundling pipeline
Integrate FHIR validator
Build FHIR-Repository integration components
Implement Java/Kotlin egress interceptor
Implement Flink loopback consumer
Implement bundle consumer
Implement origin-tag-based loop prevention
Implement Cloud Composer DAGs
Orchestrate batch ingestion jobs
Orchestrate maintenance operations
Orchestrate data product refresh schedules
Draft unit specs for new components
Work with peers on spec review
Generate implementation and tests
Iterate until tests pass
Submit code review packages
Implement data quality checks
Monitor data quality checks
Participate in code reviews
Participate in on-call rotations
Participate in incident response
Optimize pipeline performance
Profile production performance
Propose changes when SLOs are at risk
Document components through SDD framework
How You'll Work.
Team & Collaboration
Spec review with peers; Agile team environment
Process & Methodology
Agile
Full Job Description
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi! # # # _**Data Engineer**_ **Exp Range :** 4 - 8 Years **Location :** Mumbai , Bangalore, Trivandrum **Role review :** The Data Engineer is the implementation backbone of the platform. You will build and operate the ingestion pipelines, the dbt transformation layer, the FHIR serialization pipelines, the FHIR-Repository integration components, and the data products that depend on them. You will work within a spec-driven development framework — every component begins with an approved specification, and your work is generated, refined, and verified against that specification. This is a hands-on role. You will write Python, PyFlink, PySpark, dbt SQL, and supporting Java for FHIR-Repository interceptor work, with Code agents as a coding assistant under your direction. Code review, test authorship, and operational ownership of the components you build are part of the role. The platform handles regulated healthcare data at high volume, and operational discipline matters. ## Key Responsibilities * Build and maintain the ingestion pipelines — Apache Flink streaming jobs on Dataproc for HL7v2 and FHIR feeds, PySpark batch jobs for CCDA and CSV bulk loads. Implement against the CDM_ingest_mapping shared Python library that defines SourceSpec instances per source × format combination * Implement source-format parsers (HL7v2, CCDA, CSV, FHIR) as Python classes per the parser component spec. Write fixture-driven tests covering both well-formed inputs and DLQ-routing scenarios * Implement and maintain the synchronous Informatica MDM call pattern in the ingestion path — batched
Applying for this Senior Data Engineer role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Workday
- Workday has a multi-step form — save your progress after every section.
- "Apply With LinkedIn" can fail or lose data; manual entry is more reliable.
- Watch for the "Submit for Review" final step — hitting "Save" alone does not submit.
- Job requisition numbers are useful when following up with HR by email.
ANONYMOUS · UNFILTERED
What do employees actually say about Quantiphi?
Real rants from real employees. Read before you apply.