Datavant
Healthcare
SeniorEngineer-Ingestion&StreamingFrameworks
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Engineer - Ingestion & Streaming Frameworks at Datavant. Skills: Ingestion Frameworks, Streaming Frameworks, AWS, Terraform. Design ingestion frameworks. Build ingestion frameworks”
What You'll Achieve.
Make data secure, accessible and actionable; Improve health; Scale how Datavant onboards new sources; Ensure ingestion is safe, fast, observable, and boring
Industry & Context.
Reasoning about state; Reasoning about blast radius; Reasoning about data physically lives in a warehouse or lake
Post-offer health screenings, Proof/completion of vaccinations (flu shot, Tdap, COVID-19, etc.), Not eligible for employment sponsorship
What They're Looking For.
Must Have
6+ years in data engineering, platform engineering, or data-focused software engineering, 3+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, security groups), IAM (roles, policies, permission boundaries), and the data services this role touches, 2+ years writing production Terraform or equivalent IaC, 1+ years building self-service tooling, internal platforms, or paved-path frameworks consumed by other engineers, SQL skills, Production experience with Snowflake (or an equivalent cloud data warehouse), Production experience with a workflow orchestrator (Airflow / MWAA preferred), Hands-on experience with at least one ingestion approach: CDC tooling (e. g. , DMS, Debezium), managed connectors (e. g. , Fivetran, Airbyte), or rolling your own pipelines for API sources, Solid CI/CD discipline in GitHub or equivalent: branching, code review, automated checks, repeatable deployment, AI fluency is a baseline expectation, Working knowledge of Python
Nice to Have
Direct production experience with Iceberg or another open table format, especially bridging Snowflake and Databricks, Hands-on Databricks or Spark, Kubernetes experience, Snowflake certification(s), Azure experience, In-depth experience integrating data systems with managed identity platforms, particularly via SCIM (SailPoint a plus), Prior experience in healthcare or another highly regulated industry like Finance, Prior DBA, SRE, or DRE work operating production data systems under pressure
What You'll Do.
Design ingestion frameworks
Build ingestion frameworks
Operate ingestion frameworks
Evolve ingestion stack
Design new patterns for API sources
Build self-service tooling
Partner with product teams
Pick ingestion pattern
Stand up ingestion sources
Lead production troubleshooting
Lead incident response
Turn incidents into fixes
Raise bar on engineering quality
Raise bar on observability
Raise bar on cost discipline
Raise bar on security
Mentor mid-career engineers
Pull peers along through code review
Pull peers along through pairing
Pull peers along through design feedback
How You'll Work.
Team & Collaboration
Partner with product, data, and analytics teams; Work with product team; Collaborate with peers
Communication Scope
Clear written communication; Clear verbal communication; Async communication; Remote communication
Full Job Description
Datavant is the data collaboration platform trusted for healthcare. Guided by our mission to make the world’s health data secure, accessible and actionable, we provide critical data solutions for organizations across the healthcare ecosystem - including providers, health plans, researchers, and life sciences companies. From fulfilling a single patient’s request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future of how data is connected and used to improve health. By joining Datavant today, you’re stepping onto a driven and highly collaborative team that is passionate about creating transformative change in healthcare. The Ingestion some moves back out. Our job is to make both safe, fast, observable, and boring. We are looking for a Senior Engineer who thinks like a platform builder first. We are shifting from a service-oriented posture (“we’ll build the pipeline for you”) to a platform-oriented one (“here is the paved path to build it yourself, safely”), though the team still builds pipelines directly when the situation calls for it. You will be central to that shift, designing the frameworks, tooling, and guardrails that scale how Datavant onboards new sources, and rolling up your sleeves for hands-on ingestion work when there isn’t yet a paved path. AI fluency is a baseline expectation here. You should already be using Claude Code, Cursor, Copilot, or equivalent tools as a core part of your daily engineering workflow, have opinions about how they make a team faster, and know how to apply them responsibly when PHI and other sensitive data are in scope. What You Will Do: Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into Snowflake, Iceberg, and Databricks Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, Fivetran, and the homegrown tooling on top) and design new patterns for API sources that don’t fi
Applying for this Senior Engineer - Ingestion & Streaming Frameworks role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Datavant?
Real rants from real employees. Read before you apply.