Instructure
Research & Development
SeniorAppliedDataScientist,LearnerModeling
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Applied Data Scientist, Learner Modeling at Instructure. Skills: Learner modeling, Computational psychometrics, Model validation. Design knowledge tracing and longitudinal learner models. Define 'mastery' and 'progression' operationally”
What You'll Achieve.
Build core differentiator: scientifically grounded learner intelligence; Ensure outputs are trustworthy, calibrated, and fair
Industry & Context.
Root cause analysis
Pass a background check, Identity verification measures
What They're Looking For.
Must Have
6+ years of experience in applied machine learning, data science, or applied research, Depth in knowledge tracing, sequence modeling, probabilistic modeling, temporal modeling, Bayesian approaches, or psychometrics / item response theory, Working understanding of computational psychometrics, Demonstrated ability to evaluate a model on more than accuracy, Experience working with longitudinal data, Python and ML stack skills
Nice to Have
Deep experience with computational psychometrics, psychometrics, educational measurement, or item response theory, Experience with learning science or adaptive learning systems, Experience building customer-facing learner progress or mastery products, Experience combining structured knowledge representations with learner models, Experience designing experiments or observational validation strategies for learning impact, Experience partnering with platform teams to run models reliably at scale on AWS
What You'll Do.
Design knowledge tracing and longitudinal learner models
Define 'mastery' and 'progression' operationally
Build robust training and scoring approaches
Own model trustworthiness
Lead evaluation for validity
Set bar for trustworthiness
Productionize learner models into reliable services
Monitor model quality in live environments
Collaborate with product and learning partners
Translate learning theory into scalable product systems
Communicate model behavior
How You'll Work.
Team & Collaboration
Partner with AI platform engineers; Work closely with product, engineering, and research partners
Communication Scope
Communicate modeling choices; Communicate assumptions; Communicate uncertainty
Full Job Description
At Instructure, we believe in the power of people to grow and succeed throughout their lives. Our goal is to amplify that power by creating intuitive products that simplify learning and personal development, facilitate meaningful relationships, and inspire people to go further in their education and careers. We do this by giving smart, creative, passionate people opportunities to create awesome. And that's where you come in: Our team builds AI-native capabilities, reusable AI systems, and shared infrastructure that power multiple products and workflows across the platform. We are looking for a Senior Applied Data Scientist to develop and validate knowledge tracing and longitudinal learner models, defining what "mastery" means operationally and ensuring the outputs are trustworthy, calibrated, and fair before they reach learners and educators. This is a measurement role as much as a modeling role, closer to computational psychometrics than to generic data science: a prediction that is accurate on average but miscalibrated, unstable, or unfair is not product-ready, and judging that difference is the core of the job. You will partner with AI platform engineers to productionize training and scoring pipelines and to monitor quality in live environments. You will work closely with product, engineering, and research partners to turn advanced AI ideas into reliable product capabilities used at scale. Important note on scope: This role is judged on the validity of what the models claim about a learner (calibration, fairness, and stability over time), not on predictive accuracy alone, and not on BI/reporting or experimentation analytics. We are looking for someone who can define a construct, model it rigorously, and stand behind the result in a live product. WHAT YOU'LL DO - Design and build knowledge tracing and longitudinal learner models that support mastery and progression features surfaced to customers - Define what "mastery" and "progression" mean operationally: constru
Applying for this Senior Applied Data Scientist, Learner Modeling role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Ashby
- Ashby is a fast modern ATS — most applications take under 3 minutes.
- The resume parser is strong; verify parsed experience dates and job titles.
- Custom screening questions are often scored algorithmically — answer completely.
- Location field affects geo-based screening; use your actual metro area.
ANONYMOUS · UNFILTERED
What do employees actually say about Instructure?
Real rants from real employees. Read before you apply.