Predictive Validity using Item Response Theory
Classical Test Theory treats every question as equal. Lumi does not. We model each item's difficulty and discrimination to recover a student's true latent ability — the signal that actually forecasts exam-day performance.
Why a raw score lies to you
Under Classical Test Theory, a student who answers 30 of 50 questions correctly earns a 60% — regardless of which 30. But a student who solves the 30 hardest questions has demonstrably more ability than one who solves the 30 easiest. A raw percentage throws that information away, and with it, any hope of an honest forecast.
Item Response Theory reframes the problem. Instead of scoring the test, we estimate a latent trait — ability, denoted θ — that explains the pattern of right and wrong answers across items of known difficulty.
The 3-Parameter Logistic model
Lumi calibrates a 3PL model in which the probability that a student with ability θ answers item i correctly is:
The ability level at which a student has a 50% chance of solving the item (above the guessing floor). Higher b = harder question.
How sharply the item separates strong from weak students. High-a items are the ones that tell us the most about θ.
The lower asymptote — the chance a low-ability student answers correctly by chance on a 4-option MCQ (≈0.25).
Calibrated on real attempts, validated against real outcomes
We estimate per-item (a, b) parameters from hundreds of thousands of historical attempts using a marginal-maximum-likelihood fit. Each student's θ is then updated continuously as they practice — every answer is evidence that sharpens the estimate.
The result feeds Lumi's score predictor: a projected NEET / JEE mark with a calibrated confidence band, back-tested against actual exam results so that "you are tracking ~640/720" means what it says — not a vanity number.
Item parameters are recalibrated as new attempt data arrives, so difficulty estimates track the real student population rather than an author's guess at exam-writing time.
Bring calibrated forecasting to your campus.
Integrate Lumi's validated predictive models into your institution via our Enterprise API.