· Milestones · 1 min read
UTSW Pilot Surpasses 7,000 AI-Graded Encounters
The lead site reaches a major milestone with over 7,000 standardized patient encounters graded using AI in production, establishing the foundation for multi-site expansion.
UT Southwestern Medical Center, the lead institution for the UT-REAL consortium, has surpassed 7,000 AI-graded OSCE encounters in production use across three academic years. The grant proposal estimates that the six participating medical schools collectively represent more than 3,200 medical students; that figure is not the number assessed at UTSW.
The MAPLES platform has been used for both formative and summative assessments, with AI grading results reviewed by faculty through a human-in-the-loop protocol. A 300-encounter retrospective medRxiv preprint reported three-camera AI grading agreement of quadratic weighted kappa = 0.830 against a physician-adjudicated reference, compared with 0.732 for standard human evaluators against the same reference.
This production track record at UTSW provides the validation foundation that UT-REAL will extend across five additional UT System medical schools.
