Standard Setting in an OSCE

Setting the score with which a candidate could be considered to pass or fail an exam.

RCEM Use the Borderline Regression Method to standard set all OSCE examinations

Criterion referenced exams

• RCEM OSCEs are Criterion referenced examinations
• Candidates need to meet the determined standard to pass
• All candidates could pass if they meet this standard

Borderline Candidate

• The Borderline regression method requires the examiners to identify the borderline candidate
• Examiners must have a clear picture of the standard required of a candidate at this stage of their training
• For Membership level (MRCEM OSCE) = Day 1 Registrar
• For Fellowship level (FRCEM OSCE) = Day 1 Consultant
• Candidate Exam Scores and Exam Pass Mark
• Candidate Exam Score is The Sum of Total Score across 16 stations (Max 160 Marks)
• Exam Pass Mark is Sum of Each Station Cut score + 1 SEM (Standard Error of Measurement)

The Borderline Regression Method

Candidate domain scores plotted against the global judgement

A regression line is then drawn from the data

The cut score is midpoint between a borderline pass and borderline fail (crosses the regression line)