Achieving acceptable reliability in oral examinations: an analysis of the Royal College of General Practitioners membership examination's oral component.

Background: The membership examination of the Royal College of General Practitioners (RCGP) uses structured oral examinations to assess candidates' decision making skills and professional values.

Aim: To estimate three indices of reliability for these oral examinations.

Methods: In summer 1998, a revised system was introduced for the oral examinations.