Variability in doctors' problem-solving as measured by open-ended written patient simulations.

The uncertain validity of written simulations could be due to the difficulty in setting criteria for optimal performance. Usually criteria are set by definition of a limited number of 'correct answers' by a panel of experts reached through an open discussion. This is an artificial situation which entails mutual influence and forces the participants to respond to the necessity to reach a consensus.