Composition of the panel of reference for concordance tests: do teaching functions have an impact on examinees' ranks and absolute scores?

Background: Concordance tests are designed to assess the component of uncertainty of clinical reasoning. Scoring is based on a comparison of examinees' answers with those of a panel of reference, including their variability. This allows construction of tests that are close to real clinical life, with all its complexity and ambiguity.

Assessment of clinical reasoning in the context of uncertainty: the effect of variability within the reference panel.

The Script Concordance Test (SCT) assesses reasoning in the context of uncertainty. Because there is no single correct answer, scoring is based on the comparison of answers provided by examinees with those provided by members of a reference panel made up of experienced practitioners. The study aimed to assess the discriminatory power of the SCT based on the variability of the reference panel's answers.

The cognitive validity of the Script Concordance Test: a processing time study.

Background: According to the theory on which the Script Concordance Test (SCT) is based, scripts contain expectations on features that are associated with each illness and about the range of values that are typical, atypical, or incompatible.

Purpose: To document the construct validity of the SCT, we investigated the theory prediction that once a script is activated, new incoming information (e.g.