A psychological framework for different types of items commonly used with mixed-format exams is proposed. A choice model based on signal detection theory (SDT) is used for multiple-choice (MC) items, whereas an item response theory (IRT) model is used for open-ended (OE) items. The SDT and IRT models are shown to share a common conceptualization in terms of latent states of "know/don't know" at the examinee level.
View Article and Find Full Text PDFA model for multiple-choice exams is developed from a signal-detection perspective. A correct alternative in a multiple-choice exam can be viewed as being a signal embedded in noise (incorrect alternatives). Examinees are assumed to have perceptions of the plausibility of each alternative, and the decision process is to choose the most plausible alternative.
View Article and Find Full Text PDFAppl Psychol Meas
May 2020
A true-false exam can be viewed as being a signal detection task-the task is to detect whether or not an item is true (signal) or false (noise). In terms of signal detection theory (SDT), examinees can be viewed as performing the task by comparing the perceived plausibility of an item (a perceptual component) to a threshold that delineates true from false (a decision component). The resulting model is distinct yet is related to item response theory (IRT) models and grade of membership models, with the difference that SDT explicitly recognizes the role of examinees' perceptions in determining their response to an item.
View Article and Find Full Text PDFAims: This study investigated whether Pavlovian extinction occurs during smoking cessation by determining whether experience abstaining from smoking in the presence of cigarette cues leads to decreased probability of lapsing and whether this effect is mediated by craving.
Design: Secondary analyses were carried out with data sets from two studies with correlational/observational designs.
Setting: Data were collected in smokers' natural environments using ecological momentary assessment techniques.
J Exp Psychol Learn Mem Cogn
November 2008
The process dissociation procedure was developed in an attempt to separate different processes involved in memory tasks. The procedure naturally lends itself to a formulation within a class of mixture signal detection models. The dual process model is shown to be a special case.
View Article and Find Full Text PDFThe mirror effect for word frequency refers to the finding that low-frequency words have higher hit rates and lower false alarm rates than high-frequency words. This result is typically interpreted in terms of conventional signal detection theory (SDT), in which case it indicates that the order of the underlying old item distributions mirrors the order of the new item distributions. However, when viewed in terms of a mixture version of SDT, the order of hits and false alarms does not necessarily imply the same order in the underlying distributions because of possible effects of mixing.
View Article and Find Full Text PDFSequential effects are examined in a cross-modality matching experiment where observers adjusted the loudness of a tone in response to presented lengths of a metal tape. In one condition, the initial level of the tone to be adjusted was the same as the final adjusted level of the previous trial, whereas in another condition, the tone to be adjusted was reset to a different level before each trial. A fit of the DeCarlo-Cross dynamic model shows that the primary effect of the manipulation was on a judgmental factor, with little or no effect on a perceptual factor.
View Article and Find Full Text PDFObjectives: We compared the effectiveness of a telephone outreach approach versus a direct mail approach in improving rates of colorectal cancer (CRC) screening in a predominantly Black population.
Methods: A randomized trial was conducted between 2000 and 2003 that followed 456 participants in the New York metropolitan area who had not had recent CRC screening. The intervention group received tailored telephone outreach, and the control group received mailed printed materials.
Sequential effects are examined in four successive ratio estimation (RE) experiments. The procedure in successive RE is identical to that for magnitude estimation (ME), but the task in successive RE is to estimate the ratio of the current to the previous sensation magnitude, and not the separate magnitudes of the sensations. A positive stimulus context effect was found in successive RE for several continua, in agreement with results previously found for ME.
View Article and Find Full Text PDFBias in magnitude scaling can be viewed as involving deviations of judgments from proportionality. A model of bias is shown to provide a theoretical basis for Stevens's conjecture about geometrically averaging magnitude estimation and magnitude production exponents in order to obtain an estimate of the psychophysical exponent. An overlooked result is that one can also obtain an estimate of the magnitude of the bias.
View Article and Find Full Text PDFJ Exp Psychol Learn Mem Cogn
September 2003
A mixture extension of signal detection theory is applied to source discrimination. The basic idea of the approach is that only a portion of the sources (say A or B) of items to be discriminated is encoded or attended to during the study period. As a result, in addition to 2 underlying probability distributions associated with the 2 sources, there is a 3rd distribution that represents items for which sources were not attended to.
View Article and Find Full Text PDFBehav Res Methods Instrum Comput
February 2003
The recent addition of aprocedure in SPSS for the analysis of ordinal regression models offers a simple means for researchers to fit the unequal variance normal signal detection model and other extended signal detection models. The present article shows how to implement the analysis and how to interpret the SPSS output. Examples of fitting the unequal variance normal model and other generalized signal detection models are given.
View Article and Find Full Text PDFPercept Psychophys
January 2003
A dynamic model of judgment, together with a model of stimulus context effects, is applied to magnitude production (MP) and magnitude estimation (ME) experiments. Participants' responses in MP were correlated across trials, as is typically found for ME. The magnitudeof the autocorrelation, however, was small, which suggests that participants in MP tend to rely more heavily on a long-term frame of reference.
View Article and Find Full Text PDFSource memory has become the focus of a growing number of investigations in a variety of fields. An appropriate model for source memory is, therefore, of increasing importance. A simple 2-dimensional signal-detection model of source recognition is presented.
View Article and Find Full Text PDFAn extension of signal detection theory (SDT) that incorporates mixtures of the underlying distributions is presented. The mixtures can be motivated by the idea that a presentation of a signal shifts the location of an underlying distribution only if the observer is attending to the signal; otherwise, the distribution is not shifted or is only partially shifted. Thus, trials with a signal presentation consist of a mixture of 2 (or more) latent classes of trials.
View Article and Find Full Text PDFMultivariate Behav Res
October 2002
A latent class extension of signal detection theory is presented and applications are illustrated. The approach is useful for situations where observers attempt to detect latent categorical events or where the goal of the analysis is to select or classify cases. Signal detection theory is shown to offer a simple summary of the observers' performance in terms of detection and response criteria.
View Article and Find Full Text PDFA Parental Values scale, in which students ranked the top 5 of 10 items in terms of how important they perceived the items as being to their parents, was analyzed using a latent class ranking model. A model with three latent classes was considered adequate, based on the Bayesian information criterion and the interpretability of the results. The three classes were interpreted as consisting of students who perceive their parents as valuing personal happiness, those who perceive their parents as valuing concern for others, and those who perceive their parents as valuing academics and attending a good college.
View Article and Find Full Text PDF