AI Article Synopsis

  • Measurement invariance refers to ensuring that a measurement tool functions consistently across different contexts, particularly when those contexts are relevant to the attributes being measured.
  • Misapplying measurement invariance techniques can lead to measurement biases and reduced validity in assessments, particularly in fields like youth mental health, where discrepancies among different informants (like parents and teachers) often contain important, relevant information.
  • The paper argues against the premature application of measurement invariance techniques without addressing these discrepancies and highlights the need to consider conceptual, methodological, and measurement factors to improve research validity.

Article Abstract

On page 1 of his classic text, Millsap (2011) states, "Measurement invariance is built on the notion that a measuring device should function the same way across varied conditions, so long as those varied conditions are [emphasis added] to the attribute being measured." By construction, measurement invariance techniques require not only detecting varied conditions but also ruling out that these conditions inform our understanding of measured domains (i.e., conditions that do not contain ). In fact, measurement invariance techniques possess great utility when theory and research inform their application to specific, varied conditions (e.g., cultural, ethnic, or racial background of test respondents) that, if not detected, introduce measurement biases, and, thus, depress measurement validity (e.g., academic achievement and intelligence). Yet, we see emerging bodies of work where scholars have "put the cart before the horse" when it comes to measurement invariance, and they apply these techniques to varied conditions that, in fact, may reflect domain-relevant information. These bodies of work highlight a larger problem in measurement that likely cuts across many areas of scholarship. In one such area, youth mental health, researchers commonly encounter a set of conditions that nullify the use of measurement invariance, namely discrepancies between survey reports completed by multiple informants, such as parents, teachers, and youth themselves (i.e., ). In this paper, we provide an overview of conceptual, methodological, and measurement factors that should prevent researchers from applying measurement invariance techniques to detect informant discrepancies. Along the way, we cite evidence from the last 15 years indicating that informant discrepancies reflect domain-relevant information. We also apply this evidence to recent uses of measurement invariance techniques in youth mental health. Based on prior evidence, we highlight the implications of applying these techniques to multi-informant data, when the informant discrepancies observed within these data might reflect domain-relevant information. We close by calling for a moratorium on applying measurement invariance techniques to detect informant discrepancies in youth mental health assessments. In doing so, we describe how the state of the science would need to fundamentally "flip" to justify applying these techniques to detect informant discrepancies in this area of work.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9378825PMC
http://dx.doi.org/10.3389/fpsyg.2022.931296DOI Listing

Publication Analysis

Top Keywords

measurement invariance
32
invariance techniques
24
informant discrepancies
24
varied conditions
20
techniques detect
16
detect informant
16
youth mental
16
mental health
16
measurement
13
reflect domain-relevant
12

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!