Psychometric properties of the mock interview rating scale for autistic transition-age youth.

Background: Employment is a major contributor to quality of life. However, autistic people are often unemployed and underemployed. One potential barrier to employment is the job interview. However, the availability of psychometrically-evaluated assessments of job interviewing skills is limited for autism services providers and researchers.

Objective: We analyzed the psychometric properties of the Mock Interview Rating Scale that was adapted for research with autistic transition-age youth (A-MIRS; a comprehensive assessment of video-recorded job interview role-play scenarios using anchor-based ratings for 14 scripted job scenarios).

Methods: Eighty-five transition-age youth with autism completed one of two randomized controlled trials to test the effectiveness of two interventions focused on job interview skills. All participants completed a single job interview role-play at pre-test that was scored by raters using the A-MIRS. We analyzed the structure of the A-MIRS using classical test theory, which involved conducting both exploratory and confirmatory factor analyzes, Rasch model analysis and calibration techniques. We then assessed internal consistency, inter-rater reliability, and test-retest reliability. Pearson correlations were used to assess the A-MIRS' construct, convergent, divergent, criterion, and predictive validities by comparing it to demographic, clinical, cognitive, work history measures, and employment outcomes.

Results: Results revealed an 11-item unidimensional construct with strong internal consistency, inter-rater reliability, and test-retest reliability. Construct [pragmatic social skills ( = 0.61,  < 0.001), self-reported interview skills ( = 0.34,  = 0.001)], divergent [e.g., age ( = -0.13,  = 0.26), race ( = 0.02,  = 0.87)], and predictive validities [competitive employment ( = 0.31,  = 0.03)] received initial support via study correlations, while convergent [e.g., intrinsic motivation ( = 0.32,  = 0.007), job interview anxiety ( = -0.19,  = 0.08)] and criterion [e.g., prior employment ( = 0.22,  = 0.046), current employment ( = 0.21,  = 0.054)] validities were limited.

Conclusion: The psychometric properties of the 11-item A-MIRS ranged from strong-to-acceptable, indicating it may have utility as a reliable and valid method for assessing the job interview skills of autistic transition-age youth.