A guided tutorial on linear mixed-effects models for the analysis of accuracies and response times in experiments with fully crossed design.

Experiments with fully crossed designs are often used in experimental psychology spanning several fields, from cognitive psychology to social cognition. These experiments consist in the presentation of stimuli representing super-ordinate categories, which have to be sorted into the correct category in two contrasting conditions. This tutorial presents a linear mixed-effects model approach for obtaining Rasch-like parameterizations of response times and accuracies of fully crossed design data.

Assessing key soft skills in organizational contexts: development and validation of the multiple soft skills assessment tool.

Introduction: Soft skills, also known as transversal skills, have gained significant attention in the organizational context due to their positive impact on various work-related outcomes. The present study aimed to develop and validate the Multiple Soft Skills Assessment Tool (MSSAT), a short self-report instrument that evaluates interpersonal skills (initiative-resourcefulness, assertiveness, conflict management), interpersonal communication skills, decision-making style (adaptive and maladaptive), and moral integrity.

Methods: The scale development process involved selecting and adapting relevant items from existing scales and employing a cross-validation approach with a large sample of workers from diverse organizational settings and job positions ( = 639).

Constructing tests for skill assessment with competence-based test development.

Competence-based test development is a recent and innovative method for the construction of tests that are as informative as possible about the competence state (the set of skills an individual has available) underlying the observed item responses. It finds application in different contexts, including the development of tests from scratch, and the improvement or shortening of existing tests. Given a fixed collection of competence states existing in a population of individuals and a fixed collection of competencies (each of which being the subset of skills that allow for solving an item), the competency deletion procedure results in tests that differ from each other in the competencies but are all equally informative about individuals' competence states.

PsycAssist: A Web-Based Artificial Intelligence System Designed for Adaptive Neuropsychological Assessment and Training.

Assessing executive functions in individuals with disorders or clinical conditions can be challenging, as they may lack the abilities needed for conventional test formats. The use of more personalized test versions, such as adaptive assessments, might be helpful in evaluating individuals with specific needs. This paper introduces PsycAssist, a web-based artificial intelligence system designed for neuropsychological adaptive assessment and training.

Development of a scale for capturing psychological aspects of physical-digital integration: relationships with psychosocial functioning and facial emotion recognition.

The present work aims at developing a scale for the assessment of a construct that we called "physical-digital integration", which refers to the tendency of some individuals not to perceive a clear differentiation between feelings and perceptions that pertain to the physical or digital environment. The construct is articulated in four facets: identity, social relationships, time-space perception, and sensory perception. Data from a sample of 369 participants were collected to evaluate factor structure (unidimensional model, bifactor model, correlated four-factor model), internal consistency (Cronbach's , McDonald's ), and correlations of the physical-digital integration scale with other measures.

Enhancing Computerized Adaptive Testing with Batteries of Unidimensional Tests.

The article presents a new computerized adaptive testing (CAT) procedure for use with batteries of unidimensional tests. At each step of testing, the estimate of a certain ability is updated on the basis of the response to the latest administered item and the current estimates of all other abilities measured by the battery. The information deriving from these abilities is incorporated into an empirical prior that is updated each time that new estimates of the abilities are computed.

Machine learning-decision tree classifiers in psychiatric assessment: An application to the diagnosis of major depressive disorder.

This work illustrates the advantages of using machine learning classifiers in psychiatric assessment. Machine learning-decision trees (ML-DTs) represent a new approach to scoring and interpreting psychodiagnostic test data that allows for increasing assessment accuracy and efficiency. The approach is outlined in an easy yet detailed way, and its application is illustrated on real psychodiagnostic test data.

Is the performance at the implicit association test sensitive to feedback presentation? A Rasch-based analysis.

The Implicit Association Test (IAT) is commonly used for the indirect assessment of psychological constructs. While the features of the IAT that might influence the performance of the respondents have been extensively investigated, the effect of informing the respondents about the correctness of their responses (i.e.

Italian Diagnostic Adaptive Behavior Scale: Reliability and diagnostic accuracy compared with the Vineland-II.

Background: The Diagnostic Adaptive Behavior Scale (DABS) is a short scale with excellent properties to assess the conceptual, social, and practical adaptive behavior domains for the diagnosis of intellectual disability (ID) in individuals aged 4-21 years.

Aims: Investigate the test-retest and inter-respondent reliability of the Italian adaptation of the DABS, verify its diagnostic accuracy in identifying individuals with ID and excluding individuals with typical development (TD), and compare its psychometric properties to those of the Vineland-II.

Methods: Test-retest reliability: The same respondent completed the Italian DABS for the same assessed person at two separate times (n = 71).

COVID-19 emergency: the influence of implicit attitudes, information sources, and individual characteristics on psychological distress, intentions to get vaccinated, and compliance with restrictive rules.

Background: To limit the spread of the COVID-19 emergency, a massive vaccination program was implemented and restrictive measures were imposed on the population. However, the propensity to adhere to the vaccination program has struggled to take off. Moreover, complying with the restrictive rules and maintaining social distancing have been highly distressing for many individuals.

An Item Response Theory-Based Scoring of the South Oaks Gambling Screen-Revised Adolescents.

The South Oaks Gambling Screen-Revised Adolescent (SOGS-RA) is one of the most widely used screening tools for problem gambling among adolescents. In this study, item response theory was used for computing measures of problem gambling severity that took into account how much information the endorsed items provided about the presence of problem gambling. A zero-inflated mixture two-parameter logistic model was estimated on the responses of 4,404 adolescents to the South Oaks Gambling Screen-Revised Adolescent to compute the difficulty and discrimination of each item, and the problem gambling severity level (θ score) of each respondent.

Does discrimination beat association in the IAT? The discrimination-association model reconceived.

The discrimination-association model (DAM; Stefanutti et al. 2013) disentangles two components underlying the responses to the implicit association test (IAT), which pertain to stimuli discrimination (the strength of the association of the stimuli with their own category) and automatic association (the strength of the association between targets and attributes). The assumption of the DAM that these two components sum into a single process generates critical drawbacks.

DscoreApp: A Shiny Web Application for the Computation of the Implicit Association Test D-Score.

Several options are available for computing the most common score for the Implicit Association Test, the so-called . However, all these options come with some drawbacks, related to either the need for a license, for being tailored on a specific administration procedure, or for requiring a degree of familiarity with programming. By using the R package, a user-friendly, interactive, and open source web application (DscoreApp) has been created for the computation.

New Perspectives in Computing the Point of Subjective Equality Using Rasch Models.

In psychophysics, the point of subject equality (PSE) is any of the points along a stimulus dimension at which a variable stimulus (visual, tactile, auditory, and so on) is judged by an observer to be equal to a standard stimulus. Rasch models have been found to offer a valid solution for computing the PSE when the method of constant stimuli is applied in the version of the method of transitions. The present work provides an overview of the procedures for computing the PSE using Rasch models and proposes some new developments.

A Comparison of Classical and Modern Measures of Internal Consistency.

Three measures of internal consistency - Kuder-Richardson Formula 20 (KR20), Cronbach's alpha (α), and person separation reliability (R) - are considered. KR20 and α are common measures in classical test theory, whereas R is developed in modern test theory and, more precisely, in Rasch measurement. These three measures specify the observed variance as the sum of true variance and error variance.

Using Item Response Theory for the Development of a New Short Form of the Eysenck Personality Questionnaire-Revised.

The present work aims at developing a new version of the short form of the Eysenck Personality Questionnaire-Revised, which includes Psychoticism, Extraversion, Neuroticism, and Lie scales (48 items, 12 per scale). The work consists of two studies. In the first one, an item response theory model was estimated on the responses of 590 individuals to the full-length version of the questionnaire (100 items).

Testing the actual equivalence of automatically generated items.

If the automatic item generation is used for generating test items, the question of how the equivalence among different instances may be tested is fundamental to assure an accurate assessment. In the present research, the question was dealt by using the knowledge space theory framework. Two different ways of considering the equivalence among instances are proposed: The former is at a deterministic level and it requires that all the instances of an item template must belong to exactly the same knowledge states; the latter adds a probabilistic level to the deterministic one.

An evaluation system for postgraduate pediatric residency programs: report of a 3-year experience.

Unlabelled: The way a postgraduate medical training program is organized and the capacity of faculty members to function as tutors and to organize effective professional experiences are among the elements that affect the quality of training. An evaluation system designed to target these elements has been implemented within the framework of the Pediatric Residency Program of the University of Padua (Italy). The aim of this report is to describe some aspects of the experience gained in the first 3 years of implementation of the system (2013-2015).

The assessment of knowledge and learning in competence spaces: The gain-loss model for dependent skills.

The gain-loss model (GaLoM) is a formal model for assessing knowledge and learning. In its original formulation, the GaLoM assumes independence among the skills. Such an assumption is not reasonable in several domains, in which some preliminary knowledge is the foundation for other knowledge.

An Upgrading Procedure for Adaptive Assessment of Knowledge.

In knowledge space theory, existing adaptive assessment procedures can only be applied when suitable estimates of their parameters are available. In this paper, an iterative procedure is proposed, which upgrades its parameters with the increasing number of assessments. The first assessments are run using parameter values that favor accuracy over efficiency.

Modeling missing data in knowledge space theory.

Missing data are a well known issue in statistical inference, because some responses may be missing, even when data are collected carefully. The problem that arises in these cases is how to deal with missing data. In this article, the missingness is analyzed in knowledge space theory, and in particular when the basic local independence model (BLIM) is applied to the data.

Naïve Tests of Basic Local Independence Model's Invariance.

The basic local independence model (BLIM) is a probabilistic model for knowledge structures, characterized by the property that lucky guess and careless error parameters of the items are independent of the knowledge states of the subjects. When fitting the BLIM to empirical data, a good fit can be obtained even when the invariance assumption is violated. Therefore, statistical tests are needed for detecting violations of this specific assumption.

On the Link between Cognitive Diagnostic Models and Knowledge Space Theory.

The present work explores the connections between cognitive diagnostic models (CDM) and knowledge space theory (KST) and shows that these two quite distinct approaches overlap. It is proved that in fact the Multiple Strategy DINA (Deterministic Input Noisy AND-gate) model and the CBLIM, a competence-based extension of the basic local independence model (BLIM), are equivalent. To demonstrate the benefits that arise from integrating the two theoretical perspectives, it is shown that a fairly complete picture on the identifiability of these models emerges by combining results from both camps.

Validating a set of tools designed to assess the perceived quality of training of pediatric residency programs.

Background: The Paediatric Residency Program (PRP) of Padua, Italy, developed a set of questionnaires to assess the quality of the training provided by each faculty member, the quality of the professional experience the residents experienced during the various rotations and the functioning of the Resident Affair Committee (RAC), named respectively: "Tutor Assessment Questionnaire" (TAQ), "Rotation Assessment Questionnaire" (RAQ), and RAC Assessment Questionnaire". The process that brought to their validation are herein presented.

Method: Between July 2012 and July 2013, 51 residents evaluated 26 tutors through the TAQ, and 25 rotations through the RAQ.