Quality and rigor of the concept mapping methodology: a pooled study analysis.

Eval Program Plann

Concept Systems, Inc., 136 East State Street, Ithaca, NY 14850, USA.

Published: May 2012

The use of concept mapping in research and evaluation has expanded dramatically over the past 20 years. Researchers in academic, organizational, and community-based settings have applied concept mapping successfully without the benefit of systematic analyses across studies to identify the features of a methodologically sound study. Quantitative characteristics and estimates of quality and rigor that may guide for future studies are lacking. To address this gap, we conducted a pooled analysis of 69 concept mapping studies to describe characteristics across study phases, generate specific indicators of validity and reliability, and examine the relationship between select study characteristics and quality indicators. Individual study characteristics and estimates were pooled and quantitatively summarized, describing the distribution, variation and parameters for each. In addition, variation in the concept mapping data collection in relation to characteristics and estimates was examined. Overall, results suggest concept mapping yields strong internal representational validity and very strong sorting and rating reliability estimates. Validity and reliability were consistently high despite variation in participation and task completion percentages across data collection modes. The implications of these findings as a practical reference to assess the quality and rigor for future concept mapping studies are discussed.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.evalprogplan.2011.10.003DOI Listing

Publication Analysis

Top Keywords

concept mapping
28
quality rigor
12
characteristics estimates
12
analysis concept
8
mapping studies
8
validity reliability
8
study characteristics
8
data collection
8
concept
7
mapping
7

Similar Publications

Towards carbon neutrality: mapping mass retrofit opportunities in Cambridge, UK.

R Soc Open Sci

January 2025

Sustainable Design Group, Department of Architecture, University of Cambridge, Cambridge CB2 1PX, UK.

This study proposes a methodology and a proof of concept to target and prioritize mass retrofitting of residential buildings in the UK using open building datasets that combine fabric energy efficiency and fuel poverty to meet the net-zero targets. The methodological framework uses a series of multi-variate statistical and geospatial methods that consider urban, socio-economic and physical attributes. In addition, thermal imaging is implemented to provide insights at the building scale.

View Article and Find Full Text PDF

Background: Sexual health includes physical, emotional, mental, and social wellbeing related to sexuality. Given people with mild intellectual disabilities' reliance on relatives and support staff, it is important to explore the latter's understanding of sexual health.

Method: Relatives ( = 7) and support staff ( = 15) of people with mild intellectual disabilities participated in a concept mapping procedure that included brainstorming, sorting and ranking activities.

View Article and Find Full Text PDF

Alpha-1 antitrypsin (AAT) deficiency (AATD) is a monogenic disease caused by misfolding of AAT variants resulting in gain-of-toxic aggregation in the liver and loss of monomer activity in the lung leading to chronic obstructive pulmonary disease (COPD). Using high-throughput screening, we discovered a bioactive natural product, phenethyl isothiocyanate (PEITC), highly enriched in cruciferous vegetables, including watercress and broccoli, which improves the level of monomer secretion and neutrophil elastase (NE) inhibitory activity of AAT-Z through the endoplasmic reticulum (ER) redox sensor protein disulfide isomerase (PDI) A4 (PDIA4). The intracellular polymer burden of AAT-Z can be managed by combination treatment of PEITC and an autophagy activator.

View Article and Find Full Text PDF

Sclerosis is a highly morbid manifestation of chronic GVHD (cGVHD), associated with distressing symptoms and significant long-term disability. A patient-reported outcome measure (PRO) for cGVHD-associated sclerosis is essential to advance therapeutic trials. We aimed to develop a PRO for adults with cGVHD-associated sclerosis and evaluate and refine its content validity.

View Article and Find Full Text PDF

Introduction: Infertility is a complex condition that affects millions worldwide, with significant physical, emotional and social implications. Mobile apps have emerged as potential tools to assist in the management of infertility by offering features such as menstrual cycle tracking, ovulation prediction, fertility education, lifestyle modification guidance and emotional support, thereby promoting reproductive health. Despite promising advancements such as the development of apps with sophisticated algorithms for ovulation prediction and comprehensive platforms offering integrated fertility education and emotional support, there remain gaps in the literature regarding the comprehensive evaluation of mobile apps for reproductive endocrinology and infertility.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!