Capturing richer information: On establishing the validity of an interval-valued survey response mode.

Behav Res Methods

Department of Social and Decision Sciences, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA, 15213, USA.

Published: June 2022

Obtaining quantitative survey responses that are both accurate and informative is crucial to a wide range of fields. Traditional and ubiquitous response formats such as Likert and visual analogue scales require condensation of responses into discrete or point values-but sometimes a range of options may better represent the correct answer. In this paper, we propose an efficient interval-valued response mode, whereby responses are made by marking an ellipse along a continuous scale. We discuss its potential to capture and quantify valuable information that would be lost using conventional approaches, while preserving a high degree of response efficiency. The information captured by the response interval may represent a possible response range-i.e., a conjunctive set, such as the real numbers between 3 and 6. Alternatively, it may reflect uncertainty in respect to a distinct response-i.e., a disjunctive set, such as a confidence interval. We then report a validation study, utilizing our recently introduced open-source software (DECSYS), to explore how interval-valued survey responses reflect experimental manipulations of several factors hypothesised to influence interval width, across multiple contexts. Results consistently indicate that respondents used interval widths effectively, and subjective participant feedback was also positive. We present this as initial empirical evidence for the efficacy and value of interval-valued response capture. Interestingly, our results also provide insight into respondents' reasoning about the different aforementioned types of intervals-we replicate a tendency towards overconfidence for those representing epistemic uncertainty (i.e., disjunctive sets), but find intervals representing inherent range (i.e., conjunctive sets) to be well-calibrated.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9170647PMC
http://dx.doi.org/10.3758/s13428-021-01635-0DOI Listing

Publication Analysis

Top Keywords

interval-valued survey
8
response mode
8
survey responses
8
interval-valued response
8
response
7
capturing richer
4
richer establishing
4
establishing validity
4
interval-valued
4
validity interval-valued
4

Similar Publications

The identification and evaluation of barriers to artificial intelligence (AI) adoption in food supply chain finance (FSCF) can be addressed as a multiattribute decision-making problem. However, only a few studies have reported the application of decision models for evaluating barriers to the implementation of AI in FSCF, especially within an uncertain context. Hence, this work explores the evaluation issue of implementation barriers via an integrated decision model.

View Article and Find Full Text PDF

In order to encourage the use of public transportation, it is necessary to make it more appealing to commuters by conducting frequent Service Quality (SQ) evaluations and modifications. Understanding passengers' expectations of public transportation are important, and evaluating the SQ is an essential tool for assessing the overall performance of the public transportation system. The purpose of the present study was to examine the expectations and perceptions of core passengers regarding SQ in public bus transportation.

View Article and Find Full Text PDF

This paper proposes a novel fuzzy multi-criteria decision-making method based on an improved score function of connection numbers and Choquet integral under interval-valued Pythagorean fuzzy environment. To do so, we first introduce a method to convert interval-valued Pythagorean fuzzy numbers into connection numbers based on the set pair analysis theory. Then an improved score function of connection numbers is proposed to make the ranking order of connection numbers more in line with reality in multi-criteria decision-making process.

View Article and Find Full Text PDF

Capturing richer information: On establishing the validity of an interval-valued survey response mode.

Behav Res Methods

June 2022

Department of Social and Decision Sciences, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA, 15213, USA.

Obtaining quantitative survey responses that are both accurate and informative is crucial to a wide range of fields. Traditional and ubiquitous response formats such as Likert and visual analogue scales require condensation of responses into discrete or point values-but sometimes a range of options may better represent the correct answer. In this paper, we propose an efficient interval-valued response mode, whereby responses are made by marking an ellipse along a continuous scale.

View Article and Find Full Text PDF

This study investigates the degree of importance of criteria affecting the optimal site selection of offshore wind farms. Firstly, forty two different influential criteria have been selected by reviewing the scientific literature on offshore wind farm site selection. Secondly, a survey has been conducted receiving a response from thirty four internationally renowned experts across seventeen countries.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!