Use of the journal impact factor for assessing individual articles: Statistically flawed or not?

F1000Res

Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands.

Published: April 2021

Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7974631PMC
http://dx.doi.org/10.12688/f1000research.23418.2DOI Listing

Publication Analysis

Top Keywords

impact factor
40
individual articles
20
factor assessing
12
assessing individual
12
factor
10
impact
9
journal impact
8
arguments impact
8
factor level
8
level individual
8

Similar Publications

The longitudinal relationship between co-rumination and emotional problems has been understudied, particularly regarding the role of protective factors in moderating the relationship. This study employed a cross-lagged analysis to examine the bi-directional relationship between co-rumination and emotional problems, and the moderating role of self-compassion in this dynamic. The participants comprised 814 Chinese junior school students (M = 13.

View Article and Find Full Text PDF

Background: Results on parental burden during the COVID-19 pandemic are predominantly available from nonrepresentative samples. Although sample selection can significantly influence results, the effects of sampling strategies have been largely underexplored.

Objective: This study aimed to investigate how sampling strategy may impact study results.

View Article and Find Full Text PDF

Background: There is potential for digital mental health interventions to provide affordable, efficient, and scalable support to individuals. Digital interventions, including cognitive behavioral therapy, stress management, and mindfulness programs, have shown promise when applied in workplace settings.

Objective: The aim of this study is to conduct an umbrella review of systematic reviews in order to critically evaluate, synthesize, and summarize evidence of various digital mental health interventions available within a workplace setting.

View Article and Find Full Text PDF

Background: Recent advancements in artificial intelligence (AI) have changed the care processes in mental health, particularly in decision-making support for health care professionals and individuals with mental health problems. AI systems provide support in several domains of mental health, including early detection, diagnostics, treatment, and self-care. The use of AI systems in care flows faces several challenges in relation to decision-making support, stemming from technology, end-user, and organizational perspectives with the AI disruption of care processes.

View Article and Find Full Text PDF

Preoperative Anemia as a Prognostic Risk Factor for Inferior Oncological Survival Following Resection for Pancreatic Ductal Adenocarcinoma.

Pancreas

January 2025

Department of Surgery, Division of Hepato-Pancreato-Biliary Surgery and Liver Transplantation, University Medical Center Groningen, University of Groningen, the Netherlands.

Objectives: A significant proportion of patients undergoing surgery for pancreatic ductal adenocarcinoma (PDAC) are anemic at the time of resection. In these patients, blood transfusions are omitted due to their potential negative impact on oncological outcomes. The aim of the present study was to determine the prognostic value of preoperative anemia in resected PDAC patients, irrespective of blood transfusion status.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!