Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review

Objectives: With the emergence of HIV/AIDS journals, the development of the reporting of statistical inference and effect measures in published abstracts can be examined from the beginning in a new field. The aim of this study was to describe time trends of statistical inference and effect measure r...

Full description

Saved in:
Bibliographic Details
Main Authors: Andreas Stang, Henning Schäfer, Ahmad Idrissi-Yaghir, Christoph M. Friedrich, Matthew P. Fox
Format: Article
Language:English
Published: Elsevier 2025-12-01
Series:Global Epidemiology
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590113325000318
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1839603996747104256
author Andreas Stang
Henning Schäfer
Ahmad Idrissi-Yaghir
Christoph M. Friedrich
Matthew P. Fox
author_facet Andreas Stang
Henning Schäfer
Ahmad Idrissi-Yaghir
Christoph M. Friedrich
Matthew P. Fox
author_sort Andreas Stang
collection DOAJ
description Objectives: With the emergence of HIV/AIDS journals, the development of the reporting of statistical inference and effect measures in published abstracts can be examined from the beginning in a new field. The aim of this study was to describe time trends of statistical inference and effect measure reporting of major HIV/AIDS journals Methods: We included 10 major HIV/AIDS journals and analyzed all available PubMed entries for the period 1987 through 2022. We applied rule-based text mining and machine learning methodology to detect the presence of confidence intervals, numerical p-values or comparisons of p-values with thresholds, language describing statistical significance, and effect measures for dichotomous outcomes Results: Among 41,730 PubMed entries from the major HIV/AIDS journals, 31,665 contained an abstract. In the early years, most abstracts reporting statistical inference contained only significance terminology without confidence intervals and p-values. From 1988 to 2005, each year 30 % of all abstracts contained p-values without confidence intervals. Thereafter, this reporting style continued to decline. The reporting of confidence intervals increased steadily from 1988 (11 %) to 2022 (56 %). Of the 17 % of abstracts in 2017–2022 that included any effect measure, half reported odds ratios (51 %), followed by hazard ratios (28 %) and risk ratios (16 %). Difference measures and number needed to treat or harm were very uncommon Conclusions: Within the HIV/AIDS literature, there has been widespread use of confidence intervals. Most of the journals that we reviewed had a decrease in reporting only statistical significance without confidence intervals over time
format Article
id doaj-art-1bdac308b10f46bea0b975f73c5aae9c
institution Matheson Library
issn 2590-1133
language English
publishDate 2025-12-01
publisher Elsevier
record_format Article
series Global Epidemiology
spelling doaj-art-1bdac308b10f46bea0b975f73c5aae9c2025-08-02T04:47:41ZengElsevierGlobal Epidemiology2590-11332025-12-0110100213Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic reviewAndreas Stang0Henning Schäfer1Ahmad Idrissi-Yaghir2Christoph M. Friedrich3Matthew P. Fox4Institute for Medical Informatics, Biometry, and Epidemiology (IMIBE), University Hospital Essen, Hufelandstr. 55, 45147 Essen, Germany; School of Public Health, Department of Epidemiology, Boston University, 715 Albany Street, Boston, MA 02118, USA; Departments of Epidemiology and Global Health, Boston University School of Public Health, Boston University, 715 Albany Street, Boston, MA 02118, USA; Corresponding author at: Institute for Medical Informatics, Biometry, and Epidemiology (IMIBE), University Hospital Essen, Hufelandstr. 55, 45147 Essen, Germany.Department of Computer Science, University of Applied Sciences and Arts Dortmund (FHDO), Emil-Figge-Str. 42, 44227 Dortmund, Germany; Institute for Transfusion Medicine, University Hospital Essen, Hufelandstr. 55, 45147 Essen, GermanyDepartment of Computer Science, University of Applied Sciences and Arts Dortmund (FHDO), Emil-Figge-Str. 42, 44227 Dortmund, Germany; Institute for Artificial Intelligence in Medicine (IKIM), University Hospital Essen, Giradetstr. 2, 45131 Essen, GermanyInstitute for Medical Informatics, Biometry, and Epidemiology (IMIBE), University Hospital Essen, Hufelandstr. 55, 45147 Essen, Germany; Department of Computer Science, University of Applied Sciences and Arts Dortmund (FHDO), Emil-Figge-Str. 42, 44227 Dortmund, GermanyDepartments of Epidemiology and Global Health, Boston University School of Public Health, Boston University, 715 Albany Street, Boston, MA 02118, USAObjectives: With the emergence of HIV/AIDS journals, the development of the reporting of statistical inference and effect measures in published abstracts can be examined from the beginning in a new field. The aim of this study was to describe time trends of statistical inference and effect measure reporting of major HIV/AIDS journals Methods: We included 10 major HIV/AIDS journals and analyzed all available PubMed entries for the period 1987 through 2022. We applied rule-based text mining and machine learning methodology to detect the presence of confidence intervals, numerical p-values or comparisons of p-values with thresholds, language describing statistical significance, and effect measures for dichotomous outcomes Results: Among 41,730 PubMed entries from the major HIV/AIDS journals, 31,665 contained an abstract. In the early years, most abstracts reporting statistical inference contained only significance terminology without confidence intervals and p-values. From 1988 to 2005, each year 30 % of all abstracts contained p-values without confidence intervals. Thereafter, this reporting style continued to decline. The reporting of confidence intervals increased steadily from 1988 (11 %) to 2022 (56 %). Of the 17 % of abstracts in 2017–2022 that included any effect measure, half reported odds ratios (51 %), followed by hazard ratios (28 %) and risk ratios (16 %). Difference measures and number needed to treat or harm were very uncommon Conclusions: Within the HIV/AIDS literature, there has been widespread use of confidence intervals. Most of the journals that we reviewed had a decrease in reporting only statistical significance without confidence intervals over timehttp://www.sciencedirect.com/science/article/pii/S2590113325000318HIVAcquired immunodeficiency syndromeConfidence intervalsStatisticsStatistics and numerical data
spellingShingle Andreas Stang
Henning Schäfer
Ahmad Idrissi-Yaghir
Christoph M. Friedrich
Matthew P. Fox
Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
Global Epidemiology
HIV
Acquired immunodeficiency syndrome
Confidence intervals
Statistics
Statistics and numerical data
title Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
title_full Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
title_fullStr Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
title_full_unstemmed Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
title_short Statistical inference and effect measures in abstracts of major HIV and AIDS journals, 1987–2022: A systematic review
title_sort statistical inference and effect measures in abstracts of major hiv and aids journals 1987 2022 a systematic review
topic HIV
Acquired immunodeficiency syndrome
Confidence intervals
Statistics
Statistics and numerical data
url http://www.sciencedirect.com/science/article/pii/S2590113325000318
work_keys_str_mv AT andreasstang statisticalinferenceandeffectmeasuresinabstractsofmajorhivandaidsjournals19872022asystematicreview
AT henningschafer statisticalinferenceandeffectmeasuresinabstractsofmajorhivandaidsjournals19872022asystematicreview
AT ahmadidrissiyaghir statisticalinferenceandeffectmeasuresinabstractsofmajorhivandaidsjournals19872022asystematicreview
AT christophmfriedrich statisticalinferenceandeffectmeasuresinabstractsofmajorhivandaidsjournals19872022asystematicreview
AT matthewpfox statisticalinferenceandeffectmeasuresinabstractsofmajorhivandaidsjournals19872022asystematicreview