Medicine

New Tool Validates Hospital Comorbidity Scoring Across Different Software Systems

How the science connects

Clinical decision …Comorbidity

AI Insight

Researchers developed and validated ecsr10, an open-source R package that replicates all eleven releases of the widely-used Elixhauser comorbidity scoring system originally published by AHRQ in SAS. Testing on over 8.5 million Texas hospital discharge records revealed that the choice of whether to use present-on-admission (POA) indicators dramatically affected results, changing comorbidity profiles for 56.7% of admissions, while different software releases had minimal impact on individual records but substantial effects on mortality prediction scores.


The findings expose critical methodological choices in health services research that are rarely reported but significantly impact results. When POA screening is disabled, complications developed during hospitalization are incorrectly counted as pre-existing conditions, inflating risk scores and potentially distorting hospital quality comparisons and research conclusions about patient outcomes.


Understand the Science

Clinical decision support system Concept coming soon Comorbidity Concept coming soon

⚠️ Preprint – Noch nicht peer-reviewed

Dieser Artikel wurde noch nicht von unabhängigen Experten begutachtet. Die Ergebnisse sind vorläufig und sollten mit Vorsicht interpretiert werden.

The Elixhauser comorbidity measures are among the most widely used risk adjusters in administrative health data. Their reference implementation, published by the Agency for Healthcare Research and Quality (AHRQ) as SAS programs, has eleven annual releases in two families, one screening pre-existing conditions on the present-on-admission (POA) indicator and the earlier one on Medicare Severity Diagnosis-Related Group, and no implementation of every release existed outside SAS. We developed `ecsr10`, an open-source R package covering all eleven releases of both families, with a browser-based application over the same functions, and validated it against AHRQ’s own SAS programs over 40,027,114 value-level comparisons with zero disagreements. Two existing open-source reimplementations scored on the same dataset showed reproducible defects. We then used the package to quantify two choices AHRQ’s software leaves to the analyst and studies seldom report, the release and the handling of diagnoses not present on admission, on the Texas Inpatient Public Use Data File, 2016 Q1-2019 Q4 (8,585,244 adult discharges from 726 hospitals), scoring one predefined cohort under every release and pre-existing-condition setting. POA handling dominated: disabling POA changed the comorbidity profile of 56.7% of admissions, and a POA-naive mortality index scored higher on discrimination (area under the curve 0.807 versus 0.789; difference 0.0183, 95% confidence interval 0.0161-0.0204) by counting in-hospital complications as pre-existing disease. POA reporting was bimodal across hospitals, so pooled hospital comparisons on such a file partly compare documentation practice. Because the cohort predates every release compared, the release contrast is a lower bound: the release chosen between v2022.1 and v2026.1 changed at least one comorbidity flag for 0.0036% of admissions, yet a single revision of ten mortality weights changed the comorbidity index for 42.4% of them. An exactly validated implementation makes such choices measurable; release, POA handling and the implementation used should be reported as study characteristics.

Source: Release-aware, SAS-equivalent Elixhauser comorbidity scoring in R: cross-implementation validation and application to Texas inpatient discharges