External validation of a biomarker and clinical prediction model for hospital mortality in acute respiratory distress syndrome

Zhiguo Zhao, Nancy Wickersham, Kirsten N. Kangelaris, Addison K. May, Gordon R. Bernard, Michael A. Matthay, Carolyn S. Calfee, Tatsuki Koyama, Lorraine B. Ware

Mortality prediction in ARDS is important for prognostication and risk stratification. However, no prediction models have been independently validated. A combination of two biomarkers with age and APACHE III was superior in predicting mortality in the NHLBI ARDSNet ALVEOLI trial. We validated this prediction tool in two clinical trials and an observational cohort. The validation cohorts included 849 patients from the NHLBI ARDSNet Fluid and Catheter Treatment Trial (FACTT), 144 patients from a clinical trial of sivelestat for ARDS (STRIVE), and 545 ARDS patients from the VALID observational cohort study. To evaluate the performance of the prediction model, the area under the receiver operating characteristic curve (AUC), model discrimination, and calibration were assessed, and recalibration methods were applied. The biomarker/clinical prediction model performed well in all cohorts. Performance was better in the clinical trials with an AUC of 0.74 (95% CI 0.70-0.79) in FACTT, compared to 0.72 (95% CI 0.67-0.77) in VALID, a more heterogeneous observational cohort. The AUC was 0.73 (95% CI 0.70-0.76) when FACTT and VALID were combined. We validated a mortality prediction model for ARDS that includes age, APACHE III, surfactant protein D, and interleukin-8 in a variety of clinical settings. Although the model performance as measured by AUC was lower than in the original model derivation cohort, the biomarker/clinical model still performed well and may be useful for risk assessment for clinical trial enrollment, an issue of increasing importance as ARDS mortality declines, and better methods are needed for selection of the most severely ill patients for inclusion.