Selected article for: "external validation and test set"

Author: Lombardi, Carlo; Roca, Elena; Bigni, Barbara; Bertozzi, Bruno; Ferrandina, Camillo; Franzin, Alberto; Vivaldi, Oscar; Cottini, Marcello; D'Alessio, Andrea; Del Poggio, Paolo; Conte, Gian Marco; Berti, Alvise
Title: Immune and cellular damage biomarkers to predict COVID-19 mortality in hospitalized patients
  • Cord-id: u80ib4ek
  • Document date: 2021_9_16
  • ID: u80ib4ek
    Snippet: Early prediction of COVID-19 in-hospital mortality relies usually on patients’ preexisting comorbidities and is rarely reproducible in independent cohorts. We wanted to compare the role of routinely measured biomarkers of immunity, inflammation, and cellular damage with preexisting comorbidities in eight different machine-learning models to predict mortality, and evaluate their performance in an independent population. We recruited and followed-up consecutive adult patients with SARS-Cov-2 inf
    Document: Early prediction of COVID-19 in-hospital mortality relies usually on patients’ preexisting comorbidities and is rarely reproducible in independent cohorts. We wanted to compare the role of routinely measured biomarkers of immunity, inflammation, and cellular damage with preexisting comorbidities in eight different machine-learning models to predict mortality, and evaluate their performance in an independent population. We recruited and followed-up consecutive adult patients with SARS-Cov-2 infection in two different Italian hospitals. We predicted 60-day mortality in one cohort (development dataset, n = 299 patients, of which 80% was allocated to the development dataset and 20% to the training set) and retested the models in the second cohort (external validation dataset, n = 402). Demographic, clinical, and laboratory features at admission, treatments and disease outcomes were significantly different between the two cohorts. Notably, significant differences were observed for %lymphocytes (p < 0.05), international-normalized-ratio (p < 0.01), platelets, alanine-aminotransferase, creatinine (all p < 0.001). The primary outcome (60-day mortality) was 29.10% (n = 87) in the development dataset, and 39.55% (n = 159) in the external validation dataset. The performance of the 8 tested models on the external validation dataset were similar to that of the holdout test dataset, indicating that the models capture the key predictors of mortality. The shap analysis in both datasets showed that age, immune features (%lymphocytes, platelets) and LDH substantially impacted on all models' predictions, while creatinine and CRP varied among the different models. The model with the better performance was model 8 (60-day mortality AUROC 0.83 ± 0.06 in holdout test set, 0.79 ± 0.02 in external validation dataset). The features that had the greatest impact on this model's prediction were age, LDH, platelets, and %lymphocytes, more than comorbidities or inflammation markers, and these findings were highly consistent in both datasets, likely reflecting the virus effect at the very beginning of the disease.

    Search related documents:
    Co phrase search for related documents
    • absent present and lymphocyte percentage: 1, 2
    • additive explanations and local explanation: 1, 2
    • additive explanations and lymphocyte count: 1
    • additive explanations and lymphocyte percentage: 1
    • additive explanations and machine learning: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21
    • admission age and lopinavir ritonavir: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15
    • admission age and low percentage: 1, 2
    • admission age and lymphocyte count: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25
    • admission age and lymphocyte percentage: 1, 2
    • admission age and machine learning: 1, 2, 3, 4, 5
    • local explanation and lymphocyte count: 1
    • local explanation and machine learning: 1, 2, 3, 4, 5, 6
    • lopinavir ritonavir and low percentage: 1
    • lopinavir ritonavir and lymphocyte count: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
    • lopinavir ritonavir and lymphocyte percentage: 1
    • lopinavir ritonavir and machine learning: 1, 2
    • low percentage and lymphocyte percentage: 1, 2, 3, 4
    • low percentage and machine learning: 1, 2, 3, 4, 5
    • low percentage and machine learning ml model: 1