Author: Nguyen, Nam; Chang, J. Morris
Title: COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architectures Cord-id: 2wrk5ohe Document date: 2021_7_6
ID: 2wrk5ohe
Snippet: This study proposed a novel framework for COVID-19 severity prediction, which is a combination of data-centric and model-centric approaches. First, we propose a data-centric pre-training for extremely scare data scenarios of the investigating dataset. Second, we propose two hybrid convolution-attention neural architectures that leverage the self-attention from the Transformer and the Dense Associative Memory (Modern Hopfield networks). Our proposed approach achieves significant improvement from
Document: This study proposed a novel framework for COVID-19 severity prediction, which is a combination of data-centric and model-centric approaches. First, we propose a data-centric pre-training for extremely scare data scenarios of the investigating dataset. Second, we propose two hybrid convolution-attention neural architectures that leverage the self-attention from the Transformer and the Dense Associative Memory (Modern Hopfield networks). Our proposed approach achieves significant improvement from the conventional baseline approach. The best model from our proposed approach achieves $R^2 = 0.85 \pm 0.05$ and Pearson correlation coefficient $\rho = 0.92 \pm 0.02$ in geographic extend and $R^2 = 0.72 \pm 0.09, \rho = 0.85\pm 0.06$ in opacity prediction.
Search related documents:
Co phrase search for related documents- absolute error and lung involvement: 1, 2
- adaptive learning rate and loss function: 1
- loss function and lung involvement: 1
Co phrase search for related documents, hyperlinks ordered by date