Author: Hicks, S.; Strüke, I.; Thambawita, V.; Hammou, M.; Halvorsen, P.; Riegler, M.; Parasa, S.
Title: On evaluation metrics for medical applications of artificial intelligence Cord-id: 1nt7kt3u Document date: 2021_4_9
ID: 1nt7kt3u
Snippet: Clinicians and model developers need to understand how proposed machine learning (ML) models could improve patient care. In fact, no single metric captures all the desirable properties of a model and several metrics are typically reported to summarize a model's performance. Unfortunately, these measures are not easily understandable by many clinicians. Moreover, comparison of models across studies in an objective manner is challenging, and no tool exists to compare models using the same performa
Document: Clinicians and model developers need to understand how proposed machine learning (ML) models could improve patient care. In fact, no single metric captures all the desirable properties of a model and several metrics are typically reported to summarize a model's performance. Unfortunately, these measures are not easily understandable by many clinicians. Moreover, comparison of models across studies in an objective manner is challenging, and no tool exists to compare models using the same performance metrics. This paper looks at previous ML studies done in gastroenterology, provides an explanation of what different metrics mean in the context of the presented studies, and gives a thorough explanation of how different metrics should be interpreted. We also release an open source web-based tool that may be used to aid in calculating the most relevant metrics presented in this paper so that other researchers and clinicians may easily incorporate them into their research.
Search related documents:
Co phrase search for related documents- accuracy achieve and actual performance: 1
- accuracy achieve and loss function: 1, 2
- accuracy achieve and low precision: 1
- loss function and low precision: 1, 2
Co phrase search for related documents, hyperlinks ordered by date