Development of a Critical Appraisal Tool for Models Predicting the Impact of “Test, Trace, and Protect” Programmes on COVID-19 Transmission

Frank, John; Marion, Glenn; Doeschl-Wilson, Andrea

Objectives To develop a Critical Appraisal tool for non-computational-specialist public health professionals to assess the quality and relevance of modelling studies about Test and Trace (and Protect – TTP) programmes’ impact on COVID-19 transmission. Study Design Decision-making tool development. Methods Using Tugwell et al.’s Health Care Effectiveness equation as a conceptual framework, combined with a purposive search of the relevant early modeling literature, we developed six critical appraisal questions for the rapid assessment of modeling studies related to the evaluation of TTP programmes’ effectiveness. Results By applying the Critical Appraisal tool to selected recent COVID-19 modeling studies we demonstrate how models can be evaluated using the six questions to evaluate internal and external validity, and relevance. Conclusions These six critical appraisal questions are able to discriminate between modeling studies of higher and lower quality and relevance to evaluating TTP programmes’ impact. However, these questions require independent validation in a larger and systematic sample of relevant modeling studies which have appeared in later stages of the pandemic.