  Ensuring diagnostic performance of AI models before clinical use is key to
the safe and successful adoption of these technologies. Studies reporting AI
applied to digital pathology images for diagnostic purposes have rapidly
increased in number in recent years. The aim of this work is to provide an
overview of the diagnostic accuracy of AI in digital pathology images from all
areas of pathology. This systematic review and meta-analysis included
diagnostic accuracy studies using any type of artificial intelligence applied
to whole slide images (WSIs) in any disease type. The reference standard was
diagnosis through histopathological assessment and / or immunohistochemistry.
Searches were conducted in PubMed, EMBASE and CENTRAL in June 2022. We
identified 2976 studies, of which 100 were included in the review and 48 in the
full meta-analysis. Risk of bias and concerns of applicability were assessed
using the QUADAS-2 tool. Data extraction was conducted by two investigators and
meta-analysis was performed using a bivariate random effects model. 100 studies
were identified for inclusion, equating to over 152,000 whole slide images
(WSIs) and representing many disease types. Of these, 48 studies were included
in the meta-analysis. These studies reported a mean sensitivity of 96.3% (CI
94.1-97.7) and mean specificity of 93.3% (CI 90.5-95.4) for AI. There was
substantial heterogeneity in study design and all 100 studies identified for
inclusion had at least one area at high or unclear risk of bias. This review
provides a broad overview of AI performance across applications in whole slide
imaging. However, there is huge variability in study design and available
performance data, with details around the conduct of the study and make up of
the datasets frequently missing. Overall, AI offers good accuracy when applied
to WSIs but requires more rigorous evaluation of its performance.
