Performance evaluation of a computer-aided polyp detection system with artificial intelligence for colonoscopy.

Researchers

Journal

Modalities

Models

Abstract

A computer-aided detection (CAD) system was developed to support the detection of colorectal lesions by deep learning using video images of lesions and normal mucosa recorded during colonoscopy. The study’s purpose was to evaluate the stand-alone performance of this device under blinded conditions.This multicenter prospective observational study was conducted at four Japanese institutions. We used 326 videos of colonoscopies recorded with patient consent at institutions in which the Ethics Committees approved the study. The sensitivity of successful detection of the CAD system was calculated using the target lesions, those were detected by adjudicators from two facilities for each lesion appearance frame and reached consensus among all facilities. Successful detection was defined as display of the detection flag on the lesion for more than 0.5 seconds within 3 seconds of appearance.Of the 556 target lesions from 185 cases, detection success sensitivity was 97.5% (95% confidence interval [CI]: 95.8-98.5%). The “successful detection sensitivity per colonoscopy” was 93% (95% CI: 88.3-95.8%). For the frame-based sensitivity, specificity, positive predictive value and negative predictive value were 86.6% (95% CI: 84.8-88.4%), 84.7% (95% CI: 83.8-85.6%), 34.9% (95% CI; 32.3-37.4%), and 98.2% (95% CI: 97.8-98.5%).The tested device demonstrated high sensitivity under strict detection success/failure criteria using a temporal concept and could identify the presence and location lesions with sensitivity approaching that of experienced endoscopists. This study is registered with the University Hospital Medical Information Network (UMIN000044622).This article is protected by copyright. All rights reserved.