Human selection bias drives the linear nature of the more ground truth effect in explainable deep learning optical coherence tomography image segmentation.

Researchers

Journal

Modalities

Models

Abstract

Supervised Deep Learning (DL) algorithms are highly dependent on training data for which human graders are assigned, e.g. for optical coherence tomography (OCT) image annotation. Despite the tremendous success of DL, due to human judgement, these ground truth labels can be inaccurate and/or ambiguous and cause a human selection bias. We therefore investigated the impact of the size of the ground truth and variable numbers of graders on the predictive performance of the same DL architecture and repeated each experiment 3 times. The largest training dataset delivered a prediction performance close to that of human experts. All DL systems utilized were highly consistent. Nevertheless, the DL under-performers could not achieve any further autonomous improvement even after repeated training. Furthermore, a quantifiable linear relationship between ground truth ambiguity and the beneficial effect of having a larger amount of ground truth data was detected and marked as the more-ground-truth effect. This article is protected by copyright. All rights reserved.This article is protected by copyright. All rights reserved.