Structured Crowdsourcing Enables Convolutional Segmentation of Histology Images.

Researchers

Journal

Modalities

Models

Abstract

While deep-learning algorithms have demonstrated outstanding performance in semantic image segmentation tasks, large annotation datasets are needed to create accurate models. Annotation of histology images is challenging due to the effort and experience required to carefully delineate tissue structures, and difficulties related to sharing and markup of whole-slide images.
We recruited 25 participants, ranging in experience from senior pathologists to medical students, to delineate tissue regions in 151 breast cancer slides using the Digital Slide Archive. Inter-participant discordance was systematically evaluated, revealing low discordance for tumor and stroma, and higher discordance for more subjectively defined or rare tissue classes. Feedback provided by senior participants enabled the generation and curation of 20,000+ annotated tissue regions. Fully convolutional networks trained using these annotations were highly accurate (Mean AUC= 0.945), and the scale of annotation data provided notable improvements in image classification accuracy.
Supplementary dataset hosted at: https://goo.gl/cNM4EL. Additional results and methods are available at Bioinformatics online.