Crowdsourcing pneumothorax annotations using machine learning annotations on the NIH chest X-ray dataset. Academic Article uri icon

Overview

abstract

  • Pneumothorax is a potentially life-threatening condition that requires prompt recognition and often urgent intervention. In the ICU setting, large numbers of chest radiographs are performed and must be interpreted on a daily basis which may delay diagnosis of this entity. Development of artificial intelligence (AI) techniques to detect pneumothorax could help expedite detection as well as localize and potentially quantify pneumothorax. Open image analysis competitions are useful in advancing state-of-the art AI algorithms but generally require large expert annotated datasets. We have annotated and adjudicated a large dataset of chest radiographs to be made public with the goal of sparking innovation in this space. Because of the cumbersome and time-consuming nature of image labeling, we explored the value of using AI models to generate annotations for review. Utilization of this machine learning annotation (MLA) technique appeared to expedite our annotation process with relatively high sensitivity at the expense of specificity. Further research is required to confirm and better characterize the value of MLAs. Our adjudicated dataset is now available for public consumption in the form of a challenge.

publication date

  • April 1, 2020

Research

keywords

  • Crowdsourcing
  • Pneumothorax

Identity

PubMed Central ID

  • PMC7165201

Scopus Document Identifier

  • 85076223967

Digital Object Identifier (DOI)

  • 10.1148/radiol.2018180736

PubMed ID

  • 31768897

Additional Document Info

volume

  • 33

issue

  • 2