Open Access
20 July 2018 DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning
Ke Yan, Xiaosong Wang, Le Lu, Ronald M. Summers
Author Affiliations +
Abstract
Extracting, harvesting, and building large-scale annotated radiological image datasets is a greatly important yet challenging problem. Meanwhile, vast amounts of clinical annotations have been collected and stored in hospitals’ picture archiving and communication systems (PACS). These types of annotations, also known as bookmarks in PACS, are usually marked by radiologists during their daily workflow to highlight significant image findings that may serve as reference for later studies. We propose to mine and harvest these abundant retrospective medical data to build a large-scale lesion image dataset. Our process is scalable and requires minimum manual annotation effort. We mine bookmarks in our institute to develop DeepLesion, a dataset with 32,735 lesions in 32,120 CT slices from 10,594 studies of 4,427 unique patients. There are a variety of lesion types in this dataset, such as lung nodules, liver tumors, enlarged lymph nodes, and so on. It has the potential to be used in various medical image applications. Using DeepLesion, we train a universal lesion detector that can find all types of lesions with one unified framework. In this challenging task, the proposed lesion detector achieves a sensitivity of 81.1% with five false positives per image.
© 2018 Society of Photo-Optical Instrumentation Engineers (SPIE) 2329-4302/2018/$25.00 © 2018 SPIE
Ke Yan, Xiaosong Wang, Le Lu, and Ronald M. Summers "DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning," Journal of Medical Imaging 5(3), 036501 (20 July 2018). https://doi.org/10.1117/1.JMI.5.3.036501
Received: 7 March 2018; Accepted: 14 June 2018; Published: 20 July 2018
Lens.org Logo
CITATIONS
Cited by 358 scholarly publications and 3 patents.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Lymphatic system

Mining

Lung

Medical imaging

Liver

Picture Archiving and Communication System

Sensors

Back to Top