Purpose: We propose a deep learning-based anthropomorphic model observer (DeepAMO) for image quality evaluation of multi-orientation, multi-slice image sets with respect to a clinically realistic 3D defect detection task.
Approach: The DeepAMO is developed based on a hypothetical model of the decision process of a human reader performing a detection task using a 3D volume. The DeepAMO is comprised of three sequential stages: defect segmentation, defect confirmation (DC), and rating value inference. The input to the DeepAMO is a composite image, typical of that used to view 3D volumes in clinical practice. The output is a rating value designed to reproduce a human observer’s defect detection performance. In stages 2 and 3, we propose: (1) a projection-based DC block that confirms defect presence in two 2D orthogonal orientations and (2) a calibration method that “learns” the mapping from the features of stage 2 to the distribution of observer ratings from the human observer rating data (thus modeling inter- or intraobserver variability) using a mixture density network. We implemented and evaluated the DeepAMO in the context of Tc99m-DMSA SPECT imaging. A human observer study was conducted, with two medical imaging physics graduate students serving as observers. A 5 × 2-fold cross-validation experiment was conducted to test the statistical equivalence in defect detection performance between the DeepAMO and the human observer. We also compared the performance of the DeepAMO to an unoptimized implementation of a scanning linear discriminant observer (SLDO).
Results: The results show that the DeepAMO’s and human observer’s performances on unseen images were statistically equivalent with a margin of difference (ΔAUC) of 0.0426 at p < 0.05, using 288 training images. A limited implementation of an SLDO had a substantially higher AUC (0.99) compared to the DeepAMO and human observer.
Conclusion: The results show that the DeepAMO has the potential to reproduce the absolute performance, and not just the relative ranking of human observers on a clinically realistic defect detection task, and that building conceptual components of the human reading process into deep learning-based models can allow training of these models in settings where limited training images are available.
In this paper, we describe an enhanced DICOM Secondary Capture (SC) that integrates Image Quantification (IQ) results, Regions of Interest (ROIs), and Time Activity Curves (TACs) with screen shots by embedding extra medical imaging information into a standard DICOM header. A software toolkit of DICOM IQSC has been developed to implement the SC-centered information integration of quantitative analysis for routine practice of nuclear medicine. Primary experiments show that the DICOM IQSC method is simple and easy to implement seamlessly integrating post-processing workstations with PACS for archiving and retrieving IQ information. Additional DICOM IQSC applications in routine nuclear medicine and clinic research are also discussed.
Standard Single Photon Emission Computed Tomography (SPECT) has a limited field of view (FOV) and cannot
provide a 3D image of an entire long whole body SPECT. To produce a 3D whole body SPECT image, two to five
overlapped SPECT FOVs from head to foot are acquired and assembled using image stitching. Most commercial
software from medical imaging manufacturers applies a direct mid-slice stitching method to avoid blurring or ghosting
from 3D image blending. Due to intensity changes across the middle slice of overlapped images, direct mid-slice
stitching often produces visible seams in the coronal and sagittal views and maximal intensity projection (MIP). In this
study, we proposed an optimized algorithm to reduce the visibility of stitching edges. The new algorithm computed,
based on transition error minimization (TEM), a 3D stitching interface between two overlapped 3D SPECT images. To
test the suggested algorithm, four studies of 2-FOV whole body SPECT were used and included two different
reconstruction methods (filtered back projection (FBP) and ordered subset expectation maximization (OSEM)) as well as
two different radiopharmaceuticals (Tc-99m MDP for bone metastases and I-131 MIBG for neuroblastoma tumors).
Relative transition errors of stitched whole body SPECT using mid-slice stitching and the TEM-based algorithm were
measured for objective evaluation. Preliminary experiments showed that the new algorithm reduced the visibility of the
stitching interface in the coronal, sagittal, and MIP views. Average relative transition errors were reduced from 56.7% of
mid-slice stitching to 11.7% of TEM-based stitching. The proposed algorithm also avoids blurring artifacts by preserving
the noise properties of the original SPECT images.
In this study, an automated analysis of pulmonary ventilation (AAPV) was developed to visualize the ventilation in
pediatric lungs using dynamic Xe-133 scintigraphy. AAPV is a software algorithm that converts a dynamic series of Xe-
133 images into four functional images: equilibrium, washout halftime, residual, and clearance rate by analyzing pixelbased
activity. Compared to conventional methods of calculating global or regional ventilation parameters, AAPV
provides a visual representation of pulmonary ventilation functions.
Nuclear medicine dynamic studies of kidneys, bladder and stomach are important diagnostic tools. Accurate generation
of time-activity curves from regions of interest (ROIs) requires that the patient remains motionless for the duration of the
study. This is not always possible since some dynamic studies may last from several minutes to one hour. Several motion
correction solutions have been explored. Motion correction using external point sources is inconvenient and not accurate
especially when motion results from breathing, organ motion or feeding rather than from body motion alone. Centroid-based
motion correction assumes that activity distribution is only inside the single organ (without background) and
uniform, but this approach is impractical in most clinical studies. In this paper, we present a novel technique of motion
correction that first tracks the organ of interest in a dynamic series then aligns the organ. The implementation algorithm
for target tracking-based motion correction consists of image preprocessing, target detection, target positioning, motion
estimation and prediction, tracking (new search region generation) and target alignment. The targeted organ is tracked
from the first frame to the last one in the dynamic series to generate a moving trajectory of the organ. Motion correction
is implemented by aligning the organ ROIs in the image series to the location of the organ in the first image. The
proposed method of motion correction has been applied to several dynamic nuclear medicine studies including
radionuclide cystography, dynamic renal scintigraphy, diuretic renography and gastric emptying scintigraphy.
The purpose of this paper is to demonstrate the importance of building a brain imaging registry (BIR) on top of existing medical information systems including Picture Archiving Communication Systems (PACS) environment. We describe the design framework for a cluster of data marts whose purpose is to provide clinicians and researchers efficient access to a large volume of raw and processed patient images and associated data originating from multiple operational systems over time and spread out across different hospital departments and laboratories. The framework is designed using object-oriented analysis and design methodology. The BIR data marts each contain complete image and textual data relating to patients with a particular disease.
Medical information systems based in different hospital departments face tremendous difficulty in information exchange and dissemination due to the multitudes of hardware and software platforms running these systems. In this paper, we describe a distributed information system for integrating various hospital systems in supporting clinical neuroimaging research and epilepsy surgical planning. Our distributed information system uses a three-tiered architecture consists of a user-interface tier, application logic tier and data store tier. Two system implementations based on this software architecture but using different integration technologies were developed and are discussed in this paper: the XML (extensible Mark Up Language)-based implementation and the CORBA (Common Object Request Broker Architecture)-based implementation. In the XML-based implementation, application logic tier communicates with user-interface tier and data store tier using HTTP and XML for data exchange. For the data exchange in CORBA-based implementation, the middleware uses IIOP (Internet inter-ORB protocol) to call CORBA objects in the data store tier then to return the results to the user-interface tier. For the user-interface tier of either implementation, the Web browsers are served as clients to invoke application components or agents in the middleware. The application of the proposed distributed system allows clinical users to access, search and retrieve the multimedia information in any underlying computer systems with commonly used Web browsers. Preliminary results show that the system is effective for information integration and data sharing among the different departmental systems in the hospital for neuroimaging applications.
KEYWORDS: Breast imaging, Digital mammography, Imaging systems, Breast cancer, Picture Archiving and Communication System, Mammography, Data acquisition, Decision support systems, Data modeling, Databases
This paper discusses our initial efforts to design and develop a digital mammography data warehouse to facilitate clinical and research activities. Data warehouse is a complete and consistent integration of data from many information sources. It enables users to explore the warehouse for various analysis and decision support purposes. We are designing an infra-structural information system by incorporating various kinds of breast imaging data, from a diversity of existing clinical systems, into a digital data warehouse. Various types of breast imaging data, including patient demographics, family history, digital mammography and radiological reports, will be acquired for the University of California San Francisco digital mammography PACS modules, as well as Radiological Information System.
KEYWORDS: Multimedia, Epilepsy, Analytical research, Image retrieval, Magnetic resonance imaging, Picture Archiving and Communication System, Data modeling, 3D image processing, Data archive systems, Positron emission tomography
We described a web-based data warehousing method for retrieving and analyzing neurological multimedia information. The web-based method supports convenient access, effective search and retrieval of clinical textual and image data, and on-line analysis. To improve the flexibility and efficiency of multimedia information query and analysis, a three-tier, multimedia data warehouse for epilepsy research has been built. The data warehouse integrates clinical multimedia data related to epilepsy from disparate sources and archives them into a well-defined data model.
In order to evaluate and characterize the spatial resolution properties of a direct digital radiography (DDR) system based on a four CCD array detector, we measure the modulation transfer function (MTF) of the imaging system from its edge spread function (ESF). Different from the traditional algorithm for fine sampling of the ESF of an edge or a slit image with a slight angle to the image coordinate, in this paper we propose a new iterative algorithm. The novel algorithm finely samples the ESF along the column almost parallel to the edge, but not the row perpendicular to the edge. The samples of the first column and the second column are combined and averaged to get a segment of fine-sampled ESF. Then the segment of fine-sampled ESF is further combined with the next column and averaged to get a slight longer segment of ESF, and so forth. A complete fine-sampled ESF can be obtained after repeating the procedure for all columns of the edge image. An adaptive filtering is used for smoothing the ESF so that the sharpness at the edge of ESF can be protected. The MTF of the DDR is obtained from a series of image processing and data processing. The image processing includes the automatic determination of the angle of the edge to the pixel array of the edge image and fine sampling of edge spread function (ESF); data processing includes smooth filtering of ESF, numerical differential and fast Fourier transformation (FFT).
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.