Cervical precancer – a major threat in low- and middle-income countries (LMICs) – is often screened through Visual Inspection with acetic Acid (VIA) but suffers from limited reproducibility and inaccuracy. Automatic Visual Evaluation (AVE) utilizes deep learning algorithms based on cervigram or digital images to detect cervical precancer accurately and efficiently. However, important patient data and test results that can provide additional context to the images have not been integrated into the AVE workflow. The NCI ALTS dataset provides over 30,000 cervigram images with hundreds of histopathology-verified positive cases, paired with HPV, cytology, colposcopy, and histology results. To take advantage of both the images and other data, we designed a deep learning image classification algorithm, then modified its architecture to integrate age, HPV status, and cytology result with two methods – concatenation, and multiplication via an added “MetaNet”. We then proposed a two-stage training process that maximized the predictive power of both the images and meta-information while allowing flexibility for missing data. This enabled us to run concurrent inference on a patient's images, test results, and age, and return a binary cervical precancer prediction. The experiments demonstrated that in certain scenarios, the MetaNet model produced a synergistic effect between the images and meta-information by outperformingmodels that only use each component individually, increasing specificity and maintaining high sensitivity. This work provides a direction for the integration of patient meta-information into an end-to-end AVE prediction model, and generally for other medical imaging data, to potentially increase prediction power andmore precisely calibrate patient risk.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.