How accurately can quantitative imaging methods be ranked without ground truth: an upper bound on no-gold-standard evaluation

Yan Liu; Abhinav K. Jha

doi:10.1117/12.3006888

29 March 2024 How accurately can quantitative imaging methods be ranked without ground truth: an upper bound on no-gold-standard evaluation

Yan Liu, Abhinav K. Jha

Author Affiliations +

Proceedings Volume 12929, Medical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment; 129290W (2024) https://doi.org/10.1117/12.3006888
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

Objective evaluation of quantitative imaging (QI) methods with patient data, while important, is typically hindered by the lack of gold standards. To address this challenge, no-gold-standard evaluation (NGSE) techniques have been proposed. These techniques have demonstrated efficacy in accurately ranking QI methods without access to gold standards. The development of NGSE methods has raised an important question: how accurately can QI methods be ranked without ground truth. To answer this question, we propose a Cram´er–Rao bound (CRB)-based framework that quantifies the upper bound in ranking QI methods without any ground truth. We present the application of this framework in guiding the use of a well-known NGSE technique, namely the regression-without-truth (RWT) technique. Our results show the utility of this framework in quantifying the performance of this NGSE technique for different patient numbers. These results provide motivation towards studying other applications of this upper bound.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Yan Liu and Abhinav K. Jha "How accurately can quantitative imaging methods be ranked without ground truth: an upper bound on no-gold-standard evaluation", Proc. SPIE 12929, Medical Imaging 2024: Image Perception, Observer Performance, and Technology Assessment, 129290W (29 March 2024); https://doi.org/10.1117/12.3006888

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available