Predicting ROC curves for source detection under model mismatch

Performance predictions and test thresholds for the task of detecting a gamma-ray source in background with a position-sensitive detector are often costly to compute empirically. The asymptotic distributions of test statistics for detecting a point-source in background give reasonable performance predictions in terms of the receiver operating characteristic curve (ROC) with less simulated or measured data than empirical methods. The asymptotic distributions also allow the user to determine the proper threshold to achieve a desired false alarm rate. Typically only approximate models are available or practical for complex gamma-ray imaging systems such as 3D position-sensitive semiconductor detectors. Applying standard formulas for the asymptotic distributions of maximum likelihood (ML) estimates in the presence of model mismatch can yield inaccurate and sometimes overly optimistic predictions of detection performance. We apply the theory of the asymptotic distribution of ML estimates under model mismatch to the case of detecting a point-source in background with a 3D position-sensitive CdZn Te detector employing an approximate model for the system response. We show that performance predictions computed using an asymptotic approximation that accounts for mismatch more closely match the empirical performance than predictions generated by an asymptotic approximation that ignores model mismatch.

[1]  M. Melamed Detection , 2021, SETI: Astronomy as a Contact Sport.

[2]  Jeffrey A. Fessler,et al.  Asymptotic Source Detection Performance of Gamma-Ray Imaging Systems Under Model Mismatch , 2011, IEEE Transactions on Signal Processing.

[3]  Jeffrey A. Fessler,et al.  Benefits of Position-Sensitive Detectors for Radioactive Source Detection , 2010, IEEE Transactions on Signal Processing.

[4]  J. Fessler,et al.  Benefits of position-sensitive detectors for source detection with known background , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[5]  Zhong He,et al.  Sensitivity of gamma-ray source detection using 3D-position-sensitive semiconductor detectors , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[6]  S. Incerti,et al.  Geant4 developments and applications , 2006, IEEE Transactions on Nuclear Science.

[7]  Zhong He,et al.  4/spl pi/ Compton imaging using a 3-D position-sensitive CdZnTe detector via weighted list-mode maximum likelihood , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[8]  T. Gozani,et al.  Gamma ray spectroscopy features for detection of small explosives , 2003 .

[9]  H. V. Trees Detection, Estimation, And Modulation Theory , 2001 .

[10]  H H Barrett,et al.  List-mode likelihood. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[12]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[13]  H. White Maximum Likelihood Estimation of Misspecified Models , 1982 .