Bayesian active probabilistic classification for psychometric field estimation

Psychometric functions are typically estimated by fitting a parametric model to categorical subject responses. Procedures to estimate unidimensional psychometric functions (i.e., psychometric curves) have been subjected to the most research, with modern adaptive methods capable of quickly obtaining accurate estimates. These capabilities have been extended to some multidimensional psychometric functions (i.e., psychometric fields) that are easily parameterizable, but flexible procedures for general psychometric field estimation are lacking. This study introduces a nonparametric Bayesian psychometric field estimator operating on subject queries sequentially selected to improve the estimate in some targeted way. This estimator implements probabilistic classification using Gaussian processes trained by active learning. The accuracy and efficiency of two different actively sampled estimators were compared to two non-actively sampled estimators for simulations of one of the simplest psychometric fields in common use: the pure-tone audiogram. The actively sampled methods achieved estimate accuracy equivalent to the non-actively sampled methods with fewer observations. This trend held for a variety of audiogram phenotypes representative of the range of human auditory perception. Gaussian process classification is a general estimation procedure capable of extending to multiple input variables and response classes. Its success with a two-dimensional psychometric field informed by binary subject responses holds great promise for extension to complex perceptual models currently inaccessible to practical estimation.

[1]  P. King-Smith,et al.  Efficient and unbiased modifications of the QUEST threshold method: Theory, simulations, experimental evaluation and practical implementation , 1994, Vision Research.

[2]  Emily Buss,et al.  Development and the role of internal noise in detection and discrimination thresholds with narrow band stimuli. , 2006, The Journal of the Acoustical Society of America.

[3]  David Duvenaud,et al.  Automatic model construction with Gaussian processes , 2014 .

[4]  Roman Garnett,et al.  Bayesian Active Model Selection with an Application to Automated Audiometry , 2015, NIPS.

[5]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[6]  Christopher K. I. Williams Prediction with Gaussian Processes: From Linear Regression to Linear Prediction and Beyond , 1999, Learning in Graphical Models.

[7]  Frederick A. A. Kingdom,et al.  Introduction and Aims , 2016 .

[8]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[9]  Mijung Park,et al.  Active learning of neural response functions with Gaussian processes , 2011, NIPS.

[10]  H. Rootzén,et al.  A new generation of algorithms for computerized threshold perimetry, SITA. , 2009, Acta ophthalmologica Scandinavica.

[11]  Janne V. Kujala,et al.  Bayesian Adaptive Estimation: A Theoretical Review , 2011 .

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[14]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[15]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[16]  M. Leek Adaptive procedures in psychophysical research , 2001, Perception & psychophysics.

[17]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[18]  O Ozdamar,et al.  Classification of audiograms by sequential testing using a dynamic Bayesian procedure. , 1990, The Journal of the Acoustical Society of America.

[19]  Roman Garnett,et al.  Psychometric function estimation by probabilistic classification. , 2017, The Journal of the Acoustical Society of America.

[20]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.

[21]  A. Watson,et al.  QUEST+: A general multidimensional Bayesian adaptive psychometric method. , 2017, Journal of vision.

[22]  B. Treutwein Adaptive psychophysical procedures , 1995, Vision Research.

[23]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[24]  Kilian Q. Weinberger,et al.  Fast, Continuous Audiogram Estimation Using Machine Learning , 2015, Ear and hearing.

[25]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[26]  A Pentland,et al.  Maximum likelihood estimation: The best PEST , 1980, Perception & psychophysics.

[27]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[28]  M. Liberman,et al.  Auditory-nerve response from cats raised in a low-noise chamber. , 1978, The Journal of the Acoustical Society of America.

[29]  Emily Buss,et al.  Psychometric functions for pure tone intensity discrimination: slope differences in school-aged children and adults. , 2009, The Journal of the Acoustical Society of America.

[30]  F. Wightman,et al.  Psychometric functions for children's detection of tones in noise. , 1994, Journal of speech and hearing research.

[31]  C D Geisler,et al.  Thresholds for primary auditory fibers using statistically defined criteria. , 1985, The Journal of the Acoustical Society of America.

[32]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[33]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[34]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[35]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[36]  Yi Shen,et al.  A maximum-likelihood procedure for estimating psychometric functions: thresholds, slopes, and lapses of attention. , 2012, The Journal of the Acoustical Society of America.

[37]  L. Werner,et al.  Infant psychometric functions for detection: mechanisms of immature sensitivity. , 1995, The Journal of the Acoustical Society of America.

[38]  Robert Burkard,et al.  Comprar Handbook Of Clinical Audiology | Jack Katz | 9781451107173 | Lippincott Williams & Wilkins , 2009 .

[39]  John A. Gubner Probability and Random Processes for Electrical and Computer Engineers , 2006 .

[40]  De Wet Swanepoel,et al.  Hearing assessment-reliability, accuracy, and efficiency of automated audiometry. , 2010, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[41]  Donald E Morgan,et al.  Automated pure-tone audiometry: an analysis of capacity, need, and benefit. , 2008, American journal of audiology.

[42]  J. Fozard,et al.  Age changes in pure-tone hearing thresholds in a longitudinal study of normal human aging. , 1990, The Journal of the Acoustical Society of America.

[43]  Dan Farrell Objective Bayesian Analysis in Acoustics - Ning Xiang and Cameron Fackler , 2015 .

[44]  Luis A. Lesmes,et al.  Bayesian adaptive estimation of threshold versus contrast external noise functions: The quick TvC method , 2006, Vision Research.

[45]  Felix Wichmann,et al.  The psychometric function: II. Bootstrap-based confidence intervals and sampling , 2001, Perception & psychophysics.

[46]  Frank Jäkel,et al.  Bayesian inference for psychometric functions. , 2005, Journal of vision.

[47]  Zoubin Ghahramani,et al.  Bayesian Active Learning for Classification and Preference Learning , 2011, ArXiv.

[48]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[49]  Mike Brookes,et al.  Robust and efficient Bayesian adaptive psychometric function estimation. , 2017, The Journal of the Acoustical Society of America.

[50]  Gustav Theodor Fechner,et al.  Elements of psychophysics , 1966 .

[51]  S. Klein,et al.  Measuring, estimating, and understanding the psychometric function: A commentary , 2001, Perception & psychophysics.

[52]  J. Jerger,et al.  Preferred Method For Clinical Determination Of Pure-Tone Thresholds , 1959 .

[53]  Faheema Mahomed,et al.  Validity of Automated Threshold Audiometry: A Systematic Review and Meta-Analysis , 2013, Ear and hearing.

[54]  Andreas Krause,et al.  Near-optimal sensor placements in Gaussian processes , 2005, ICML.

[55]  Yi Shen,et al.  Bayesian adaptive estimation of the auditory filter. , 2013, The Journal of the Acoustical Society of America.

[56]  J A Henry,et al.  Reliability and validity of high-frequency (8-20 kHz) thresholds obtained on a computer-based audiometer as compared to a documented laboratory system. , 1990, Journal of the American Academy of Audiology.

[57]  G. M. Zharkova,et al.  Flow visualization on a low aspect ratio wing by liquid crystal thermography , 2002 .

[58]  Mi Jung Park Bayesian learning methods for neural coding , 2013 .

[59]  J. L. Hall Hybrid adaptive procedure for estimation of psychometric functions. , 1980 .

[60]  C. DiMattina Fast adaptive estimation of multidimensional psychometric functions. , 2015, Journal of vision.

[61]  Mark A. Eckert,et al.  Classifying Human Audiometric Phenotypes of Age-Related Hearing Loss from Animal Models , 2013, Journal of the Association for Research in Otolaryngology.

[62]  James O. Berger,et al.  Ockham's Razor and Bayesian Analysis , 1992 .

[63]  David Barber,et al.  Bayesian Classification With Gaussian Processes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[65]  G. Békésy,et al.  Experiments in Hearing , 1963 .

[66]  Alexander Joseph Book reviewDischarge patterns of single fibers in the cat's auditory nerve: Nelson Yuan-Sheng Kiang, with the assistance of Takeshi Watanabe, Eleanor C. Thomas and Louise F. Clark: Research Monograph no. 35. Cambridge, Mass., The M.I.T. Press, 1965 , 1967 .