Application of multivariate outlier detection to fluid velocity measurements

A statistical-based approach to detect outliers in fluid-based velocity measurements is proposed. Outliers are effectively detected from experimental unimodal distributions with the application of an existing multivariate outlier detection algorithm for asymmetric distributions (Hubert and Van der Veeken, J Chemom 22:235–246, 2008). This approach is an extension of previous methods that only apply to symmetric distributions. For fluid velocity measurements, rejection of statistical outliers, meaning erroneous as well as low probability data, via multivariate outlier rejection is compared to a traditional method based on univariate statistics. For particle image velocimetry data, both tests are conducted after application of the current de facto standard spatial filter, the universal outlier detection test (Westerweel and Scarano, Exp Fluids 39:1096–1100, 2005). By doing so, the utility of statistical outlier detection in addition to spatial filters is demonstrated, and further, the differences between multivariate and univariate outlier detection are discussed. Since the proposed technique for outlier detection is an independent process, statistical outlier detection is complementary to spatial outlier detection and can be used as an additional validation tool.

[1]  Victor J. Yohai,et al.  The Behavior of the Stahel-Donoho Robust Multivariate Estimator , 1995 .

[2]  Nathan E. Murray,et al.  An application of Gappy POD , 2006 .

[3]  Ursula Gather,et al.  The largest nonindentifiable outlier: a comparison of multivariate simultaneous outlier identification rules , 2001 .

[4]  J. Westerweel,et al.  Universal outlier detection for PIV data , 2005 .

[5]  Mathieu Legrand,et al.  Limits and accuracy of the Stereo-LFC PIV technique and its application to flows of industrial interest , 2008 .

[6]  Yuichi Murai,et al.  A new tracking algorithm of PIV and removal of spurious vectors using Delaunay tessellation , 1999 .

[7]  Ursula Gather,et al.  The Largest Nonidentifiable Outlier , 2000 .

[8]  J. D. Bugg,et al.  Variable threshold outlier identification in PIV data , 2004 .

[9]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[10]  J. Westerweel,et al.  Efficient detection of spurious vectors in particle image velocimetry data , 1994 .

[11]  Ramanathan Gnanadesikan,et al.  Methods for statistical data analysis of multivariate observations , 1977, A Wiley publication in applied statistics.

[12]  J. Bendat,et al.  Random Data: Analysis and Measurement Procedures , 1987 .

[13]  M. Hubert,et al.  Outlier detection for skewed data , 2008 .

[14]  Hugh W. Coleman,et al.  Experimentation and Uncertainty Analysis for Engineers , 1989 .

[15]  Ronald Adrian,et al.  Optimization of particle image velocimeters , 1990, Other Conferences.

[16]  Ramanathan Gnanadesikan Methods for Statistical Data Analysis of Multivariate Observations: Gnanadesikan/Methods , 1997 .

[17]  Vic Barnett,et al.  Outliers in Statistical Data , 1980 .

[18]  Mia Hubert,et al.  An adjusted boxplot for skewed distributions , 2008, Comput. Stat. Data Anal..

[19]  Louis N. Cattafesta,et al.  An Experimental Study of Circulation Control on an , 2009 .

[20]  H. Saunders Literature Review : RANDOM DATA: ANALYSIS AND MEASUREMENT PROCEDURES J. S. Bendat and A.G. Piersol Wiley-Interscience, New York, N. Y. (1971) , 1974 .

[21]  W. R. Thompson On a Criterion for the Rejection of Observations and the Distribution of the Ratio of Deviation to Sample Standard Deviation , 1935 .

[22]  Richard D. Keane,et al.  Optimization of particle image velocimeters. I, Double pulsed systems , 1990 .

[23]  A. Madansky Identification of Outliers , 1988 .

[24]  K. Sreenivasan An Introduction to Turbulent Flow , 2001 .

[25]  David L. Woodruff,et al.  Identification of Outliers in Multivariate Data , 1996 .

[26]  M. Hubert,et al.  A Robust Measure of Skewness , 2004 .

[27]  Mia Hubert,et al.  LIBRA: a MATLAB library for robust analysis , 2005 .

[28]  A. Hadi Identifying Multiple Outliers in Multivariate Data , 1992 .

[29]  Nathan E. Murray,et al.  For subsonic cavity flow PIV data , 2007 .

[30]  Katrien van Driessen,et al.  A Fast Algorithm for the Minimum Covariance Determinant Estimator , 1999, Technometrics.

[31]  Markus Raffel,et al.  Particle Image Velocimetry: A Practical Guide , 2002 .