Detecting Collusive Cliques in Futures Markets Based on Trading Behaviors from Real Data

In financial markets, abnormal trading behaviors pose a serious challenge to market surveillance and risk management. What is worse, there is an increasing emergence of abnormal trading events that some experienced traders constitute a collusive clique and collaborate to manipulate some instruments, thus mislead other investors by applying similar trading behaviors for maximizing their personal benefits. In this paper, a method is proposed to detect the hidden collusive cliques involved in an instrument of future markets by first calculating the correlation coefficient between any two eligible unified aggregated time series of signed order volume, and then combining the connected components from multiple sparsified weighted graphs constructed by using the correlation matrices where each correlation coefficient is over a user-specified threshold. Experiments conducted on real order data from the Shanghai Futures Exchange show that the proposed method can effectively detect suspect collusive cliques. A tool based on the proposed method has been deployed in the exchange as a pilot application for futures market surveillance and risk management.

[1]  Lei Chen,et al.  Robust and fast similarity search for moving object trajectories , 2005, SIGMOD '05.

[2]  Chengqi Zhang,et al.  Domain-Driven Local Exceptional Pattern Mining for Detecting Stock Price Manipulation , 2008, PRICAI.

[3]  Jyun-Cheng Wang,et al.  Recommending trusted online auction sellers using social network analysis , 2008, Expert Syst. Appl..

[4]  Carl E. Walter,et al.  Privatizing China: The Stock Markets and Their Role In Corporate Reform , 2003 .

[5]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[6]  Ramesh Govindan,et al.  Making Eigenvector-Based Reputation Systems Robust to Collusion , 2004, WAW.

[7]  Jarrod Trevathan,et al.  Investigating Shill Bidding Behaviour Involving Colluding Bidders , 2007, J. Comput..

[8]  A. Khwaja,et al.  Unchecked Intermediaries: Price Manipulation in an Emerging Stock Market , 2005 .

[9]  Christos Faloutsos,et al.  Efficient Similarity Search In Sequence Databases , 1993, FODO.

[10]  János Kertész,et al.  On the origin of the Epps effect , 2007 .

[11]  Wolfgang Nejdl,et al.  Preventing shilling attacks in online recommender systems , 2005, WIDM '05.

[12]  Jan Schröder,et al.  On the Analysis of Irregular Stock Market Trading Behavior , 2007, GfKl.

[13]  Hui Ding,et al.  Querying and mining of time series data: experimental comparison of representations and distance measures , 2008, Proc. VLDB Endow..

[14]  Fillia Makedon,et al.  Attack Detection in Time Series for Recommendation Systems , 2006 .

[15]  Dimitrios Gunopulos,et al.  Discovering similar multidimensional trajectories , 2002, Proceedings 18th International Conference on Data Engineering.

[16]  Rajesh Aggarwal,et al.  Stock Market Manipulations , 2006 .

[17]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[18]  János Kertész,et al.  The Epps effect revisited , 2007, 0704.1099.

[19]  T. W. Epps.  Comovements in Stock Prices in the Very Short Run , 1979 .

[20]  S. Stigler.  Francis Galton's Account of the Invention of Correlation , 1989 .

[21]  Lei Chen,et al.  On the Marriage of Edit Distance and Lp Norms , 2004, VLDB 2004.

[22]  Zheng Chen,et al.  Finding group shilling in recommendation system , 2005, WWW '05.

[23]  J. Mei,et al.  Behavior Based Manipulation , 2003 .

[24]  Janine Hansen,et al.  Manipulation in political stock markets – preconditions and evidence , 2004 .

[25]  Anthony K. H. Tung,et al.  SpADe: On Shape-based Pattern Detection in Streaming Time Series , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[26]  Franklin Allen,et al.  Large Investors, Price Manipulation, and Limits to Arbitrage: An Anatomy of Market Corners , 2004 .

[27]  Eamonn J. Keogh,et al.  Scaling up dynamic time warping for datamining applications , 2000, KDD '00.

[28]  Eamonn J. Keogh,et al.  On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration , 2002, Data Mining and Knowledge Discovery.

[29]  Piazza S. Francesco,et al.  A CLOSER LOOK AT THE EPPS EFFECT , 2003 .

[30]  John Riedl,et al.  Shilling recommender systems for fun and profit , 2004, WWW '04.

[31]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[32]  Jignesh M. Patel,et al.  An efficient and accurate method for evaluating time series similarity , 2007, SIGMOD '07.

[33]  Girish Keshav Palshikar,et al.  Collusion set detection using graph clustering , 2008, Data Mining and Knowledge Discovery.

[34]  Philip S. Yu,et al.  Detecting abnormal coupled sequences and sequence changes in group-based manipulative trading behaviors , 2010, KDD.

[35]  Yafei Yang,et al.  Detection of collusion behaviors in online reputation systems , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[36]  Jarrod Trevathan,et al.  Detecting Collusive Shill Bidding , 2007, Fourth International Conference on Information Technology (ITNG'07).

[37]  Girish Keshav Palshikar,et al.  Fuzzy Temporal Patterns for Analyzing Stock Market Databases , 2000 .

[38]  Ion Stoica,et al.  Robust incentive techniques for peer-to-peer networks , 2004, EC '04.

[39]  Ben Y. Zhao,et al.  An Empirical Study of Collusion Behavior in the Maze P2P File-Sharing System , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).