Performance of Information Complexity Criteria in Structural Equation Models with Applications

A common problem in structural equation modeling is that of model selection. Many re- searchers have addressed this problem, but many methods have provided mixed benefits until recently. Akaike's well-known criteria, AIC, has been applied in the context of structural equation modeling, but the effectiveness of many other information criteria have not been studied in a convincing manner. In this paper, we compare the SEM model selection prowess of several AIC-type and ICOMP-type crite- ria. We also introduce two new large sample consistent forms of Bozdogan's ICOMP criteria - one of which is robust to model misspecification. To study the empirical performance of the information criteria, we use a well-known SEM simulation protocol, and demonstrate that most of the information-theoretic criteria select the "pseudo true" model with very high frequencies. We also demonstrate, however, that the performance of AIC is inversely related to the sample size. Finally, we apply the new criteria to select an analytical model for a real dataset from a retail marketing study of consumer behavior. Our results show the versatility of the new proposed method where both the goodness-of fit and the complexity of the model is taken into account in one criterion function. 2010 Mathematics Subject Classifications: 62H12,62H15,62H20,62H25,62P15,62F35

[1]  Boris G. Mirkin,et al.  Choosing the number of clusters , 2011, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[2]  H. Bozdogan,et al.  Structural equation modeling (SEM) of categorical and mixed-data using the Novel Gifi transformations and information complexity (ICOMP) criterion , 2011 .

[3]  Hamparsum Bozdogan,et al.  Learning Factor Patterns in Exploratory Factor Analysis Using the Genetic Algorithm and Information Complexity as the Fitness Function , 2011 .

[4]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[5]  Hamparsun Bozdogan,et al.  A new class of information complexity (ICOMP) criteria with an application to customer profiling and segmentation , 2009 .

[6]  Stanley A. Mulaik,et al.  Linear Causal Modeling with Structural Equations , 2009 .

[7]  Alireza Bab-Hadiashar,et al.  Detecting cylinders in 3D range data using model selection criteria , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[8]  Xitao Fan,et al.  TEACHER'S CORNER: Using SAS for Monte Carlo Simulation Research in SEM , 2005 .

[9]  Hamparsum Bozdogan,et al.  Intelligent Statistical Data Mining with Information Complexity and Genetic Algorithms , 2004 .

[10]  David A. Lavis,et al.  Physics from Fisher information , 2002 .

[11]  T. Wan Structural Equation Models with Latent Variables , 2002 .

[12]  H. Bozdogan,et al.  Akaike's Information Criterion and Recent Developments in Information Complexity. , 2000, Journal of mathematical psychology.

[13]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[14]  H. Bozdogan Choosing the Number of Clusters, Subset Selection of Variables, and Outlier Detection in the Standard Mixture-Model Cluster Analysis , 1994 .

[15]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[16]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[17]  G. Kitagawa,et al.  Akaike Information Criterion Statistics , 1988 .

[18]  H. Bozdogan Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[19]  H. Akaike Factor analysis and AIC , 1987 .

[20]  石黒 真木夫,et al.  Akaike information criterion statistics , 1986 .

[21]  N Cliff,et al.  Some Cautions Concerning The Application Of Causal Modeling Methods. , 1983, Multivariate behavioral research.

[22]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[23]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[24]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[25]  van M.H. Emden,et al.  An analysis of complexity , 1971 .

[26]  S. Kullback Information Theory and Statistics , 1959 .

[27]  C. Radhakrishna Rao,et al.  Sufficient statistics and minimum variance estimates , 1949, Mathematical Proceedings of the Cambridge Philosophical Society.

[28]  C. R. Rao,et al.  Minimum variance and the estimation of several parameters , 1947, Mathematical Proceedings of the Cambridge Philosophical Society.