Issues in Automating Exploratory Data Analysis

Exploratory data analysis often plays a central role in the early stages of scientific inquiry. Models of complex phenomena are built incrementally, based on suggestive patterns in data and iterative refinement of plausible explanations. Unfortunately, exploration poses an explosive search problem. In this paper we present a planning approach to the problem. We outline the motivation for this approach and describe a planning system called Aide which we are developing to assist human analysts in exploring data.

[1]  Casimir Kulikowski,et al.  Domain-independent scientific function finding , 1990 .

[2]  F. Mosteller,et al.  Exploring Data Tables, Trends and Shapes. , 1988 .

[3]  Richard Scheines,et al.  Discovering Causal Structure: Artificial Intelligence, Philosophy of Science, and Statistical Modeling , 1987 .

[4]  William A. Gale,et al.  REX review , 1986 .

[5]  Martin Stacey,et al.  Scientific Discovery: Computational Explorations of the Creative Processes , 1988 .

[6]  Victor R. Lesser,et al.  A planner for the control of problem-solving systems , 1993, IEEE Trans. Syst. Man Cybern..

[7]  J. W. Gorman,et al.  Fitting Equations to Data. , 1973 .

[8]  G. Box,et al.  Scientific Inference, Data Analysis and Robustness. , 1985 .

[9]  David J. Hand,et al.  Patterns in statistical strategy , 1986 .

[10]  F. Mosteller,et al.  Understanding robust and exploratory data analysis , 1985 .

[11]  T E Graedel,et al.  Sunday and Workday Variations in Photochemical Air Pollutants in New Jersey and New York , 1974, Science.

[12]  Paul R. Cohen,et al.  Planning representation for automated exploratory data analysis , 1994, Defense, Security, and Sensing.

[13]  Michael Stuart,et al.  Understanding Robust and Exploratory Data Analysis , 1984 .

[14]  Pat Langley,et al.  Models of Incremental Concept Formation , 1990, Artif. Intell..

[15]  Kevin T. Kelly,et al.  Discovering Causal Structure. , 1989 .

[16]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[17]  R. Wayne Oldford,et al.  Implementation and study of statistical strategy , 1986 .

[18]  Paul R. Cohen,et al.  Preliminary System Design for an EDA Assistant , 1994 .

[19]  I. J. Good,et al.  The Philosophy of Exploratory Data Analysis , 1983, Philosophy of Science.

[20]  S.J.J. Smith,et al.  Empirical Methods for Artificial Intelligence , 1995 .

[21]  Gautam Biswas,et al.  Conceptual Clustering and Exploratory Data Analysis , 1991, ML.