Exploratory Correlation Analysis

We present a novel unsupervised artificial neural network for the extraction of common features in multiple data sources. This algorithm, which we name Exploratory Correlation Analysis (ECA), is a multi-stream extension of a neural implementation of Exploratory Projection Pursuit (EPP) and has a close relationship with Canonical Correlation Analysis (CCA). Whereas EPP identifies ”interesting” statistical directions in a single stream of data, ECA develops a joint coding of the common underlying statistical features across a number of data streams. It has been shown that the principle of contextual guidance may be used to find a sparse coding of the features in dual natural image patches that is very different from single stream sparse coding experiments. The network only identifies those features which exist in both data streams and thus tend to be fewer in number and more complex in nature.