Random Features and Random Neurons for Brain-Inspired Big Data Analytics

With the explosion of Big Data, fast and frugal reasoning algorithms are increasingly needed to keep up with the size and the pace of user-generated contents on the Web. In many real-time applications, it is preferable to be able to process more data with reasonable accuracy rather than having higher accuracy over a smaller set of data. In this work, we leverage on both random features and random neurons to perform analogical reasoning over Big Data. Due to their big size and dynamic nature, in fact, Big Data are hard to process with standard dimensionality reduction techniques and clustering algorithms. To this end, we apply random projection to generate a multi-dimensional vector space of commonsense knowledge and use an extreme learning machine to perform reasoning on it. In particular, the combined use of random multi-dimensional scaling and randomly-initialized learning methods allows for both better representation of high-dimensional data and more efficient discovery of their semantic and affective relatedness.

[1]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[2]  Roberto V. Zicari,et al.  PoliTwi: Early detection of emerging political topics on twitter and the impact on concept-level sentiment analysis , 2014, Knowl. Based Syst..

[3]  Quan Pan,et al.  Learning binary codes with neural collaborative filtering for efficient recommendation systems , 2019, Knowl. Based Syst..

[4]  Charles Elkan,et al.  Fast Algorithms for Approximating the Singular Value Decomposition , 2011, TKDD.

[5]  M. Minsky The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind , 2006 .

[6]  Erik Cambria,et al.  Sentic Computing for patient centered applications , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[7]  Erik Cambria,et al.  Fuzzy commonsense reasoning for multimodal sentiment analysis , 2019, Pattern Recognit. Lett..

[8]  Erik Cambria,et al.  Sentic Activation: A Two-Level Affective Common Sense Reasoning Framework , 2012, AAAI.

[9]  Dimitris Achlioptas,et al.  Database-friendly random projections , 2001, PODS.

[10]  Erik Cambria,et al.  Sentic Computing: Exploitation of Common Sense for the Development of Emotion-Sensitive Systems , 2009, COST 2102 Training School.

[11]  Luca Oneto,et al.  Technical analysis and sentiment embeddings for market trend prediction , 2019, Expert Syst. Appl..

[12]  Ramanathan V. Guha,et al.  Building Large Knowledge-Based Systems: Representation and Inference in the Cyc Project , 1990 .

[13]  Heikki Mannila,et al.  Random projection in dimensionality reduction: applications to image and text data , 2001, KDD '01.

[14]  Erik Cambria,et al.  Sentic Medoids: Organizing Affective Common Sense Knowledge in a Multi-Dimensional Vector Space , 2011, ISNN.

[15]  David Balduzzi,et al.  Randomized co-training: from cortical neurons to machine learning and back again , 2013, ArXiv.

[16]  김용수,et al.  Extreme Learning Machine 기반 퍼지 패턴 분류기 설계 , 2015 .

[17]  Erik Cambria,et al.  Sentic PROMs: Application of sentic computing to the development of a novel unified framework for measuring health-care quality , 2012, Expert Syst. Appl..

[18]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[19]  Tamás Sarlós,et al.  Improved Approximation Algorithms for Large Matrices via Random Projections , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[20]  Honglak Lee,et al.  Unsupervised learning of hierarchical representations with convolutional deep belief networks , 2011, Commun. ACM.

[21]  E. Davis,et al.  Common Sense Reasoning , 2014, Encyclopedia of Social Network Analysis and Mining.

[22]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[23]  G. Fauconnier,et al.  The Way We Think: Conceptual Blending and the Mind''s Hidden Complexities. Basic Books , 2002 .

[24]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[25]  James Pustejovsky,et al.  Coarse Word-Sense Disambiguation Using Common Sense , 2010, AAAI Fall Symposium: Commonsense Knowledge.

[26]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[27]  Francesco Piazza,et al.  Acoustic template-matching for automatic emergency state detection: An ELM based algorithm , 2015, Neurocomputing.

[28]  Aviv Segev,et al.  Analyzing future communities in growing citation networks , 2013, Knowl. Based Syst..

[29]  Bernard Chazelle,et al.  Faster dimension reduction , 2010, Commun. ACM.

[30]  David Bell,et al.  Microblogging as a mechanism for human-robot interaction , 2014, Knowl. Based Syst..

[31]  Luis Alfonso Ureña López,et al.  Crowd explicit sentiment analysis , 2014, Knowl. Based Syst..

[32]  Joel A. Tropp,et al.  Improved Analysis of the subsampled Randomized Hadamard Transform , 2010, Adv. Data Sci. Adapt. Anal..

[33]  Haixun Wang,et al.  Guest Editorial: Big Social Data Analysis , 2014, Knowl. Based Syst..

[34]  Erik Cambria,et al.  Natural language based financial forecasting: a survey , 2017, Artificial Intelligence Review.

[35]  Ivor W. Tsang,et al.  The Emerging "Big Dimensionality" , 2014, IEEE Computational Intelligence Magazine.

[36]  Erik Cambria,et al.  Common Sense Computing: From the Society of Mind to Digital Intuition and beyond , 2009, COST 2101/2102 Conference.

[37]  Catherine Havasi,et al.  ConceptNet 5: A Large Semantic Network for Relational Knowledge , 2013, The People's Web Meets NLP.

[38]  Li Chen,et al.  News impact on stock price return via sentiment analysis , 2014, Knowl. Based Syst..

[39]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[40]  Dean P. Foster,et al.  Faster Ridge Regression via the Subsampled Randomized Hadamard Transform , 2013, NIPS.

[41]  Erik Cambria,et al.  An Introduction to Concept-Level Sentiment Analysis , 2013, MICAI.

[42]  A. Kolmogorov,et al.  ALGORITHMS AND RANDOMNESS , 1988 .