A Mathematical Approach to Investigate the Relationship between Association Memory and Latent Semantic Analysis for Word Meanings in English and Chinese

A Mathematical Approach to Investigate the Relationship between Association Memory and Latent Semantic Analysis for Word Meanings in English and Chinese Ming-Liang Wei National Cheng Kung University Chung-Ching Wang National Cheng Kung University Yen-Cheng Chen National Cheng Kung University Yu-Lin Chang National Taiwan Normal University Hsueh-Chih Chen National Taiwan Normal University Jon-Fan Hu National Cheng Kung University Abstract: Certain previous researches attempted to characterize how association memory works. The word meanings derived from LSA (latent semantic analysis) are usually showed highly related to the performance of forward association memory. A na¨ive postulation would assume that the mechanisms for that relationship are mainly due to the processes of semantic similarity. The present work not only validates that the LSA calculation outcome is related to the norm of association memory for both English and Chinese, but also proposes that association memory could be constructed by considering the similar co-occurrences across situations for words from the perspective of LSA. The work further analyzes the constructed association bipartite nets and the results showed that the counts of afferent associations are proportional to the strength of association memory. It can be concluded that the words associated with many other words would have higher probability to have higher LSA values. Finally, we suggest a possible mechanism of how association memory is formed and depicts how words emerging in many other situations would be more probable to be associated with other words, which can be predicted by LSA.