Learners Based on Transducers

As data come out one by one from an infinite stream, automatic learners maintain some string as long term memory, and update it at every new datum (example) they process. Transduced learners are generalization of automatic learners. Both kind of learners are evaluated with respect to the space they consume for learning. For automatic learners, it is unknown whether at any point, the size of the long term memory can be bounded by the length of the longest datum that has been received so far. Here it is shown that, even when restricting learning to automatic families, there is a hierarchy of classes that can be learnt with memory \(O(n^k)\), and all automatic families which are learnable in principle can be learnt by a transduced learner using exponential sized memory.

[1]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[2]  Achim Blumensath,et al.  Automatic structures , 2000, Proceedings Fifteenth Annual IEEE Symposium on Logic in Computer Science (Cat. No.99CB36332).

[3]  Anil Nerode,et al.  Automatic Presentations of Structures , 1994, LCC.

[4]  Sasha Rubin,et al.  Automata Presenting Structures: A Survey of the Finite String Case , 2008, Bulletin of Symbolic Logic.

[5]  Frank Stephan,et al.  Language Learning from Texts: Mindchanges, Limited Memory, and Monotonicity , 1995, Inf. Comput..

[6]  André Nies,et al.  Automatic structures: richness and limitations , 2004, Proceedings of the 19th Annual IEEE Symposium on Logic in Computer Science, 2004..

[7]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[8]  John Case,et al.  Automatic Learning of Subclasses of Pattern Languages , 2011, LATA.

[9]  Maurice Nivat,et al.  Transduction des langages de Chomsky , 1968 .

[10]  John Case,et al.  Automatic functions, linear time and learning , 2013, Log. Methods Comput. Sci..

[11]  John Case,et al.  Machine Inductive Inference and Language Identification , 1982, ICALP.

[12]  Thomas Zeugmann,et al.  Learning indexed families of recursive languages from positive data: A survey , 2008, Theor. Comput. Sci..

[13]  Sanjay Jain,et al.  ON AUTOMATIC FAMILIES , 2011 .

[14]  Sanjay Jain,et al.  Learnability of automatic classes , 2012, J. Comput. Syst. Sci..

[15]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[16]  John Case,et al.  Difficulties in Forcing Fairness of Polynomial Time Inductive Inference , 2009, ALT.

[17]  Carl H. Smith,et al.  On the impact of forgetting on learning machines , 1995, JACM.

[18]  Leonard Pitt,et al.  Inductive Inference, DFAs, and Computational Complexity , 1989, AII.

[19]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..

[20]  Alexandra Silva,et al.  Generalizing determinization from automata to coalgebras , 2013, Log. Methods Comput. Sci..

[21]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[22]  Rolf Wiehagen Limes-Erkennung rekursiver Funktionen durch spezielle Strategien , 1975, J. Inf. Process. Cybern..

[23]  Ana Sokolova,et al.  Generic Trace Semantics via Coinduction , 2007, Log. Methods Comput. Sci..