Kyle Goyette

Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics

Yoshua Bengio, Gauthier Gidel, Giancarlo Kerg, 2019, NeurIPS.

Untangling tradeoffs between recurrence and self-attention in artificial neural networks

Yoshua Bengio, Anirudh Goyal, Giancarlo Kerg, 2020, NeurIPS.

Deep Pepper: Expert Iteration based Chess agent in the Reinforcement Learning Setting pdf

Breandan Considine, Ahmad Chamseddine, Kyle Goyette, 2018, ArXiv.

Untangling tradeoffs between recurrence and self-attention in neural networks pdf

Yoshua Bengio, Giancarlo Kerg, Guillaume Lajoie, 2020, ArXiv.

Learning Long-term Dependencies Using Cognitive Inductive Biases in Self-attention RNNs

Giancarlo Kerg, Yoshua Bengio, Guillaume Lajoie, 2020 .