The repeat copy task is an evaluation method for Neural Turing Machines (NTMs) that extends the standard copy task. In this task, the NTM is required to output a copied sequence a specified number of times. The authors used this task to test whether NTMs would be able to learn trivial nested functions.

San Diego State University

Google

"The copy task tests whether NTM can store and recall a long sequence of arbitrary information. The network is presented with an input sequence of random binary vectors followed by a delimiter flag. Storage and access of information over long time periods has  always been problematic for RNNs and other dynamic architectures. We were particularly interested to see if an NTM is able to bridge longer time delays than LSTM"

Learn Before

Related