NTMs have two basic components, namely, controller and memory bank. Controller uses input and output vectors to interact with outside environment. This is similar to what we have in typical neural network architectures. Additionally, unlike other neural network architectures, it also interacts with the memory bank using read and write operations. NTMs can be used with gradient descent and this process would be quite straightforward as each component is differentiable.