sentence1: for extracting recurrent neural network language model features , we use elman 1 , a modification of the rnnlm toolkit 2 that outputs hidden layer activations .
sentence2: for the decoder , we use a recurrent neural network language model , which is widely used in language generation tasks .