sentence1: we use different pretrained word embeddings such as glove 1 and fasttext 2 as the initial word embeddings .
sentence2: we use glove embeddings for the english tasks and fasttext embeddings for all newswire tasks .