sentence1: we present an endto-end evaluation framework for the wa task , and provide new evaluation metrics and detailed guidelines for evaluating semantic models on the wa task .
sentence2: we have also provided new evaluation metrics inspired by research in ir , and guidelines for evaluating semantic representation models on the quantitative wa task .