How to enable bidirectional attention?

#21
by Adenialzz - opened

Hi, thanks for open-sourcing such a good model. I wonder can I conveniently enable bidirectional attention. I noticed that you conducted relevant ablation experiments in the technical report.

Sign up or log in to comment