         │
            └── class               classifier trained in step 4
                ├── fwd             forward learner
                └── bwd             backwards learner</code></pre>

</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered"><div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h3 id="1.-Prepare-Wikipedia-dump-for-pretraining">1. Prepare Wikipedia-dump for pretraining<a class="anchor-link" href="#1.-Prepare