ils.py">https://github.com/fastai/course-nlp/blob/master/nlputils.py</a></p>
<p>I built a docker container and script, that automates the following steps:
1) Download Wikipedia XML-dump
2) Extract the text from the dump
3) Sample 160.000 documents with a minimum length of 1800 characters (results in 100m-120m tokens) both parameters can be changed - see the usage below</p>
<p>The whole process will take some time depending on the download speed and your hardware. For the 'dewiki' the preperation took about 