Add Wiki Lingua Dataset
CONTRIBUTOR
I am done adding the dataset. Requesting to review and advise.
2020-12-09T04:55:09Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-741526408
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0MTUyNjQwOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/741526408/reactions
2020-12-09T04:55:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/741526408
https://avatars.githubusercontent.com/u/7674948?v=4
https://api.github.com/users/katnoria/events{/privacy}
https://api.github.com/users/katnoria/followers
https://api.github.com/users/katnoria/following{/other_user}
https://api.github.com/users/katnoria/gists{/gist_id}
https://github.com/katnoria
katnoria
MDQ6VXNlcjc2NzQ5NDg=
https://api.github.com/users/katnoria/orgs
https://api.github.com/users/katnoria/received_events
https://api.github.com/users/katnoria/repos
https://api.github.com/users/katnoria/starred{/owner}{/repo}
https://api.github.com/users/katnoria/subscriptions
User
https://api.github.com/users/katnoria
public
MEMBER
looks like this PR has changes about many other files than the ones for WIki Lingua 

Can you create another branch and another PR please ?
2020-12-10T09:42:15Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-742405444
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0MjQwNTQ0NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/742405444/reactions
2020-12-10T09:42:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742405444
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Any reason to have english as the default config over the other languages ?
2020-12-10T09:45:48Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-742407477
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0MjQwNzQ3Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/742407477/reactions
2020-12-10T09:45:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742407477
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
> looks like this PR has changes about many other files than the ones for WIki Lingua
> 
> Can you create another branch and another PR please ?

Ok, I will create another branch and submit a fresh PR.
2020-12-11T01:13:01Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-742900692
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0MjkwMDY5Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/742900692/reactions
2020-12-11T01:13:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742900692
https://avatars.githubusercontent.com/u/7674948?v=4
https://api.github.com/users/katnoria/events{/privacy}
https://api.github.com/users/katnoria/followers
https://api.github.com/users/katnoria/following{/other_user}
https://api.github.com/users/katnoria/gists{/gist_id}
https://github.com/katnoria
katnoria
MDQ6VXNlcjc2NzQ5NDg=
https://api.github.com/users/katnoria/orgs
https://api.github.com/users/katnoria/received_events
https://api.github.com/users/katnoria/repos
https://api.github.com/users/katnoria/starred{/owner}{/repo}
https://api.github.com/users/katnoria/subscriptions
User
https://api.github.com/users/katnoria
public
CONTRIBUTOR
> Any reason to have english as the default config over the other languages ?

The data for all other languages has a direct reference to English article. Thus, I kept English as default.
2020-12-11T01:14:35Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-742901142
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0MjkwMTE0Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/742901142/reactions
2020-12-11T01:16:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742901142
https://avatars.githubusercontent.com/u/7674948?v=4
https://api.github.com/users/katnoria/events{/privacy}
https://api.github.com/users/katnoria/followers
https://api.github.com/users/katnoria/following{/other_user}
https://api.github.com/users/katnoria/gists{/gist_id}
https://github.com/katnoria
katnoria
MDQ6VXNlcjc2NzQ5NDg=
https://api.github.com/users/katnoria/orgs
https://api.github.com/users/katnoria/received_events
https://api.github.com/users/katnoria/repos
https://api.github.com/users/katnoria/starred{/owner}{/repo}
https://api.github.com/users/katnoria/subscriptions
User
https://api.github.com/users/katnoria
public
MEMBER
closing in favor of #1470 
2020-12-14T10:39:52Z
https://github.com/huggingface/datasets/pull/1308#issuecomment-744350625
https://api.github.com/repos/huggingface/datasets/issues/1308
MDEyOklzc3VlQ29tbWVudDc0NDM1MDYyNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/744350625/reactions
2020-12-14T10:39:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/744350625
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Hello,

This is my first PR. 

I have added Wiki Lingua Dataset along with dataset card to the best of my knowledge.
There was one hiccup though. I was unable to create dummy data because the data is in pkl format.
From the document, I see that:
```At the moment it supports data files in the following format: txt, csv, tsv, jsonl, json, xml```

