Add MultiEURLEX dataset
CONTRIBUTOR
Hi @lhoestq, we have this new cool multilingual dataset coming at EMNLP 2021. It would be really nice if we could have it in Hugging Face asap. Thanks! 
2021-09-02T13:36:39Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-911692046
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42V1EO
https://api.github.com/repos/huggingface/datasets/issues/comments/911692046/reactions
2021-09-02T13:36:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/911692046
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
CONTRIBUTOR
Hi @lhoestq, I adopted most of your suggestions:

- Dummy data files reduced, including the 2 smallest documents per subset JSONL.
- README was updated with the publication URL and instructions on how to download and use label descriptors. Excessive newlines were deleted.

I would prefer to keep the label list in a pure format (original ids), to enable people to combine those with more information or possibly in the future explore the dataset, find inconsistencies and fix those to release a new version. 
2021-09-06T18:20:55Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-913801368
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42d4CY
https://api.github.com/repos/huggingface/datasets/issues/comments/913801368/reactions
2021-09-06T18:20:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/913801368
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
MEMBER
Thanks for the changes :)

Regarding the labels:

If you use the ClassLabel feature type, the only change is that it will store the ids as integers instead of (currently) string.
The advantage is that if people want to know what id corresponds to which label name, they can use `classlabel.int2str`. It is also the format that helps automate model training for classification in `transformers`.

Let me know if that sounds good to you or if you still want to stick with the labels as they are now.
2021-09-09T08:39:06Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-915883145
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42l0SJ
https://api.github.com/repos/huggingface/datasets/issues/comments/915883145/reactions
2021-09-09T08:39:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/915883145
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Hey @lhoestq, thanks for providing this information. This sounds great. I updated my code accordingly to use `ClassLabel`. Could you please provide a minimal example of how `classlabel.int2str` works in practice in my case, where labels are a sequence?

```python
from datasets import load_dataset
dataset = load_dataset('multi_eurlex', 'all_languages')
# Read strs from the labels (list of integers) for the 1st sample of the training split
```

I would like to include this in the README file.

Could you also provide some info on how I could define the supervized key to automate model training, as you said?

Thanks!
2021-09-09T12:13:23Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-916035278
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42mZbO
https://api.github.com/repos/huggingface/datasets/issues/comments/916035278/reactions
2021-09-09T12:13:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916035278
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
MEMBER
Thanks for the update :)

Here is an example of usage:
```python
from datasets import load_dataset
dataset = load_dataset('multi_eurlex', 'all_languages', split='train')
classlabel = dataset.features["labels"].feature
print(dataset[0]["labels"])
# [1, 20, 7, 3, 0]
print(classlabel.int2str(dataset[0]["labels"]))
# ['100160', '100155', '100158', '100147', '100149']
```

The ClassLabel is simply used to define the `id2label` dictionary of classification models, to make the ids match between the model and the dataset. There nothing more to do :p 

I think one last thing to do is just update the `dataset_infos.json` file and we'll be good !
2021-09-10T09:29:42Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-916767204
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42pMHk
https://api.github.com/repos/huggingface/datasets/issues/comments/916767204/reactions
2021-09-10T09:29:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916767204
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Everything is ready! 👍 

2021-09-10T10:33:29Z
https://github.com/huggingface/datasets/pull/2865#issuecomment-916804248
https://api.github.com/repos/huggingface/datasets/issues/2865
IC_kwDODunzps42pVKY
https://api.github.com/repos/huggingface/datasets/issues/comments/916804248/reactions
2021-09-10T10:33:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916804248
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
**Add new MultiEURLEX Dataset**

MultiEURLEX comprises 65k EU laws in 23 official EU languages (some low-ish resource). Each EU law has been annotated with EUROVOC concepts (labels) by the Publication Office of EU. As with the English EURLEX, the goal is to predict the relevant EUROVOC concepts (labels); this is multi-label classification task (given the text, predict multiple labels).