Loading GLUE dataset loads CoLA by default
NONE
As a follow-up to this: It looks like the actual GLUE task name is supplied as the `name` argument. Is there a way to check what `name`s/sub-datasets are available under a grouping like GLUE? That information doesn't seem to be readily available in info from `nlp.list_datasets()`.

Edit: I found the info under `Glue.BUILDER_CONFIGS`
2020-05-15T15:03:31Z
https://github.com/huggingface/datasets/issues/130#issuecomment-629284332
https://api.github.com/repos/huggingface/datasets/issues/130
MDEyOklzc3VlQ29tbWVudDYyOTI4NDMzMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/629284332/reactions
2020-05-15T15:23:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/629284332
https://avatars.githubusercontent.com/u/1668462?v=4
https://api.github.com/users/zphang/events{/privacy}
https://api.github.com/users/zphang/followers
https://api.github.com/users/zphang/following{/other_user}
https://api.github.com/users/zphang/gists{/gist_id}
https://github.com/zphang
zphang
MDQ6VXNlcjE2Njg0NjI=
https://api.github.com/users/zphang/orgs
https://api.github.com/users/zphang/received_events
https://api.github.com/users/zphang/repos
https://api.github.com/users/zphang/starred{/owner}{/repo}
https://api.github.com/users/zphang/subscriptions
User
https://api.github.com/users/zphang
public
MEMBER
Yes so the first config is loaded by default when no `name` is supplied but for GLUE this should probably throw an error indeed.

We can probably just add an `__init__` at the top of the `class Glue(nlp.GeneratorBasedBuilder)` in the `glue.py` script which does this check:
```
class Glue(nlp.GeneratorBasedBuilder):
    def __init__(self, *args, **kwargs):
        assert 'name' in kwargs and kwargs[name] is not None, "Glue has to be called with a configuration name"
        super(Glue, self).__init__(*args, **kwargs)
```
2020-05-17T13:01:01Z
https://github.com/huggingface/datasets/issues/130#issuecomment-629793979
https://api.github.com/repos/huggingface/datasets/issues/130
MDEyOklzc3VlQ29tbWVudDYyOTc5Mzk3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/629793979/reactions
2020-05-17T13:01:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/629793979
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
An error is raised if the sub-dataset is not specified :)
```
ValueError: Config name is missing.
Please pick one among the available configs: ['cola', 'sst2', 'mrpc', 'qqp', 'stsb', 'mnli', 'mnli_mismatched', 'mnli_matched', 'qnli', 'rte', 'wnli', 'ax']
Example of usage:
	`load_dataset('glue', 'cola')`
```
2020-05-27T22:07:58Z
https://github.com/huggingface/datasets/issues/130#issuecomment-634968980
https://api.github.com/repos/huggingface/datasets/issues/130
MDEyOklzc3VlQ29tbWVudDYzNDk2ODk4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/634968980/reactions
2020-05-27T22:07:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/634968980
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
If I run:

```python
dataset = nlp.load_dataset('glue')
```
The resultant dataset seems to be CoLA be default, without throwing any error. This is in contrast to calling:

```python
metric = nlp.load_metric("glue")
```
which throws an error telling the user that they need to specify a task in GLUE. Should the same apply for loading datasets?