new version of Ted Talks IWSLT (WIT3)
CONTRIBUTOR
> Nice thank you ! Actually as it is a translation dataset we should probably have one configuration = one language pair no ?
> 
> Could you use the same trick for this dataset ?

I was looking for this input, infact I had written a long post on the Slack channel,...(_but unfortunately due to the holidays didn;t get a respones_). Initially I had tried with language pairs and then with specific language configs. 

I'll have a look at the `opus-gnomes` dataset

2021-01-04T15:55:33Z
https://github.com/huggingface/datasets/pull/1676#issuecomment-754056779
https://api.github.com/repos/huggingface/datasets/issues/1676
MDEyOklzc3VlQ29tbWVudDc1NDA1Njc3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/754056779/reactions
2021-01-04T15:56:22Z
https://api.github.com/repos/huggingface/datasets/issues/comments/754056779
https://avatars.githubusercontent.com/u/9033954?v=4
https://api.github.com/users/skyprince999/events{/privacy}
https://api.github.com/users/skyprince999/followers
https://api.github.com/users/skyprince999/following{/other_user}
https://api.github.com/users/skyprince999/gists{/gist_id}
https://github.com/skyprince999
skyprince999
MDQ6VXNlcjkwMzM5NTQ=
https://api.github.com/users/skyprince999/orgs
https://api.github.com/users/skyprince999/received_events
https://api.github.com/users/skyprince999/repos
https://api.github.com/users/skyprince999/starred{/owner}{/repo}
https://api.github.com/users/skyprince999/subscriptions
User
https://api.github.com/users/skyprince999
public
MEMBER
Oh sorry I must have missed your message then :/
I was off a few days during the holidays

Hopefully this trick can enable the use of any language pair (+ year ?) combination and also simplify a lot the dummy data creation since it will only require a few configs.
2021-01-04T15:58:46Z
https://github.com/huggingface/datasets/pull/1676#issuecomment-754058592
https://api.github.com/repos/huggingface/datasets/issues/1676
MDEyOklzc3VlQ29tbWVudDc1NDA1ODU5Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/754058592/reactions
2021-01-04T15:58:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/754058592
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Updated it as per the comments. But couldn't figure out why the dummy tests are failing >> 
```
$RUN_SLOW=1 pytest tests/test_dataset_common.py::LocalDatasetTest::test_load_real_dataset_ted_talks_iwslt
.....
....
tests/test_dataset_common.py:198: in check_load_dataset
    self.parent.assertTrue(len(dataset[split]) > 0)
E   AssertionError: False is not true
```
2021-01-13T13:32:28Z
https://github.com/huggingface/datasets/pull/1676#issuecomment-759450250
https://api.github.com/repos/huggingface/datasets/issues/1676
MDEyOklzc3VlQ29tbWVudDc1OTQ1MDI1MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/759450250/reactions
2021-01-13T13:33:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/759450250
https://avatars.githubusercontent.com/u/9033954?v=4
https://api.github.com/users/skyprince999/events{/privacy}
https://api.github.com/users/skyprince999/followers
https://api.github.com/users/skyprince999/following{/other_user}
https://api.github.com/users/skyprince999/gists{/gist_id}
https://github.com/skyprince999
skyprince999
MDQ6VXNlcjkwMzM5NTQ=
https://api.github.com/users/skyprince999/orgs
https://api.github.com/users/skyprince999/received_events
https://api.github.com/users/skyprince999/repos
https://api.github.com/users/skyprince999/starred{/owner}{/repo}
https://api.github.com/users/skyprince999/subscriptions
User
https://api.github.com/users/skyprince999
public
In the previous iteration #1608 I had used language pairs. Which created 21,582 configs (109*108) !!! 

Now, TED talks in _each language_ is a separate config. So it's more cleaner with _just 109 configs_  (one for each language). Dummy files were created manually. 

Locally  I was able to clear the `python datasets-cli test datasets/......` . Which created the `dataset_info.json`  file . The test for the dummy files was also cleared. However couldn't figure out how to specify the local data folder for the real dataset


**Note: that this requires manual download of the dataset.** 
**Note2: The high number of _Files changed (112)_ is because of the large number of dummy files/configs!**