Is there a way to download only NQ dev?
MEMBER
Unfortunately it's not possible to download only the dev set of NQ.

I think we could add a way to download only the test set by adding a custom configuration to the processing script though.
2020-07-20T09:45:45Z
https://github.com/huggingface/datasets/issues/413#issuecomment-660923778
https://api.github.com/repos/huggingface/datasets/issues/413
MDEyOklzc3VlQ29tbWVudDY2MDkyMzc3OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/660923778/reactions
2020-07-20T09:45:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/660923778
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Ok, got it. I think this could be a valuable feature - especially for large datasets like NQ, but potentially also others. 
For us, it will in this case make the difference of using the library or keeping the old downloads of the raw dev datasets.  
However, I don't know if that fits into your plans with the library and can also understand if you don't want to support this.
2020-07-21T06:36:37Z
https://github.com/huggingface/datasets/issues/413#issuecomment-661665055
https://api.github.com/repos/huggingface/datasets/issues/413
MDEyOklzc3VlQ29tbWVudDY2MTY2NTA1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/661665055/reactions
2020-07-21T06:36:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/661665055
https://avatars.githubusercontent.com/u/1563902?v=4
https://api.github.com/users/tholor/events{/privacy}
https://api.github.com/users/tholor/followers
https://api.github.com/users/tholor/following{/other_user}
https://api.github.com/users/tholor/gists{/gist_id}
https://github.com/tholor
tholor
MDQ6VXNlcjE1NjM5MDI=
https://api.github.com/users/tholor/orgs
https://api.github.com/users/tholor/received_events
https://api.github.com/users/tholor/repos
https://api.github.com/users/tholor/starred{/owner}{/repo}
https://api.github.com/users/tholor/subscriptions
User
https://api.github.com/users/tholor
public
MEMBER
I don't think we could force this behavior generally since the dataset script authors are free to organize the file download as they want (sometimes the mapping between split and files can be very much nontrivial) but we can add an additional configuration for Natural Question indeed as @lhoestq indicate.
2020-07-29T13:06:20Z
https://github.com/huggingface/datasets/issues/413#issuecomment-665652022
https://api.github.com/repos/huggingface/datasets/issues/413
MDEyOklzc3VlQ29tbWVudDY2NTY1MjAyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/665652022/reactions
2020-07-29T13:06:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/665652022
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
Maybe I missed that in the docs, but is there a way to only download the dev set of natural questions (~1 GB)? 
As we want to benchmark QA models on different datasets, I would like to avoid downloading the 41GB of training data. 

I tried
```
dataset = nlp.load_dataset('natural_questions', split="validation", beam_runner="DirectRunner")
```
But this still triggered a big download of presumably the whole dataset. Is there any way of doing this or are splits / slicing options only available after downloading?

Thanks!