Don't keep the dummy data folder or dataset_infos.json when resolving data files
CONTRIBUTOR
Hi @lhoestq I am new to huggingface datasets, I would like to work on this issue!

2021-09-26T19:04:27Z
https://github.com/huggingface/datasets/issues/2877#issuecomment-927354395
https://api.github.com/repos/huggingface/datasets/issues/2877
IC_kwDODunzps43Rk4b
https://api.github.com/repos/huggingface/datasets/issues/comments/927354395/reactions
2021-09-26T19:04:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/927354395
https://avatars.githubusercontent.com/u/46553104?v=4
https://api.github.com/users/Ishan-Kumar2/events{/privacy}
https://api.github.com/users/Ishan-Kumar2/followers
https://api.github.com/users/Ishan-Kumar2/following{/other_user}
https://api.github.com/users/Ishan-Kumar2/gists{/gist_id}
https://github.com/Ishan-Kumar2
Ishan-Kumar2
MDQ6VXNlcjQ2NTUzMTA0
https://api.github.com/users/Ishan-Kumar2/orgs
https://api.github.com/users/Ishan-Kumar2/received_events
https://api.github.com/users/Ishan-Kumar2/repos
https://api.github.com/users/Ishan-Kumar2/starred{/owner}{/repo}
https://api.github.com/users/Ishan-Kumar2/subscriptions
User
https://api.github.com/users/Ishan-Kumar2
public
MEMBER
Thanks for the help :) 

As mentioned in the PR, excluding files named "dummy_data.zip" is actually more general than excluding the files inside a "dummy" folder. I just did the change in the PR, I think we can merge it now
2021-09-29T09:02:12Z
https://github.com/huggingface/datasets/issues/2877#issuecomment-929981517
https://api.github.com/repos/huggingface/datasets/issues/2877
IC_kwDODunzps43bmRN
https://api.github.com/repos/huggingface/datasets/issues/comments/929981517/reactions
2021-09-29T09:02:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/929981517
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
When there's no dataset script, all the data files of a folder or a repository on the Hub are loaded as data files.

There are already a few exceptions:
- files starting with "." are ignored
- the dataset card "README.md" is ignored
- any file named "config.json" is ignored (currently it isn't used anywhere, but it could be used in the future to define splits or configs for example, but not 100% sure)

However any data files in a folder named "dummy" should be ignored as well as they should only be used to test the dataset.
Same for "dataset_infos.json" which should only be used to get the `dataset.info`