[api request] API to obtain "dataset_module" dynamic path?
MEMBER
Hi @richardliaw, 

First, thanks for the compliments.

In relation with your request, currently, the dynamic modules path is obtained this way:
```python
from datasets.load import init_dynamic_modules, MODULE_NAME_FOR_DYNAMIC_MODULES

dynamic_modules_path = init_dynamic_modules(MODULE_NAME_FOR_DYNAMIC_MODULES)
```

Let me know if it is OK for you this way. 

I could set `MODULE_NAME_FOR_DYNAMIC_MODULES` as default value, so that you could instead obtain the path with:
```
dynamic_modules_path = datasets.load.init_dynamic_modules()
```
2021-05-05T09:08:45Z
https://github.com/huggingface/datasets/issues/2318#issuecomment-832536422
https://api.github.com/repos/huggingface/datasets/issues/2318
MDEyOklzc3VlQ29tbWVudDgzMjUzNjQyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/832536422/reactions
2021-05-05T09:08:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/832536422
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Hi @albertvillanova, the default value proposal seems great :) Looking forward to this!
2021-05-05T16:20:00Z
https://github.com/huggingface/datasets/issues/2318#issuecomment-832827156
https://api.github.com/repos/huggingface/datasets/issues/2318
MDEyOklzc3VlQ29tbWVudDgzMjgyNzE1Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/832827156/reactions
2021-05-05T16:20:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/832827156
https://avatars.githubusercontent.com/u/4529381?v=4
https://api.github.com/users/richardliaw/events{/privacy}
https://api.github.com/users/richardliaw/followers
https://api.github.com/users/richardliaw/following{/other_user}
https://api.github.com/users/richardliaw/gists{/gist_id}
https://github.com/richardliaw
richardliaw
MDQ6VXNlcjQ1MjkzODE=
https://api.github.com/users/richardliaw/orgs
https://api.github.com/users/richardliaw/received_events
https://api.github.com/users/richardliaw/repos
https://api.github.com/users/richardliaw/starred{/owner}{/repo}
https://api.github.com/users/richardliaw/subscriptions
User
https://api.github.com/users/richardliaw
public
MEMBER
I like the idea as well ! thanks @albertvillanova 
2021-05-05T18:22:19Z
https://github.com/huggingface/datasets/issues/2318#issuecomment-832908954
https://api.github.com/repos/huggingface/datasets/issues/2318
MDEyOklzc3VlQ29tbWVudDgzMjkwODk1NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/832908954/reactions
2021-05-05T18:22:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/832908954
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Hi @richardliaw, the feature is on the master branch and will be included in the next release in a couple of weeks.
2021-05-06T08:00:46Z
https://github.com/huggingface/datasets/issues/2318#issuecomment-833317833
https://api.github.com/repos/huggingface/datasets/issues/2318
MDEyOklzc3VlQ29tbWVudDgzMzMxNzgzMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/833317833/reactions
2021-05-06T08:00:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/833317833
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
awesome work @albertvillanova !
2021-05-06T08:45:45Z
https://github.com/huggingface/datasets/issues/2318#issuecomment-833349767
https://api.github.com/repos/huggingface/datasets/issues/2318
MDEyOklzc3VlQ29tbWVudDgzMzM0OTc2Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/833349767/reactions
2021-05-06T08:45:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/833349767
https://avatars.githubusercontent.com/u/4529381?v=4
https://api.github.com/users/richardliaw/events{/privacy}
https://api.github.com/users/richardliaw/followers
https://api.github.com/users/richardliaw/following{/other_user}
https://api.github.com/users/richardliaw/gists{/gist_id}
https://github.com/richardliaw
richardliaw
MDQ6VXNlcjQ1MjkzODE=
https://api.github.com/users/richardliaw/orgs
https://api.github.com/users/richardliaw/received_events
https://api.github.com/users/richardliaw/repos
https://api.github.com/users/richardliaw/starred{/owner}{/repo}
https://api.github.com/users/richardliaw/subscriptions
User
https://api.github.com/users/richardliaw
public
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is.

This is an awesome library. 

It seems like the dynamic module path in this library has broken some of hyperparameter tuning functionality: https://discuss.huggingface.co/t/using-hyperparameter-search-in-trainer/785/34

This is because Ray will spawn new processes, and each process will load modules by path. However, we need to explicitly inform Ray to load the right modules, or else it will error upon import. 

I'd like an API to obtain the dynamic paths. This will allow us to support this functionality in this awesome library while being future proof.

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

`datasets.get_dynamic_paths -> List[str]` will be sufficient for my use case.

By offering this API, we will be able to address the following issues (by patching the ray integration sufficiently):

https://github.com/huggingface/blog/issues/106
https://github.com/huggingface/transformers/issues/11565
https://discuss.huggingface.co/t/using-hyperparameter-search-in-trainer/785/34
https://discuss.huggingface.co/t/using-hyperparameter-search-in-trainer/785/35

