Add modules cache
MEMBER
All the tests pass on my side. Not sure if it is a cache issue or a pytest issue or a circleci issue.
EDIT: I have the same error on google colab. Trying to fix that
2020-09-04T16:44:14Z
https://github.com/huggingface/datasets/pull/574#issuecomment-687262283
https://api.github.com/repos/huggingface/datasets/issues/574
MDEyOklzc3VlQ29tbWVudDY4NzI2MjI4Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/687262283/reactions
2020-09-04T16:50:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/687262283
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
I think I fixed it (sorry didn't notice you were on it as well)
2020-09-04T17:55:38Z
https://github.com/huggingface/datasets/pull/574#issuecomment-687296214
https://api.github.com/repos/huggingface/datasets/issues/574
MDEyOklzc3VlQ29tbWVudDY4NzI5NjIxNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/687296214/reactions
2020-09-04T17:55:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/687296214
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
As discusses in #554 , we should use a module cache directory outside of the python packages directory since we may not have write permissions.

I added a new HF_MODULES_PATH directory that is added to the python path when doing `import nlp`.
In this directory, a module `nlp_modules` is created so that datasets can be added to `nlp_modules.datasets` and metrics to `nlp_modules.metrics`. `nlp_modules` doesn't exist on Pypi.

If someone using cloudpickle still wants to have the downloaded dataset/metrics scripts to be inside the nlp directory, it is still possible to change the environment variable HF_MODULES_CACHE to be a path inside the nlp lib.