Set specific cache directories per test function call
MEMBER
@lhoestq, I think this reaches some memory limit on Linux instances... (?)
2021-04-21T10:10:16Z
https://github.com/huggingface/datasets/pull/2244#issuecomment-823945970
https://api.github.com/repos/huggingface/datasets/issues/2244
MDEyOklzc3VlQ29tbWVudDgyMzk0NTk3MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/823945970/reactions
2021-04-21T10:10:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/823945970
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
It looks like the `comet` metric test fails because it tries to load a model in memory.
In the tests I think we have `patch_comet` that mocks the model download + inference. Not sure why it didn't work though.
I can take a look tomorrow (this afternoon is the pytorch ecosystem day)
2021-04-21T10:18:07Z
https://github.com/huggingface/datasets/pull/2244#issuecomment-823950553
https://api.github.com/repos/huggingface/datasets/issues/2244
MDEyOklzc3VlQ29tbWVudDgyMzk1MDU1Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/823950553/reactions
2021-04-21T10:18:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/823950553
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
@lhoestq thanks for the hint: I'm going to have a look at that mock... ;)
2021-04-21T10:25:52Z
https://github.com/huggingface/datasets/pull/2244#issuecomment-823954896
https://api.github.com/repos/huggingface/datasets/issues/2244
MDEyOklzc3VlQ29tbWVudDgyMzk1NDg5Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/823954896/reactions
2021-04-28T11:04:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/823954896
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
@lhoestq finally I did not find out why the mock is not used... If you can give me some other hint tomorrow...
2021-04-21T15:43:16Z
https://github.com/huggingface/datasets/pull/2244#issuecomment-824164208
https://api.github.com/repos/huggingface/datasets/issues/2244
MDEyOklzc3VlQ29tbWVudDgyNDE2NDIwOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/824164208/reactions
2021-04-21T15:43:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/824164208
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
Implement specific cache directories (datasets, metrics and modules) per test function call.

Currently, the cache directories are set within the temporary test directory, but they are shared across all test function calls.

This PR implements specific cache directories for each test function call, so that tests are atomic and there are no side effects.

