Make DownloadManager downloaded/extracted paths accessible
MEMBER
First I was thinking of the dict, which makes sense for .download, mapping URL to downloaded path. However does this make sense for .extract, mapping the downloaded path to the extracted path? I ask this because the user did not chose the downloaded path, so this is completely unknown for them...
2021-02-15T12:19:41Z
https://github.com/huggingface/datasets/pull/1846#issuecomment-779186846
https://api.github.com/repos/huggingface/datasets/issues/1846
MDEyOklzc3VlQ29tbWVudDc3OTE4Njg0Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/779186846/reactions
2021-02-15T12:19:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/779186846
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
There could be several situations:
- download a file with no extraction
- download a file and extract it
- download a file, extract it and then inside the output folder extract some more files
- extract a local file (for datasets with data that are manually downloaded for example)
- extract a local file, and then inside the output folder extract some more files

So I think it's ok to have `downloaded_paths` as a dict url -> downloaded_path and `extracted_paths` as a dict local_path -> extracted_path.
2021-02-15T13:29:26Z
https://github.com/huggingface/datasets/pull/1846#issuecomment-779224896
https://api.github.com/repos/huggingface/datasets/issues/1846
MDEyOklzc3VlQ29tbWVudDc3OTIyNDg5Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/779224896/reactions
2021-02-15T13:29:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/779224896
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
OK. I am refactoring this. I have opened #1879, as an intermediate step...
2021-02-15T13:48:30Z
https://github.com/huggingface/datasets/pull/1846#issuecomment-779235436
https://api.github.com/repos/huggingface/datasets/issues/1846
MDEyOklzc3VlQ29tbWVudDc3OTIzNTQzNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/779235436/reactions
2021-02-15T13:49:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/779235436
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
Make accessible the file paths downloaded/extracted by DownloadManager.

Close #1831.

The approach:
- I set these paths as DownloadManager attributes: these are DownloadManager's concerns
- To access to these from DatasetBuilder, I set the DownloadManager instance as DatasetBuilder attribute: object composition