Cannot load TREC dataset: ConnectionError
MEMBER
Hi ! Indeed there's an issue with those links.
We should probably use the target urls of the redirections instead
2020-11-09T09:05:50Z
https://github.com/huggingface/datasets/issues/798#issuecomment-723874281
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyMzg3NDI4MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/723874281/reactions
2020-11-09T09:05:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/723874281
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Hi, the same issue here, could you tell me how to download it through datasets? thanks 
2020-11-13T17:52:35Z
https://github.com/huggingface/datasets/issues/798#issuecomment-726916965
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyNjkxNjk2NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/726916965/reactions
2020-11-13T17:52:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/726916965
https://avatars.githubusercontent.com/u/6278280?v=4
https://api.github.com/users/rabeehk/events{/privacy}
https://api.github.com/users/rabeehk/followers
https://api.github.com/users/rabeehk/following{/other_user}
https://api.github.com/users/rabeehk/gists{/gist_id}
https://github.com/rabeehk
rabeehk
MDQ6VXNlcjYyNzgyODA=
https://api.github.com/users/rabeehk/orgs
https://api.github.com/users/rabeehk/received_events
https://api.github.com/users/rabeehk/repos
https://api.github.com/users/rabeehk/starred{/owner}{/repo}
https://api.github.com/users/rabeehk/subscriptions
User
https://api.github.com/users/rabeehk
public
NONE
Same issue. 
2020-11-15T11:49:37Z
https://github.com/huggingface/datasets/issues/798#issuecomment-727557461
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyNzU1NzQ2MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/727557461/reactions
2020-11-15T11:49:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/727557461
https://avatars.githubusercontent.com/u/7473094?v=4
https://api.github.com/users/AliKarimi74/events{/privacy}
https://api.github.com/users/AliKarimi74/followers
https://api.github.com/users/AliKarimi74/following{/other_user}
https://api.github.com/users/AliKarimi74/gists{/gist_id}
https://github.com/AliKarimi74
AliKarimi74
MDQ6VXNlcjc0NzMwOTQ=
https://api.github.com/users/AliKarimi74/orgs
https://api.github.com/users/AliKarimi74/received_events
https://api.github.com/users/AliKarimi74/repos
https://api.github.com/users/AliKarimi74/starred{/owner}{/repo}
https://api.github.com/users/AliKarimi74/subscriptions
User
https://api.github.com/users/AliKarimi74
public
MEMBER
Actually it's already fixed on the master branch since #740 
I'll do the 1.1.3 release soon
2020-11-16T09:29:18Z
https://github.com/huggingface/datasets/issues/798#issuecomment-727854736
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyNzg1NDczNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/727854736/reactions
2020-11-16T09:29:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/727854736
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Hi
thanks, but I did tried to install from the pip install git+... and it does
not work for me,. thanks for the help. I have the same issue with wmt16,
"ro-en"
thanks.
Best
Rabeeh

On Mon, Nov 16, 2020 at 10:29 AM Quentin Lhoest <notifications@github.com>
wrote:

> Actually it's already fixed on the master branch since #740
> <https://github.com/huggingface/datasets/pull/740>
> I'll do the 1.1.3 release soon
>
> —
> You are receiving this because you commented.
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/798#issuecomment-727854736>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ABP4ZCEUBJKPOCLABXCKMPDSQDWH3ANCNFSM4TJBUKSA>
> .
>

2020-11-16T10:12:19Z
https://github.com/huggingface/datasets/issues/798#issuecomment-727879255
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyNzg3OTI1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/727879255/reactions
2020-11-16T10:12:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/727879255
https://avatars.githubusercontent.com/u/6278280?v=4
https://api.github.com/users/rabeehk/events{/privacy}
https://api.github.com/users/rabeehk/followers
https://api.github.com/users/rabeehk/following{/other_user}
https://api.github.com/users/rabeehk/gists{/gist_id}
https://github.com/rabeehk
rabeehk
MDQ6VXNlcjYyNzgyODA=
https://api.github.com/users/rabeehk/orgs
https://api.github.com/users/rabeehk/received_events
https://api.github.com/users/rabeehk/repos
https://api.github.com/users/rabeehk/starred{/owner}{/repo}
https://api.github.com/users/rabeehk/subscriptions
User
https://api.github.com/users/rabeehk
public
MEMBER
I just tested on google colab using
```python
!pip install git+https://github.com/huggingface/datasets.git
from datasets import load_dataset
load_dataset("trec")
```
and it works.
Can you detail how you got the issue even when using the latest version on master ?

Also about wmt we'll look into it, thanks for reporting !
2020-11-16T10:18:25Z
https://github.com/huggingface/datasets/issues/798#issuecomment-727882849
https://api.github.com/repos/huggingface/datasets/issues/798
MDEyOklzc3VlQ29tbWVudDcyNzg4Mjg0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/727882849/reactions
2020-11-16T10:18:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/727882849
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
I think the new url with .edu is also broken:
```
ConnectionError: Couldn't reach https://cogcomp.seas.upenn.edu/Data/QA/QC/train_5500.label
```
Cant download the dataset anymore.
2021-11-18T16:50:24Z
https://github.com/huggingface/datasets/issues/798#issuecomment-973050459
https://api.github.com/repos/huggingface/datasets/issues/798
IC_kwDODunzps45_5Jb
https://api.github.com/repos/huggingface/datasets/issues/comments/973050459/reactions
2021-11-18T16:50:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/973050459
https://avatars.githubusercontent.com/u/8525537?v=4
https://api.github.com/users/unre4l/events{/privacy}
https://api.github.com/users/unre4l/followers
https://api.github.com/users/unre4l/following{/other_user}
https://api.github.com/users/unre4l/gists{/gist_id}
https://github.com/unre4l
unre4l
MDQ6VXNlcjg1MjU1Mzc=
https://api.github.com/users/unre4l/orgs
https://api.github.com/users/unre4l/received_events
https://api.github.com/users/unre4l/repos
https://api.github.com/users/unre4l/starred{/owner}{/repo}
https://api.github.com/users/unre4l/subscriptions
User
https://api.github.com/users/unre4l
public
MEMBER
Hi ! The URL seems to work fine on my side, can you try again ?
2021-11-19T11:43:32Z
https://github.com/huggingface/datasets/issues/798#issuecomment-974000979
https://api.github.com/repos/huggingface/datasets/issues/798
IC_kwDODunzps46DhNT
https://api.github.com/repos/huggingface/datasets/issues/comments/974000979/reactions
2021-11-19T11:43:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/974000979
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Forgot to update, i wrote an email to the webmaster of seas.upenn.edu because i couldnt reach the url on any machine. This was the answer:
```
Thank you for your report. The server was offline for maintenance and is now available again.
```
Guess all back to normal now 🙂 
2021-11-19T11:47:52Z
https://github.com/huggingface/datasets/issues/798#issuecomment-974003387
https://api.github.com/repos/huggingface/datasets/issues/798
IC_kwDODunzps46Dhy7
https://api.github.com/repos/huggingface/datasets/issues/comments/974003387/reactions
2021-11-19T11:47:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/974003387
https://avatars.githubusercontent.com/u/8525537?v=4
https://api.github.com/users/unre4l/events{/privacy}
https://api.github.com/users/unre4l/followers
https://api.github.com/users/unre4l/following{/other_user}
https://api.github.com/users/unre4l/gists{/gist_id}
https://github.com/unre4l
unre4l
MDQ6VXNlcjg1MjU1Mzc=
https://api.github.com/users/unre4l/orgs
https://api.github.com/users/unre4l/received_events
https://api.github.com/users/unre4l/repos
https://api.github.com/users/unre4l/starred{/owner}{/repo}
https://api.github.com/users/unre4l/subscriptions
User
https://api.github.com/users/unre4l
public
## Problem
I cannot load "trec" dataset, it results with ConnectionError as shown below. I've tried on both Google Colab and locally. 
* `requests.head('http://cogcomp.org/Data/QA/QC/train_5500.label')` returns <Response [302]>. 
* `requests.head('http://cogcomp.org/Data/QA/QC/train_5500.label', allow_redirects=True)` raises `requests.exceptions.TooManyRedirects: Exceeded 30 redirects.`
* Opening `http://cogcomp.org/Data/QA/QC/train_5500.label' in a browser works, but opens a different address
* Increasing max_redirects to 100 doesn't help

Also, while debugging I've seen that requesting 'https://storage.googleapis.com/huggingface-nlp/cache/datasets/trec/default/1.1.0/dataset_info.json' returns <Response [404]> before, but it doesn't raise any errors. Not sure if that's relevant.

* datasets.__version__ == '1.1.2'
* requests.__version__ == '2.24.0'

## Error trace
```
>>> import datasets
>>> datasets.__version__
'1.1.2'
>>> dataset = load_dataset("trec", split="train")
Using custom data configuration default
Downloading and preparing dataset trec/default (download: 350.79 KiB, generated: 403.39 KiB, post-processed: Unknown size, total: 754.18 KiB) to /home/przemyslaw/.cache/huggingface/datasets/trec/default/1.1.0/ca4248481ad244f235f4cf277186cad2ee8769f975119a2bbfc41b8932b88bd7...
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/load.py", line 611, in load_dataset
    ignore_verifications=ignore_verifications,
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/builder.py", line 476, in download_and_prepare
    dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/builder.py", line 531, in _download_and_prepare
    split_generators = self._split_generators(dl_manager, **split_generators_kwargs)
  File "/home/przemyslaw/.cache/huggingface/modules/datasets_modules/datasets/trec/ca4248481ad244f235f4cf277186cad2ee8769f975119a2bbfc41b8932b88bd7/trec.py", line 140, in _split_generators
    dl_files = dl_manager.download_and_extract(_URLs)
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/download_manager.py", line 254, in download_and_extract
    return self.extract(self.download(url_or_urls))
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/download_manager.py", line 179, in download
    num_proc=download_config.num_proc,
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/py_utils.py", line 225, in map_nested
    _single_map_nested((function, obj, types, None, True)) for obj in tqdm(iterable, disable=disable_tqdm)
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/py_utils.py", line 225, in <listcomp>
    _single_map_nested((function, obj, types, None, True)) for obj in tqdm(iterable, disable=disable_tqdm)
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/py_utils.py", line 163, in _single_map_nested
    return function(data_struct)
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/file_utils.py", line 308, in cached_path
    use_etag=download_config.use_etag,
  File "/home/przemyslaw/.local/lib/python3.6/site-packages/datasets/utils/file_utils.py", line 475, in get_from_cache
    raise ConnectionError("Couldn't reach {}".format(url))
ConnectionError: Couldn't reach http://cogcomp.org/Data/QA/QC/train_5500.label
```

I would appreciate some suggestions here. 