Broken Link to PubMed Abstracts dataset .
COLLABORATOR
This has already been reported in the HF Course repo (https://github.com/huggingface/course/issues/623).
2023-10-02T15:34:56Z
https://github.com/huggingface/datasets/issues/6273#issuecomment-1743246671
https://api.github.com/repos/huggingface/datasets/issues/6273
IC_kwDODunzps5n59VP
https://api.github.com/repos/huggingface/datasets/issues/comments/1743246671/reactions
2023-10-02T15:34:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1743246671
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
COLLABORATOR
@lhoestq @albertvillanova @lewtun I don't think we are allowed to host these data files on the Hub (due to DMCA), which means the only option is to use a different dataset in the course (and to re-record the video 🙂), no?
2023-10-02T15:40:48Z
https://github.com/huggingface/datasets/issues/6273#issuecomment-1743256433
https://api.github.com/repos/huggingface/datasets/issues/6273
IC_kwDODunzps5n5_tx
https://api.github.com/repos/huggingface/datasets/issues/comments/1743256433/reactions
2023-10-02T15:41:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1743256433
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
MEMBER
Keeping the video is maybe fine, we can add a note on youtube to suggest to load a dataset with a different name. Maybe C4 ? And update the code snippets on the website ?
2023-10-02T16:39:59Z
https://github.com/huggingface/datasets/issues/6273#issuecomment-1743354552
https://api.github.com/repos/huggingface/datasets/issues/6273
IC_kwDODunzps5n6Xq4
https://api.github.com/repos/huggingface/datasets/issues/comments/1743354552/reactions
2023-10-02T16:40:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1743354552
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Maybe you want to try it with the PUBMED dataset that I reproduced based on the The [PubMed Abstract GitHub Site](http://github.com/thoppe/The-Pile-PubMed) and uploaded on the HuggingFace:

```
from datasets import load_dataset
pubmed_dataset = load_dataset("hwang2006/PUBMED_title_abstracts_2020_baseline")
pubmed_dataset

#Downloading data: 100%
#7.98G/7.98G [11:47<00:00, 9.68MB/s]
#Generating train split: 17722096/0 [00:36<00:00, 505376.37 examples/s]

#DatasetDict({
#   train: Dataset({
#        features: ['meta', 'text'],
#        num_rows: 17722096
#    })
#})
```
2024-01-08T11:06:02Z
https://github.com/huggingface/datasets/issues/6273#issuecomment-1880793260
https://api.github.com/repos/huggingface/datasets/issues/6273
IC_kwDODunzps5wGqCs
https://api.github.com/repos/huggingface/datasets/issues/comments/1880793260/reactions
2024-01-09T05:48:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1880793260
https://avatars.githubusercontent.com/u/5524674?v=4
https://api.github.com/users/qualis2006/events{/privacy}
https://api.github.com/users/qualis2006/followers
https://api.github.com/users/qualis2006/following{/other_user}
https://api.github.com/users/qualis2006/gists{/gist_id}
https://github.com/qualis2006
qualis2006
MDQ6VXNlcjU1MjQ2NzQ=
https://api.github.com/users/qualis2006/orgs
https://api.github.com/users/qualis2006/received_events
https://api.github.com/users/qualis2006/repos
https://api.github.com/users/qualis2006/starred{/owner}{/repo}
https://api.github.com/users/qualis2006/subscriptions
User
https://api.github.com/users/qualis2006
public
NONE
孔令涛说感谢感谢
2024-04-28T02:30:41Z
https://github.com/huggingface/datasets/issues/6273#issuecomment-2081296938
https://api.github.com/repos/huggingface/datasets/issues/6273
IC_kwDODunzps58DhIq
https://api.github.com/repos/huggingface/datasets/issues/comments/2081296938/reactions
2024-04-28T02:30:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2081296938
https://avatars.githubusercontent.com/u/53045017?v=4
https://api.github.com/users/dosomethingbyme/events{/privacy}
https://api.github.com/users/dosomethingbyme/followers
https://api.github.com/users/dosomethingbyme/following{/other_user}
https://api.github.com/users/dosomethingbyme/gists{/gist_id}
https://github.com/dosomethingbyme
dosomethingbyme
MDQ6VXNlcjUzMDQ1MDE3
https://api.github.com/users/dosomethingbyme/orgs
https://api.github.com/users/dosomethingbyme/received_events
https://api.github.com/users/dosomethingbyme/repos
https://api.github.com/users/dosomethingbyme/starred{/owner}{/repo}
https://api.github.com/users/dosomethingbyme/subscriptions
User
https://api.github.com/users/dosomethingbyme
public
### Describe the bug

The link provided for the dataset is broken,
data_files = 
[https://the-eye.eu/public/AI/pile_preliminary_components/PUBMED_title_abstracts_2019_baseline.jsonl.zst](url)

The 

### Steps to reproduce the bug

Steps to reproduce:

1) Head over to [https://huggingface.co/learn/nlp-course/chapter5/4?fw=pt#big-data-datasets-to-the-rescue](url)

2) In the Section  "What is the Pile?", you can see a code snippet that contains the broken link.

### Expected behavior

The link should Redirect to the  "PubMed Abstracts dataset" as expected .

### Environment info

.