Why the `conll2003` dataset on huggingface only contains the `en` subset? Where is the  German data?
MEMBER
Thanks for reporting @beyondguo.

Indeed, we generate this dataset from this raw data file URL: https://data.deepai.org/conll2003.zip
And that URL only contains the English version.
2022-04-28T16:55:14Z
https://github.com/huggingface/datasets/issues/4230#issuecomment-1112441331
https://api.github.com/repos/huggingface/datasets/issues/4230
IC_kwDODunzps5CToHz
https://api.github.com/repos/huggingface/datasets/issues/comments/1112441331/reactions
2022-04-28T16:55:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1112441331
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
The German data requires payment

The [original task page](https://www.clips.uantwerpen.be/conll2003/ner/) states "The German data is a collection of articles from the Frankfurter Rundschau. The named entities have been annotated by people of the University of Antwerp. Only the annotations are available here. In order to build these data sets you need access to the ECI Multilingual Text Corpus. It can be ordered from the Linguistic Data Consortium (2003 non-member price: US$ 35.00)."

Inflation since 2003 has also affected LDC's prices, and today the dataset [LDC94T5](https://catalog.ldc.upenn.edu/LDC94T5) is available under license for $75 a copy. The [license](https://catalog.ldc.upenn.edu/license/eci-slash-mci-user-agreement.pdf) includes a non-distribution condition, which is probably why the data has not turned up openly.

The ACL hold copyright of this data; I'll mail them and anyone I can find at ECI to see if they'll open this up now. After all, it worked with Microsoft 3DMM, why not here too, after 28 years? :)

2022-05-12T11:37:06Z
https://github.com/huggingface/datasets/issues/4230#issuecomment-1124884827
https://api.github.com/repos/huggingface/datasets/issues/4230
IC_kwDODunzps5DDGFb
https://api.github.com/repos/huggingface/datasets/issues/comments/1124884827/reactions
2022-05-12T12:23:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1124884827
https://avatars.githubusercontent.com/u/121934?v=4
https://api.github.com/users/leondz/events{/privacy}
https://api.github.com/users/leondz/followers
https://api.github.com/users/leondz/following{/other_user}
https://api.github.com/users/leondz/gists{/gist_id}
https://github.com/leondz
leondz
MDQ6VXNlcjEyMTkzNA==
https://api.github.com/users/leondz/orgs
https://api.github.com/users/leondz/received_events
https://api.github.com/users/leondz/repos
https://api.github.com/users/leondz/starred{/owner}{/repo}
https://api.github.com/users/leondz/subscriptions
User
https://api.github.com/users/leondz
public
COLLABORATOR
Closing this issue as we are not allowed to share publicly the German subset.
2023-07-25T15:10:15Z
https://github.com/huggingface/datasets/issues/4230#issuecomment-1650028751
https://api.github.com/repos/huggingface/datasets/issues/4230
IC_kwDODunzps5iWXDP
https://api.github.com/repos/huggingface/datasets/issues/comments/1650028751/reactions
2023-07-25T15:10:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1650028751
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
![image](https://user-images.githubusercontent.com/37113676/165416606-96b5db18-b16c-4b6b-928c-de8620fd943e.png)

But on huggingface datasets:
![image](https://user-images.githubusercontent.com/37113676/165416649-8fd77980-ca0d-43f0-935e-f398ba8323a4.png)

Where is the  German data?