Dataset Error: DaNE contains empty samples at the end
MEMBER
Thanks for reporting, I opened a PR to fix that
2021-01-05T13:30:09Z
https://github.com/huggingface/datasets/issues/1686#issuecomment-754637072
https://api.github.com/repos/huggingface/datasets/issues/1686
MDEyOklzc3VlQ29tbWVudDc1NDYzNzA3Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/754637072/reactions
2021-01-05T13:30:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/754637072
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
One the PR is merged the fix will be available in the next release of `datasets`.

If you don't want to wait the next release you can still load the script from the master branch with

```python
load_dataset("dane", script_version="master")
```
2021-01-05T14:00:04Z
https://github.com/huggingface/datasets/issues/1686#issuecomment-754652868
https://api.github.com/repos/huggingface/datasets/issues/1686
MDEyOklzc3VlQ29tbWVudDc1NDY1Mjg2OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/754652868/reactions
2021-01-05T14:00:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/754652868
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
If you have other questions feel free to reopen :) 
2021-01-05T14:01:09Z
https://github.com/huggingface/datasets/issues/1686#issuecomment-754653454
https://api.github.com/repos/huggingface/datasets/issues/1686
MDEyOklzc3VlQ29tbWVudDc1NDY1MzQ1NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/754653454/reactions
2021-01-05T14:01:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/754653454
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
The dataset DaNE, contains empty samples at the end. It is naturally easy to remove using a filter but should probably not be there, to begin with as it can cause errors.

```python
>>> import datasets
[...]
>>> dataset = datasets.load_dataset("dane")
[...]
>>> dataset["test"][-1]
{'dep_ids': [], 'dep_labels': [], 'lemmas': [], 'morph_tags': [], 'ner_tags': [], 'pos_tags': [], 'sent_id': '', 'text': '', 'tok_ids': [], 'tokens': []}
>>> dataset["train"][-1]
{'dep_ids': [], 'dep_labels': [], 'lemmas': [], 'morph_tags': [], 'ner_tags': [], 'pos_tags': [], 'sent_id': '', 'text': '', 'tok_ids': [], 'tokens': []}
```

Best,
Kenneth