SNLI dataset contains labels with value -1
CONTRIBUTOR
I believe the `-1` label is used for missing/NULL data as per HuggingFace Dataset conventions. If I recall correctly SNLI has some entries with no (gold) labels in the dataset.
2020-12-10T17:09:14Z
https://github.com/huggingface/datasets/issues/1452#issuecomment-742659098
https://api.github.com/repos/huggingface/datasets/issues/1452
MDEyOklzc3VlQ29tbWVudDc0MjY1OTA5OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/742659098/reactions
2020-12-10T17:09:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742659098
https://avatars.githubusercontent.com/u/50873201?v=4
https://api.github.com/users/vineeths96/events{/privacy}
https://api.github.com/users/vineeths96/followers
https://api.github.com/users/vineeths96/following{/other_user}
https://api.github.com/users/vineeths96/gists{/gist_id}
https://github.com/vineeths96
vineeths96
MDQ6VXNlcjUwODczMjAx
https://api.github.com/users/vineeths96/orgs
https://api.github.com/users/vineeths96/received_events
https://api.github.com/users/vineeths96/repos
https://api.github.com/users/vineeths96/starred{/owner}{/repo}
https://api.github.com/users/vineeths96/subscriptions
User
https://api.github.com/users/vineeths96
public
NONE
Ah, you're right. The dataset has some pairs with missing labels. Thanks for reminding me.
2020-12-10T17:49:55Z
https://github.com/huggingface/datasets/issues/1452#issuecomment-742684511
https://api.github.com/repos/huggingface/datasets/issues/1452
MDEyOklzc3VlQ29tbWVudDc0MjY4NDUxMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/742684511/reactions
2020-12-10T17:49:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/742684511
https://avatars.githubusercontent.com/u/11405654?v=4
https://api.github.com/users/aarnetalman/events{/privacy}
https://api.github.com/users/aarnetalman/followers
https://api.github.com/users/aarnetalman/following{/other_user}
https://api.github.com/users/aarnetalman/gists{/gist_id}
https://github.com/aarnetalman
aarnetalman
MDQ6VXNlcjExNDA1NjU0
https://api.github.com/users/aarnetalman/orgs
https://api.github.com/users/aarnetalman/received_events
https://api.github.com/users/aarnetalman/repos
https://api.github.com/users/aarnetalman/starred{/owner}{/repo}
https://api.github.com/users/aarnetalman/subscriptions
User
https://api.github.com/users/aarnetalman
public
```
import datasets
nli_data = datasets.load_dataset("snli")
train_data = nli_data['train']
train_labels = train_data['label']
label_set = set(train_labels)
print(label_set)
```

**Output:**
`{0, 1, 2, -1}`