Add Stanford Sentiment Treebank (SST)
CONTRIBUTOR
Dataset added in release [1.5.0](https://github.com/huggingface/datasets/releases/tag/1.5.0), I think I can close this.
2021-03-18T17:51:44Z
https://github.com/huggingface/datasets/issues/1934#issuecomment-802161937
https://api.github.com/repos/huggingface/datasets/issues/1934
MDEyOklzc3VlQ29tbWVudDgwMjE2MTkzNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/802161937/reactions
2021-03-18T17:51:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/802161937
https://avatars.githubusercontent.com/u/15801338?v=4
https://api.github.com/users/patpizio/events{/privacy}
https://api.github.com/users/patpizio/followers
https://api.github.com/users/patpizio/following{/other_user}
https://api.github.com/users/patpizio/gists{/gist_id}
https://github.com/patpizio
patpizio
MDQ6VXNlcjE1ODAxMzM4
https://api.github.com/users/patpizio/orgs
https://api.github.com/users/patpizio/received_events
https://api.github.com/users/patpizio/repos
https://api.github.com/users/patpizio/starred{/owner}{/repo}
https://api.github.com/users/patpizio/subscriptions
User
https://api.github.com/users/patpizio
public
I am going to add SST:

- **Name:** The Stanford Sentiment Treebank
- **Description:** The first corpus with fully labeled parse trees that allows for a complete analysis of the compositional effects of sentiment in language
- **Paper:** [Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank](https://nlp.stanford.edu/~socherr/EMNLP2013_RNTN.pdf)
- **Data:** https://nlp.stanford.edu/sentiment/index.html
- **Motivation:** Already requested in #353, SST is a popular dataset for Sentiment Classification

What's the difference with the [_SST-2_](https://huggingface.co/datasets/viewer/?dataset=glue&config=sst2) dataset included in GLUE? Essentially, SST-2 is a version of SST where:
- the labels were mapped from real numbers in [0.0, 1.0] to a binary label: {0, 1}
- the labels of the *sub-sentences* were included only in the training set
- the labels in the test set are obfuscated

So there is a lot more information in the original SST. The tricky bit is, the data is scattered into many text files and, for one in particular, I couldn't find the original encoding ([*but I'm not the only one*](https://groups.google.com/g/word2vec-toolkit/c/QIUjLw6RqFk/m/_iEeyt428wkJ) 🎵). The only solution I found was to manually replace all the è, ë, ç and so on into an `utf-8` copy of the text file. I uploaded the result in my Dropbox and I am using that as the main repo for the dataset.

Also, the _sub-sentences_ are built at run-time from the information encoded in several text files, so generating the examples is a bit more cumbersome than usual. Luckily, the dataset is not enormous.

I plan to divide the dataset in 2 configs: one with just whole sentences with their labels, the other with sentences _and their sub-sentences_ with their labels. Each config will be split in train, validation and test. Hopefully this makes sense, we may discuss it in the PR I'm going to submit.



