Tasks alignment with models
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-03-30T16:55:20Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1083386002
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5AkyiS
https://api.github.com/repos/huggingface/datasets/issues/comments/1083386002/reactions
2022-04-08T12:27:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1083386002
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
Yay! This is exciting! Note that we would probably be able to generate this JSON directly from `huggingface/hub-docs`' `Types.ts` file (cc @osanseviero)
2022-03-30T18:32:54Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1083480219
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5AlJib
https://api.github.com/repos/huggingface/datasets/issues/comments/1083480219/reactions
2022-03-30T18:32:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1083480219
https://avatars.githubusercontent.com/u/326577?v=4
https://api.github.com/users/julien-c/events{/privacy}
https://api.github.com/users/julien-c/followers
https://api.github.com/users/julien-c/following{/other_user}
https://api.github.com/users/julien-c/gists{/gist_id}
https://github.com/julien-c
julien-c
MDQ6VXNlcjMyNjU3Nw==
https://api.github.com/users/julien-c/orgs
https://api.github.com/users/julien-c/received_events
https://api.github.com/users/julien-c/repos
https://api.github.com/users/julien-c/starred{/owner}{/repo}
https://api.github.com/users/julien-c/subscriptions
User
https://api.github.com/users/julien-c
public
CONTRIBUTOR
The following issue should make this much easier :smile: https://github.com/huggingface/hub-docs/issues/83
2022-03-30T20:32:13Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1083596683
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5All-L
https://api.github.com/repos/huggingface/datasets/issues/comments/1083596683/reactions
2022-03-30T20:32:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1083596683
https://avatars.githubusercontent.com/u/7246357?v=4
https://api.github.com/users/osanseviero/events{/privacy}
https://api.github.com/users/osanseviero/followers
https://api.github.com/users/osanseviero/following{/other_user}
https://api.github.com/users/osanseviero/gists{/gist_id}
https://github.com/osanseviero
osanseviero
MDQ6VXNlcjcyNDYzNTc=
https://api.github.com/users/osanseviero/orgs
https://api.github.com/users/osanseviero/received_events
https://api.github.com/users/osanseviero/repos
https://api.github.com/users/osanseviero/starred{/owner}{/repo}
https://api.github.com/users/osanseviero/subscriptions
User
https://api.github.com/users/osanseviero
public
MEMBER
So far I think I've addressed all the comments that I got on slack, but feel free to do a review @osanseviero and let me know if it sounds good to you
2022-04-01T15:18:48Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1086028753
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5Au3vR
https://api.github.com/repos/huggingface/datasets/issues/comments/1086028753/reactions
2022-04-01T15:18:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1086028753
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
It just occurred to me that we should probably restart the `datasets-tagging` space once this is merged to update all the task categories there: https://huggingface.co/spaces/huggingface/datasets-tagging
2022-04-05T12:52:08Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1088666227
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5A47pz
https://api.github.com/repos/huggingface/datasets/issues/comments/1088666227/reactions
2022-04-05T12:52:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1088666227
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
Yes, let me update it now
2022-04-05T12:55:57Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1088669920
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5A48jg
https://api.github.com/repos/huggingface/datasets/issues/comments/1088669920/reactions
2022-04-05T12:55:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1088669920
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Updated: https://huggingface.co/spaces/huggingface/datasets-tagging
2022-04-05T15:31:58Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1088874332
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5A5udc
https://api.github.com/repos/huggingface/datasets/issues/comments/1088874332/reactions
2022-04-05T15:31:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1088874332
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
current automated export is visible at #4154
2022-04-12T17:14:00Z
https://github.com/huggingface/datasets/pull/4066#issuecomment-1096986341
https://api.github.com/repos/huggingface/datasets/issues/4066
IC_kwDODunzps5BYq7l
https://api.github.com/repos/huggingface/datasets/issues/comments/1096986341/reactions
2022-04-12T17:14:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1096986341
https://avatars.githubusercontent.com/u/326577?v=4
https://api.github.com/users/julien-c/events{/privacy}
https://api.github.com/users/julien-c/followers
https://api.github.com/users/julien-c/following{/other_user}
https://api.github.com/users/julien-c/gists{/gist_id}
https://github.com/julien-c
julien-c
MDQ6VXNlcjMyNjU3Nw==
https://api.github.com/users/julien-c/orgs
https://api.github.com/users/julien-c/received_events
https://api.github.com/users/julien-c/repos
https://api.github.com/users/julien-c/starred{/owner}{/repo}
https://api.github.com/users/julien-c/subscriptions
User
https://api.github.com/users/julien-c
public
I updated our `tasks.json` file with the new task taxonomy that is aligned with models.

The rule that defines a task is the following:

**Two tasks are different if and only if the steps of their pipelines** are different, i.e. if they can’t reasonably be implemented using the same coherent code (level of granularity/complexity of the code to be defined - ideally I’d like to say “HF user’s level”) - this is the same definition in `transformers` 

I will update the tags of all the datasets in this repository [in another PR](https://github.com/huggingface/datasets/pull/4067) for readability.

Main changes:
- conditional-text-generation is split between summarization, translation, text-generation and text2text-generation
- speech-processing is split into automatic-speech-recognition, audio-classification, etc.
- structure-prediction is renamed token-classification
- abstractive-qa now belongs to text2text-generation

Here is just a simplified YAML dump of `tasks.json`:

```yaml
audio-classification:
- keyword-spotting
- speaker-identification
- speaker-intent-classification
- emotion-recognition
- speaker-language-identification
audio-to-audio: []
automatic-speech-recognition: []
conversational:
- dialogue-generation
feature-extraction: []
fill-mask:
- slot-filling
- masked-language-modeling
image-classification:
- multi-label-image-classification
- multi-class-image-classification
image-segmentation:
- instance-segmentation
- semantic-segmentation
- panoptic-segmentation
image-to-text:
- image-captioning
multiple-choice:
- multiple-choice-qa
- multiple-choice-coreference-resolution
object-detection:
- face-detection
- vehicle-detection
question-answering:
- extractive-qa
- open-domain-qa
- closed-domain-qa
sentence-similarity: []
tabular-classification: []
tabular-to-text:
- rdf-to-text
summarization:
- news-articles-summarization
- news-articles-headline-generation
table-to-text: []
table-question-answering: []
text-classification:
- acceptability-classification
- entity-linking-classification
- fact-checking
- intent-classification
- multi-class-classification
- multi-label-classification
- natural-language-inference
- semantic-similarity-classification
- sentiment-classification
- topic-classification
- semantic-similarity-scoring
- sentiment-scoring
- sentiment-analysis
- hate-speech-detection
- text-scoring
text-generation:
- dialogue-modeling
- language-modeling
text-retrieval:
- document-retrieval
- utterance-retrieval
- entity-linking-retrieval
- fact-checking-retrieval
text-to-image: []
text-to-tabular:
- relation-extraction
- semantic-role-labeling
text-to-speech: []
text2text-generation:
- text-simplification
- explanation-generation
- abstractive-qa
- open-domain-abstractive-qa
- closed-domain-qa
- open-book-qa
- closed-book-qa
time-series-forecasting:
- univariate-time-series-forecasting
- multivariate-time-series-forecasting
token-classification:
- named-entity-recognition
- part-of-speech-tagging
- parsing
- lemmatization
- word-sense-disambiguation
- coreference-resolution
translation: []
visual-question-answering: []
voice-activity-detection: []
zero-shot-classification: []
zero-shot-image-classification: []
reinforcement-learning: []
other: []
```

Feel free to comment and give suggestions, especially if you think we can also align this list with other projects

cc @julien-c @osanseviero @severo @lewtun @yjernite @albertvillanova @mariosasko @polinaeterna 