Add per type scores in seqeval metric
CONTRIBUTOR
LGTM :-) Some small suggestions to shorten the code a bit :-) 
2020-05-14T09:50:54Z
https://github.com/huggingface/datasets/pull/100#issuecomment-628526106
https://api.github.com/repos/huggingface/datasets/issues/100
MDEyOklzc3VlQ29tbWVudDYyODUyNjEwNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/628526106/reactions
2020-05-14T09:54:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/628526106
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
MEMBER
Can you put the kwargs as normal kwargs instead of a dict? (And add them to the kwargs description As well)
2020-05-14T10:26:36Z
https://github.com/huggingface/datasets/pull/100#issuecomment-628542928
https://api.github.com/repos/huggingface/datasets/issues/100
MDEyOklzc3VlQ29tbWVudDYyODU0MjkyOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/628542928/reactions
2020-05-14T10:26:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/628542928
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
CONTRIBUTOR
@thom Is-it what you meant?
2020-05-14T10:38:49Z
https://github.com/huggingface/datasets/pull/100#issuecomment-628548823
https://api.github.com/repos/huggingface/datasets/issues/100
MDEyOklzc3VlQ29tbWVudDYyODU0ODgyMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/628548823/reactions
2020-05-14T10:38:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/628548823
https://avatars.githubusercontent.com/u/959590?v=4
https://api.github.com/users/jplu/events{/privacy}
https://api.github.com/users/jplu/followers
https://api.github.com/users/jplu/following{/other_user}
https://api.github.com/users/jplu/gists{/gist_id}
https://github.com/jplu
jplu
MDQ6VXNlcjk1OTU5MA==
https://api.github.com/users/jplu/orgs
https://api.github.com/users/jplu/received_events
https://api.github.com/users/jplu/repos
https://api.github.com/users/jplu/starred{/owner}{/repo}
https://api.github.com/users/jplu/subscriptions
User
https://api.github.com/users/jplu
public
MEMBER
Yes and there is a dynamically generated doc string in the metric script KWARGS DESCRIPTION
2020-05-14T11:14:29Z
https://github.com/huggingface/datasets/pull/100#issuecomment-628565107
https://api.github.com/repos/huggingface/datasets/issues/100
MDEyOklzc3VlQ29tbWVudDYyODU2NTEwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/628565107/reactions
2020-05-14T11:14:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/628565107
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
This PR add a bit more detail in the seqeval metric. Now the usage and output are:

```python
import nlp
met = nlp.load_metric('metrics/seqeval')
references = [['O', 'O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]
predictions =  [['O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]
met.compute(predictions, references)

#Output: {'PER': {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1}, 'MISC': {'precision': 0.0, 'recall': 0.0, 'f1': 0, 'number': 1}, 'overall_precision': 0.5, 'overall_recall': 0.5, 'overall_f1': 0.5, 'overall_accuracy': 0.8}
```

It is also possible to compute scores for non IOB notations, POS tagging for example hasn't this kind of notation. Add `suffix` parameter:

```python
import nlp
met = nlp.load_metric('metrics/seqeval')
references = [['O', 'O', 'O', 'MISC', 'MISC', 'MISC', 'O'], ['PER', 'PER', 'O']]
predictions =  [['O', 'O', 'MISC', 'MISC', 'MISC', 'MISC', 'O'], ['PER', 'PER', 'O']]
met.compute(predictions, references, metrics_kwargs={"suffix": True})

#Output: {'PER': {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 1}, 'MISC': {'precision': 0.0, 'recall': 0.0, 'f1': 0, 'number': 1}, 'overall_precision': 0.5, 'overall_recall': 0.5, 'overall_f1': 0.5, 'overall_accuracy': 0.9}
```