Fix/start token mask issue and update documentation
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-04-29T22:54:39Z
https://github.com/huggingface/datasets/pull/4258#issuecomment-1113848861
https://api.github.com/repos/huggingface/datasets/issues/4258
IC_kwDODunzps5CY_wd
https://api.github.com/repos/huggingface/datasets/issues/comments/1113848861/reactions
2022-05-02T16:33:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1113848861
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
> Good catch ! Thanks :)
> 
> Next time can you describe your fix in the Pull Request description please ?

Thanks. Also whoops, sorry about not being very descriptive. I updated the pull request description, and will keep this in mind for future PRs.
2022-05-02T16:25:52Z
https://github.com/huggingface/datasets/pull/4258#issuecomment-1115092587
https://api.github.com/repos/huggingface/datasets/issues/4258
IC_kwDODunzps5CdvZr
https://api.github.com/repos/huggingface/datasets/issues/comments/1115092587/reactions
2022-05-02T16:25:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1115092587
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
This pr fixes a couple bugs:

1) the perplexity was calculated with a 0 in the attention mask for the start token, which was causing high perplexity scores that were not correct
2) the documentation was not updated