Does both 'bookcorpus' and 'wikipedia' belong to the same datasets which Google used for pretraining BERT?
MEMBER
No they are other similar copies but they are not provided by the official Bert models authors.
2020-09-25T12:03:21Z
https://github.com/huggingface/datasets/issues/666#issuecomment-698890335
https://api.github.com/repos/huggingface/datasets/issues/666
MDEyOklzc3VlQ29tbWVudDY5ODg5MDMzNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/698890335/reactions
2020-09-25T12:03:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/698890335
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public