Introduce web and wiki config in triviaqa dataset
MEMBER
I just made the dummy data smaller :)
Once github refreshes the change I think we can merge !
2021-10-01T12:42:45Z
https://github.com/huggingface/datasets/pull/2949#issuecomment-932193236
https://api.github.com/repos/huggingface/datasets/issues/2949
IC_kwDODunzps43kCPU
https://api.github.com/repos/huggingface/datasets/issues/comments/932193236/reactions
2021-10-01T12:42:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/932193236
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Thank you so much for reviewing and accepting my pull request!! :)

I created these rather large dummy data sets to cover all different cases for the row structure. E.g. in the web configuration, it's possible that a row has evidence from wikipedia ("EntityPages") and the web ("SearchResults"). But it also might happen that either EntityPages or SearchResults is empty. Probably, I will add this thought to the dataset description in the future.
2021-10-02T17:17:06Z
https://github.com/huggingface/datasets/pull/2949#issuecomment-932786857
https://api.github.com/repos/huggingface/datasets/issues/2949
IC_kwDODunzps43mTKp
https://api.github.com/repos/huggingface/datasets/issues/comments/932786857/reactions
2021-10-02T17:17:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/932786857
https://avatars.githubusercontent.com/u/1706443?v=4
https://api.github.com/users/shirte/events{/privacy}
https://api.github.com/users/shirte/followers
https://api.github.com/users/shirte/following{/other_user}
https://api.github.com/users/shirte/gists{/gist_id}
https://github.com/shirte
shirte
MDQ6VXNlcjE3MDY0NDM=
https://api.github.com/users/shirte/orgs
https://api.github.com/users/shirte/received_events
https://api.github.com/users/shirte/repos
https://api.github.com/users/shirte/starred{/owner}{/repo}
https://api.github.com/users/shirte/subscriptions
User
https://api.github.com/users/shirte
public
MEMBER
Ok I see ! Yes feel free to mention it in the dataset card, this can be useful.

For the dummy data though we can keep the small ones, as the tests are mainly about testing the parsing from the dataset script rather than the actual content of the dataset.
2021-10-05T13:20:52Z
https://github.com/huggingface/datasets/pull/2949#issuecomment-934408667
https://api.github.com/repos/huggingface/datasets/issues/2949
IC_kwDODunzps43sfHb
https://api.github.com/repos/huggingface/datasets/issues/comments/934408667/reactions
2021-10-05T13:20:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/934408667
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
The TriviaQA paper suggests that the two subsets (Wikipedia and Web)
should be treated differently. There are also different leaderboards
for the two sets on CodaLab. For that reason, introduce additional
builder configs in the trivia_qa dataset.