Add wiki dpr multiset embeddings
MEMBER
I still have to compute the dataset_infos, and build + host the indexes
2020-10-30T16:06:09Z
https://github.com/huggingface/datasets/pull/739#issuecomment-719643182
https://api.github.com/repos/huggingface/datasets/issues/739
MDEyOklzc3VlQ29tbWVudDcxOTY0MzE4Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/719643182/reactions
2020-10-30T16:06:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/719643182
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
update: I'm computing the metadata, will update the PR soon
2020-11-16T17:07:23Z
https://github.com/huggingface/datasets/pull/739#issuecomment-728196514
https://api.github.com/repos/huggingface/datasets/issues/739
MDEyOklzc3VlQ29tbWVudDcyODE5NjUxNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/728196514/reactions
2020-11-16T17:07:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/728196514
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Finally all green and ready to merge :)
2020-11-25T17:43:23Z
https://github.com/huggingface/datasets/pull/739#issuecomment-733854134
https://api.github.com/repos/huggingface/datasets/issues/739
MDEyOklzc3VlQ29tbWVudDczMzg1NDEzNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/733854134/reactions
2020-11-25T17:43:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/733854134
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
There are two DPR encoders, one trained on Natural Questions and one trained on a multiset/hybrid dataset.
Previously only the embeddings from the encoder trained on NQ were available. I'm adding the ones from the encoder trained on the multiset/hybrid dataset.
In the configuration you can now specify `embeddings_name="nq"` or `embeddings_name="multiset"`