Integrate Milvus (pymilvus) library
NONE
Hi @mariosasko，Just search randomly and I found this issue~ I'm the tech lead of Milvus and we are looking forward to integrate milvus together with huggingface datasets.

Any suggestion on how we could start?

2022-02-27T14:30:21Z
https://github.com/huggingface/datasets/issues/3558#issuecomment-1053572878
https://api.github.com/repos/huggingface/datasets/issues/3558
IC_kwDODunzps4-zD8O
https://api.github.com/repos/huggingface/datasets/issues/comments/1053572878/reactions
2022-02-27T14:30:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1053572878
https://avatars.githubusercontent.com/u/83447078?v=4
https://api.github.com/users/xiaofan-luan/events{/privacy}
https://api.github.com/users/xiaofan-luan/followers
https://api.github.com/users/xiaofan-luan/following{/other_user}
https://api.github.com/users/xiaofan-luan/gists{/gist_id}
https://github.com/xiaofan-luan
xiaofan-luan
MDQ6VXNlcjgzNDQ3MDc4
https://api.github.com/users/xiaofan-luan/orgs
https://api.github.com/users/xiaofan-luan/received_events
https://api.github.com/users/xiaofan-luan/repos
https://api.github.com/users/xiaofan-luan/starred{/owner}{/repo}
https://api.github.com/users/xiaofan-luan/subscriptions
User
https://api.github.com/users/xiaofan-luan
public
NONE
Feel free to assign to me and we probably need some guide on it
2022-02-27T14:30:55Z
https://github.com/huggingface/datasets/issues/3558#issuecomment-1053573005
https://api.github.com/repos/huggingface/datasets/issues/3558
IC_kwDODunzps4-zD-N
https://api.github.com/repos/huggingface/datasets/issues/comments/1053573005/reactions
2022-02-27T14:30:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1053573005
https://avatars.githubusercontent.com/u/83447078?v=4
https://api.github.com/users/xiaofan-luan/events{/privacy}
https://api.github.com/users/xiaofan-luan/followers
https://api.github.com/users/xiaofan-luan/following{/other_user}
https://api.github.com/users/xiaofan-luan/gists{/gist_id}
https://github.com/xiaofan-luan
xiaofan-luan
MDQ6VXNlcjgzNDQ3MDc4
https://api.github.com/users/xiaofan-luan/orgs
https://api.github.com/users/xiaofan-luan/received_events
https://api.github.com/users/xiaofan-luan/repos
https://api.github.com/users/xiaofan-luan/starred{/owner}{/repo}
https://api.github.com/users/xiaofan-luan/subscriptions
User
https://api.github.com/users/xiaofan-luan
public
NONE
@mariosasko any updates my man?

2022-03-02T05:59:59Z
https://github.com/huggingface/datasets/issues/3558#issuecomment-1056312482
https://api.github.com/repos/huggingface/datasets/issues/3558
IC_kwDODunzps4-9gyi
https://api.github.com/repos/huggingface/datasets/issues/comments/1056312482/reactions
2022-03-02T05:59:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1056312482
https://avatars.githubusercontent.com/u/83447078?v=4
https://api.github.com/users/xiaofan-luan/events{/privacy}
https://api.github.com/users/xiaofan-luan/followers
https://api.github.com/users/xiaofan-luan/following{/other_user}
https://api.github.com/users/xiaofan-luan/gists{/gist_id}
https://github.com/xiaofan-luan
xiaofan-luan
MDQ6VXNlcjgzNDQ3MDc4
https://api.github.com/users/xiaofan-luan/orgs
https://api.github.com/users/xiaofan-luan/received_events
https://api.github.com/users/xiaofan-luan/repos
https://api.github.com/users/xiaofan-luan/starred{/owner}{/repo}
https://api.github.com/users/xiaofan-luan/subscriptions
User
https://api.github.com/users/xiaofan-luan
public
COLLABORATOR
Hi! For starters, I suggest you take a look at this file: https://github.com/huggingface/datasets/blob/master/src/datasets/search.py, which contains all the code for Faiss/ElasticSearch support. We could set up a Slack channel for additional guidance. Let me know what you prefer.
2022-03-03T14:49:54Z
https://github.com/huggingface/datasets/issues/3558#issuecomment-1058118186
https://api.github.com/repos/huggingface/datasets/issues/3558
IC_kwDODunzps4_EZoq
https://api.github.com/repos/huggingface/datasets/issues/comments/1058118186/reactions
2022-03-03T14:49:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1058118186
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
> Hi! For starters, I suggest you take a look at this file: https://github.com/huggingface/datasets/blob/master/src/datasets/search.py, which contains all the code for Faiss/ElasticSearch support. We could set up a Slack channel for additional guidance. Let me know what you prefer.

Sure, we take a look and do some research
2022-03-05T12:28:36Z
https://github.com/huggingface/datasets/issues/3558#issuecomment-1059754728
https://api.github.com/repos/huggingface/datasets/issues/3558
IC_kwDODunzps4_KpLo
https://api.github.com/repos/huggingface/datasets/issues/comments/1059754728/reactions
2022-03-05T12:28:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1059754728
https://avatars.githubusercontent.com/u/83447078?v=4
https://api.github.com/users/xiaofan-luan/events{/privacy}
https://api.github.com/users/xiaofan-luan/followers
https://api.github.com/users/xiaofan-luan/following{/other_user}
https://api.github.com/users/xiaofan-luan/gists{/gist_id}
https://github.com/xiaofan-luan
xiaofan-luan
MDQ6VXNlcjgzNDQ3MDc4
https://api.github.com/users/xiaofan-luan/orgs
https://api.github.com/users/xiaofan-luan/received_events
https://api.github.com/users/xiaofan-luan/repos
https://api.github.com/users/xiaofan-luan/starred{/owner}{/repo}
https://api.github.com/users/xiaofan-luan/subscriptions
User
https://api.github.com/users/xiaofan-luan
public
Milvus is a popular open-source vector database. We should add a new vector index to support this project.