❓ Sharing ElasticSearch indexed dataset 
CONTRIBUTOR
Hello @pietrolesci , I am not sure to understand what you are trying to do here.

If you're looking for ways to save a dataset on disk, you can you the `save_to_disk` method:
```python
>>> import datasets
>>> loaded_dataset = datasets.load("dataset_name")
>>> loaded_dataset.save_to_disk("/path/on/your/disk")
```

The saved dataset can later be retrieved using:
```python
>>> loaded_dataset = datasets.Dataset.load_from_disk("/path/on/your/disk")
```

Also, I'd recommend posting your question directly in the issue section of the [elasticsearch repo](https://github.com/elastic/elasticsearch)
2020-12-15T17:53:00Z
https://github.com/huggingface/datasets/issues/1324#issuecomment-745458888
https://api.github.com/repos/huggingface/datasets/issues/1324
MDEyOklzc3VlQ29tbWVudDc0NTQ1ODg4OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/745458888/reactions
2020-12-15T18:32:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/745458888
https://avatars.githubusercontent.com/u/33657802?v=4
https://api.github.com/users/SBrandeis/events{/privacy}
https://api.github.com/users/SBrandeis/followers
https://api.github.com/users/SBrandeis/following{/other_user}
https://api.github.com/users/SBrandeis/gists{/gist_id}
https://github.com/SBrandeis
SBrandeis
MDQ6VXNlcjMzNjU3ODAy
https://api.github.com/users/SBrandeis/orgs
https://api.github.com/users/SBrandeis/received_events
https://api.github.com/users/SBrandeis/repos
https://api.github.com/users/SBrandeis/starred{/owner}{/repo}
https://api.github.com/users/SBrandeis/subscriptions
User
https://api.github.com/users/SBrandeis
public
NONE
Hi @SBrandeis,

Thanks a lot for picking up my request. 

Maybe I can clarify my use-case with a bit of context. Say I have the IMDb dataset. I create an ES index on it. Now I can save and reload the dataset from disk normally. Once I reload the dataset, it is easy to retrieve the ES index on my machine. I was wondering: is there a way I can share the (now) indexed version of the IMDb dataset with my colleagues without requiring them to re-index it?

Thanks a lot in advance for your consideration.

Best,

Pietro
2020-12-21T13:20:14Z
https://github.com/huggingface/datasets/issues/1324#issuecomment-748969707
https://api.github.com/repos/huggingface/datasets/issues/1324
MDEyOklzc3VlQ29tbWVudDc0ODk2OTcwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/748969707/reactions
2020-12-21T13:20:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748969707
https://avatars.githubusercontent.com/u/61748653?v=4
https://api.github.com/users/pietrolesci/events{/privacy}
https://api.github.com/users/pietrolesci/followers
https://api.github.com/users/pietrolesci/following{/other_user}
https://api.github.com/users/pietrolesci/gists{/gist_id}
https://github.com/pietrolesci
pietrolesci
MDQ6VXNlcjYxNzQ4NjUz
https://api.github.com/users/pietrolesci/orgs
https://api.github.com/users/pietrolesci/received_events
https://api.github.com/users/pietrolesci/repos
https://api.github.com/users/pietrolesci/starred{/owner}{/repo}
https://api.github.com/users/pietrolesci/subscriptions
User
https://api.github.com/users/pietrolesci
public
CONTRIBUTOR
Thanks for the clarification.

I am not familiar with ElasticSearch, but if I understand well you're trying to migrate your data along with the ES index.
My advice would be to check out ES documentation, for instance, this might help you: https://www.elastic.co/guide/en/cloud/current/ec-migrate-data.html

Let me know if it helps
2020-12-22T07:50:56Z
https://github.com/huggingface/datasets/issues/1324#issuecomment-749400456
https://api.github.com/repos/huggingface/datasets/issues/1324
MDEyOklzc3VlQ29tbWVudDc0OTQwMDQ1Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/749400456/reactions
2020-12-22T07:50:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/749400456
https://avatars.githubusercontent.com/u/33657802?v=4
https://api.github.com/users/SBrandeis/events{/privacy}
https://api.github.com/users/SBrandeis/followers
https://api.github.com/users/SBrandeis/following{/other_user}
https://api.github.com/users/SBrandeis/gists{/gist_id}
https://github.com/SBrandeis
SBrandeis
MDQ6VXNlcjMzNjU3ODAy
https://api.github.com/users/SBrandeis/orgs
https://api.github.com/users/SBrandeis/received_events
https://api.github.com/users/SBrandeis/repos
https://api.github.com/users/SBrandeis/starred{/owner}{/repo}
https://api.github.com/users/SBrandeis/subscriptions
User
https://api.github.com/users/SBrandeis
public
Hi there,

First of all, thank you very much for this amazing library. Datasets have become my preferred data structure for basically everything I am currently doing.

**Question:** I'm working with a dataset and I have an elasticsearch container running at localhost:9200. I added an elasticsearch index and I was wondering

- how can I know where it has been saved?

- how can I share the indexed dataset with others?

I tried to dig into the docs, but could not find anything about that.

Thank you very much for your help.

Best,
Pietro

Edit: apologies for the wrong label