irc_disentangle - Issue with splitting data
NONE
Thank you I will try this out!

On Tue, Jun 11, 2024 at 3:55 AM Vincent Lau ***@***.***>
wrote:

> I add a "streaming=True" after the name of the dataset, and it
> works.....hope it can help you
>
> And if you install the version datasets==2.15.0, this bug will not happen.
> I don't know why, but all of them works
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#issuecomment-2160041812>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7AMBT2MNO34SC3Z5G3ZG2UOXAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRQGA2DCOBRGI>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>

2024-06-11T18:39:15Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2161387981
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6A1CnN
https://api.github.com/repos/huggingface/datasets/issues/comments/2161387981/reactions
2024-06-11T18:39:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2161387981
https://avatars.githubusercontent.com/u/114260604?v=4
https://api.github.com/users/eor51355/events{/privacy}
https://api.github.com/users/eor51355/followers
https://api.github.com/users/eor51355/following{/other_user}
https://api.github.com/users/eor51355/gists{/gist_id}
https://github.com/eor51355
eor51355
U_kgDOBs96fA
https://api.github.com/users/eor51355/orgs
https://api.github.com/users/eor51355/received_events
https://api.github.com/users/eor51355/repos
https://api.github.com/users/eor51355/starred{/owner}{/repo}
https://api.github.com/users/eor51355/subscriptions
User
https://api.github.com/users/eor51355
public
NONE
I still find out that there are some strange bug in v2.15.0 of datasets. it seems like that the *.arrow file cannot be established. it may be an index of the subsets. well I still try to debug it. but, one of the most efficient way may be using the google colab to build this index in the ~/huggingface/datasets, and than download them to replace the local file.....lol......it works!
2024-06-12T02:33:02Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2161988798
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6A3VS-
https://api.github.com/repos/huggingface/datasets/issues/comments/2161988798/reactions
2024-06-12T02:33:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2161988798
https://avatars.githubusercontent.com/u/17721894?v=4
https://api.github.com/users/cybest0608/events{/privacy}
https://api.github.com/users/cybest0608/followers
https://api.github.com/users/cybest0608/following{/other_user}
https://api.github.com/users/cybest0608/gists{/gist_id}
https://github.com/cybest0608
cybest0608
MDQ6VXNlcjE3NzIxODk0
https://api.github.com/users/cybest0608/orgs
https://api.github.com/users/cybest0608/received_events
https://api.github.com/users/cybest0608/repos
https://api.github.com/users/cybest0608/starred{/owner}{/repo}
https://api.github.com/users/cybest0608/subscriptions
User
https://api.github.com/users/cybest0608
public
NONE
Yeah I did try what you suggested and it didn’t work. I was able to get it
on a local from someone who access the dataset in the past. Let me know
when you end up fixing this bug.

On Tue, Jun 11, 2024 at 10:33 PM Vincent Lau ***@***.***>
wrote:

> I still find out that there are some strange bug in v2.15.0 of datasets.
> it seems like that the *.arrow file cannot be established. it may be an
> index of the subsets. well I still try to debug it. but, one of the most
> efficient way may be using the google colab to build this index in the
> ~/huggingface/datasets, and than download them to replace the local
> file.....lol......it works!
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#issuecomment-2161988798>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7BCJE2LOCWRVWPMNODZG6XPJAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRRHE4DQNZZHA>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>

2024-06-12T12:13:16Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2162856447
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6A6pH_
https://api.github.com/repos/huggingface/datasets/issues/comments/2162856447/reactions
2024-06-12T12:13:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2162856447
https://avatars.githubusercontent.com/u/114260604?v=4
https://api.github.com/users/eor51355/events{/privacy}
https://api.github.com/users/eor51355/followers
https://api.github.com/users/eor51355/following{/other_user}
https://api.github.com/users/eor51355/gists{/gist_id}
https://github.com/eor51355
eor51355
U_kgDOBs96fA
https://api.github.com/users/eor51355/orgs
https://api.github.com/users/eor51355/received_events
https://api.github.com/users/eor51355/repos
https://api.github.com/users/eor51355/starred{/owner}{/repo}
https://api.github.com/users/eor51355/subscriptions
User
https://api.github.com/users/eor51355
public
MEMBER
Could you please provide more information, as required by the Bug template: https://github.com/huggingface/datasets/issues/new?assignees=&labels=&projects=&template=bug-report.yml

Without all that information, it is very difficult for us to understand the underlying issue and to give a pertinent answer.

What are the versions of the libraries you are using? Datasets, pyarrow, fsspec,...
> Environment info
> Please share your environemnt info with us. You can run the command datasets-cli env and copy-paste its output below.

What is the output you get after executing these code lines?
```python
import datasets
ds = datasets.load_dataset('irc_disentangle')
ds
```


2024-07-01T08:05:36Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2199502771
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6DGb-z
https://api.github.com/repos/huggingface/datasets/issues/comments/2199502771/reactions
2024-07-01T08:05:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2199502771
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
We have made the following fixes:
- [Fix source data URL](https://huggingface.co/datasets/jkkummerfeld/irc_disentangle/discussions/4)
- [Convert dataset to Parquet](https://huggingface.co/datasets/jkkummerfeld/irc_disentangle/discussions/5)
2024-07-08T06:18:08Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2213114690
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6D6XNC
https://api.github.com/repos/huggingface/datasets/issues/comments/2213114690/reactions
2024-07-08T06:18:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2213114690
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Thank you for the fixes. Sorry I lost this conversation in my inbox.

On Mon, Jul 8, 2024 at 2:18 AM Albert Villanova del Moral <
***@***.***> wrote:

> Closed #6906 <https://github.com/huggingface/datasets/issues/6906> as
> completed.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/huggingface/datasets/issues/6906#event-13418330895>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/A3HXU7HREJDE5BZSOEJFJI3ZLIVLNAVCNFSM6AAAAABH45CNPWVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJTGQYTQMZTGA4DSNI>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>

2024-07-16T00:21:55Z
https://github.com/huggingface/datasets/issues/6906#issuecomment-2229717968
https://api.github.com/repos/huggingface/datasets/issues/6906
IC_kwDODunzps6E5svQ
https://api.github.com/repos/huggingface/datasets/issues/comments/2229717968/reactions
2024-07-16T00:21:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2229717968
https://avatars.githubusercontent.com/u/114260604?v=4
https://api.github.com/users/eor51355/events{/privacy}
https://api.github.com/users/eor51355/followers
https://api.github.com/users/eor51355/following{/other_user}
https://api.github.com/users/eor51355/gists{/gist_id}
https://github.com/eor51355
eor51355
U_kgDOBs96fA
https://api.github.com/users/eor51355/orgs
https://api.github.com/users/eor51355/received_events
https://api.github.com/users/eor51355/repos
https://api.github.com/users/eor51355/starred{/owner}{/repo}
https://api.github.com/users/eor51355/subscriptions
User
https://api.github.com/users/eor51355
public
### Describe the bug

I am trying to access your database through python using "datasets.load_dataset("irc_disentangle")" and I am getting this error message:

ValueError: Instruction "train" corresponds to no data!

### Steps to reproduce the bug

import datasets
ds = datasets.load_dataset('irc_disentangle')
ds

### Expected behavior

The data is supposed to load into ds and be accessable as such:
ds['train'][1050], ds['train'][1055]

### Environment info

I tired Python 3.12 and 3.10