I was getting a similar error `pyarrow.lib.ArrowInvalid: Integer value 528 not in range: -128 to 127` - AFAICT, this is because the type specified for `reddit_scores` is `datasets.Sequence(datasets.Value("int8"))`, but the actual values can be well outside the max range for 8-bit integers.
NONE
Duplicated issue.
2023-02-24T12:58:31Z
https://github.com/huggingface/datasets/issues/5576#issuecomment-1443650022
https://api.github.com/repos/huggingface/datasets/issues/5576
IC_kwDODunzps5WDFnm
https://api.github.com/repos/huggingface/datasets/issues/comments/1443650022/reactions
2023-02-24T12:58:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1443650022
https://avatars.githubusercontent.com/u/5126316?v=4
https://api.github.com/users/wjfwzzc/events{/privacy}
https://api.github.com/users/wjfwzzc/followers
https://api.github.com/users/wjfwzzc/following{/other_user}
https://api.github.com/users/wjfwzzc/gists{/gist_id}
https://github.com/wjfwzzc
wjfwzzc
MDQ6VXNlcjUxMjYzMTY=
https://api.github.com/users/wjfwzzc/orgs
https://api.github.com/users/wjfwzzc/received_events
https://api.github.com/users/wjfwzzc/repos
https://api.github.com/users/wjfwzzc/starred{/owner}{/repo}
https://api.github.com/users/wjfwzzc/subscriptions
User
https://api.github.com/users/wjfwzzc
public
              I was getting a similar error `pyarrow.lib.ArrowInvalid: Integer value 528 not in range: -128 to 127` - AFAICT, this is because the type specified for `reddit_scores` is `datasets.Sequence(datasets.Value("int8"))`, but the actual values can be well outside the max range for 8-bit integers.

I worked around this by downloading the `the_pile_openwebtext2.py` and editing it to use local files and drop reddit scores as a column (not needed for my purposes).

_Originally posted by @tc-wolf in https://github.com/huggingface/datasets/issues/3053#issuecomment-1281392422_
            