Don't use pyarrow 4.0.0 since it segfaults when casting a sliced ListArray of integers
MEMBER
@lhoestq note that the segfault also occurs on Linux.
2021-04-27T13:24:00Z
https://github.com/huggingface/datasets/pull/2268#issuecomment-827603718
https://api.github.com/repos/huggingface/datasets/issues/2268
MDEyOklzc3VlQ29tbWVudDgyNzYwMzcxOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/827603718/reactions
2021-04-27T13:24:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/827603718
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Created the ticket at
https://issues.apache.org/jira/browse/ARROW-12568
2021-04-27T13:42:42Z
https://github.com/huggingface/datasets/pull/2268#issuecomment-827616676
https://api.github.com/repos/huggingface/datasets/issues/2268
MDEyOklzc3VlQ29tbWVudDgyNzYxNjY3Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/827616676/reactions
2021-04-27T13:42:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/827616676
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
@lhoestq the ticket you mentioned is now in state resolved. Pyarrow supports AArch64 after version 4.0.0. Because of this restriction `datasets` is not installing in AArch64 systems.
2021-06-12T12:44:49Z
https://github.com/huggingface/datasets/pull/2268#issuecomment-860048613
https://api.github.com/repos/huggingface/datasets/issues/2268
MDEyOklzc3VlQ29tbWVudDg2MDA0ODYxMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/860048613/reactions
2021-06-12T12:44:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/860048613
https://avatars.githubusercontent.com/u/12284951?v=4
https://api.github.com/users/symeneses/events{/privacy}
https://api.github.com/users/symeneses/followers
https://api.github.com/users/symeneses/following{/other_user}
https://api.github.com/users/symeneses/gists{/gist_id}
https://github.com/symeneses
symeneses
MDQ6VXNlcjEyMjg0OTUx
https://api.github.com/users/symeneses/orgs
https://api.github.com/users/symeneses/received_events
https://api.github.com/users/symeneses/repos
https://api.github.com/users/symeneses/starred{/owner}{/repo}
https://api.github.com/users/symeneses/subscriptions
User
https://api.github.com/users/symeneses
public
This test `tests/test_table.py::test_concatenation_table_cast` segfaults with the latest update of pyarrow 4.0.0.
Setting `pyarrow<4.0.0` for now. I'll open an issue on JIRA once I know more about the origin of the issue