cudf-cu12 24.4.1, ibis-framework 8.0.0 requires pyarrow<15.0.0a0,>=14.0.1,pyarrow<16,>=2 and datasets 2.21.0 requires pyarrow>=15.0.0
NONE
@sayakpaul  please advice 
2024-08-20T08:14:24Z
https://github.com/huggingface/datasets/issues/7112#issuecomment-2298248198
https://api.github.com/repos/huggingface/datasets/issues/7112
IC_kwDODunzps6I_HwG
https://api.github.com/repos/huggingface/datasets/issues/comments/2298248198/reactions
2024-08-20T08:14:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2298248198
https://avatars.githubusercontent.com/u/174590283?v=4
https://api.github.com/users/SoumyaMB10/events{/privacy}
https://api.github.com/users/SoumyaMB10/followers
https://api.github.com/users/SoumyaMB10/following{/other_user}
https://api.github.com/users/SoumyaMB10/gists{/gist_id}
https://github.com/SoumyaMB10
SoumyaMB10
U_kgDOCmgJSw
https://api.github.com/users/SoumyaMB10/orgs
https://api.github.com/users/SoumyaMB10/received_events
https://api.github.com/users/SoumyaMB10/repos
https://api.github.com/users/SoumyaMB10/starred{/owner}{/repo}
https://api.github.com/users/SoumyaMB10/subscriptions
User
https://api.github.com/users/SoumyaMB10
public
NONE
Hits the same dependency conflict
2024-09-20T15:29:26Z
https://github.com/huggingface/datasets/issues/7112#issuecomment-2363993449
https://api.github.com/repos/huggingface/datasets/issues/7112
IC_kwDODunzps6M561p
https://api.github.com/repos/huggingface/datasets/issues/comments/2363993449/reactions
2024-09-20T15:29:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2363993449
https://avatars.githubusercontent.com/u/42265657?v=4
https://api.github.com/users/fyuan1316/events{/privacy}
https://api.github.com/users/fyuan1316/followers
https://api.github.com/users/fyuan1316/following{/other_user}
https://api.github.com/users/fyuan1316/gists{/gist_id}
https://github.com/fyuan1316
fyuan1316
MDQ6VXNlcjQyMjY1NjU3
https://api.github.com/users/fyuan1316/orgs
https://api.github.com/users/fyuan1316/received_events
https://api.github.com/users/fyuan1316/repos
https://api.github.com/users/fyuan1316/starred{/owner}{/repo}
https://api.github.com/users/fyuan1316/subscriptions
User
https://api.github.com/users/fyuan1316
public
### Describe the bug

!pip install accelerate>=0.16.0 torchvision transformers>=4.25.1 datasets>=2.19.1 ftfy tensorboard Jinja2 peft==0.7.0

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
cudf-cu12 24.4.1 requires pyarrow<15.0.0a0,>=14.0.1, but you have pyarrow 17.0.0 which is incompatible.
ibis-framework 8.0.0 requires pyarrow<16,>=2, but you have pyarrow 17.0.0 which is incompatible.

to solve above error
!pip install pyarrow==14.0.1

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
datasets 2.21.0 requires pyarrow>=15.0.0, but you have pyarrow 14.0.1 which is incompatible.

### Steps to reproduce the bug

!pip install datasets>=2.19.1

### Expected behavior

run without dependency error

### Environment info

Diffusers version: 0.31.0.dev0

Platform: Linux-6.1.85+-x86_64-with-glibc2.35
Running on Google Colab?: Yes
Python version: 3.10.12
PyTorch version (GPU?): 2.3.1+cu121 (True)
Flax version (CPU?/GPU?/TPU?): 0.8.4 (gpu)
Jax version: 0.4.26
JaxLib version: 0.4.26
Huggingface_hub version: 0.23.5
Transformers version: 4.42.4
Accelerate version: 0.32.1
PEFT version: 0.7.0
Bitsandbytes version: not installed
Safetensors version: 0.4.4
xFormers version: not installed
Accelerator: Tesla T4, 15360 MiB
Using GPU in script?:
Using distributed or parallel set-up in script?: