Error when pushing to the CI hub
COLLABORATOR
Hmmm, git bisect tells me that the behavior is the same since https://github.com/huggingface/datasets/commit/67e65c90e9490810b89ee140da11fdd13c356c9c (3 Oct), i.e. https://github.com/huggingface/datasets/pull/4926
2022-12-23T14:11:38Z
https://github.com/huggingface/datasets/issues/5390#issuecomment-1363985398
https://api.github.com/repos/huggingface/datasets/issues/5390
IC_kwDODunzps5RTMP2
https://api.github.com/repos/huggingface/datasets/issues/comments/1363985398/reactions
2022-12-23T14:21:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1363985398
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
COLLABORATOR
Maybe related to the discussions in https://github.com/huggingface/datasets/pull/5196
2022-12-23T14:21:03Z
https://github.com/huggingface/datasets/issues/5390#issuecomment-1363992440
https://api.github.com/repos/huggingface/datasets/issues/5390
IC_kwDODunzps5RTN94
https://api.github.com/repos/huggingface/datasets/issues/comments/1363992440/reactions
2022-12-23T14:21:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1363992440
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
COLLABORATOR
Maybe the current version of moonlanding in Hub CI is the issue.

I relaunched tests that were working two days ago: now they are failing. https://github.com/huggingface/datasets-server/commit/746414449cae4b311733f8a76e5b3b4ca73b38a9 for example

cc @huggingface/moon-landing 
2022-12-23T14:39:21Z
https://github.com/huggingface/datasets/issues/5390#issuecomment-1364004664
https://api.github.com/repos/huggingface/datasets/issues/5390
IC_kwDODunzps5RTQ84
https://api.github.com/repos/huggingface/datasets/issues/comments/1364004664/reactions
2022-12-23T14:40:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1364004664
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
COLLABORATOR
Hi! I don't think this has anything to do with `datasets`. Hub CI seems to be the culprit - the identical failure can be found in  [this](https://github.com/huggingface/datasets/pull/5389) PR (with unrelated changes) opened today.
2022-12-23T15:24:39Z
https://github.com/huggingface/datasets/issues/5390#issuecomment-1364041910
https://api.github.com/repos/huggingface/datasets/issues/5390
IC_kwDODunzps5RTaC2
https://api.github.com/repos/huggingface/datasets/issues/comments/1364041910/reactions
2022-12-23T15:24:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1364041910
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
COLLABORATOR
OK! Thanks for looking at it. Closing then.
2022-12-23T20:29:02Z
https://github.com/huggingface/datasets/issues/5390#issuecomment-1364319135
https://api.github.com/repos/huggingface/datasets/issues/5390
IC_kwDODunzps5RUduf
https://api.github.com/repos/huggingface/datasets/issues/comments/1364319135/reactions
2022-12-23T20:29:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1364319135
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
### Describe the bug

Note that it's a special case where the Hub URL is "https://hub-ci.huggingface.co", which does not appear if we do the same on the Hub (https://huggingface.co).

The call to `dataset.push_to_hub(` fails:

```
Pushing dataset shards to the dataset hub: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00,  1.93s/it]
Traceback (most recent call last):
  File "reproduce_hubci.py", line 16, in <module>
    dataset.push_to_hub(repo_id=repo_id, private=False, token=USER_TOKEN, embed_external_files=True)
  File "/home/slesage/hf/datasets/src/datasets/arrow_dataset.py", line 5025, in push_to_hub
    HfApi(endpoint=config.HF_ENDPOINT).upload_file(
  File "/home/slesage/.pyenv/versions/datasets/lib/python3.8/site-packages/huggingface_hub/hf_api.py", line 1346, in upload_file
    raise err
  File "/home/slesage/.pyenv/versions/datasets/lib/python3.8/site-packages/huggingface_hub/hf_api.py", line 1337, in upload_file
    r.raise_for_status()
  File "/home/slesage/.pyenv/versions/datasets/lib/python3.8/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: https://hub-ci.huggingface.co/api/datasets/__DUMMY_DATASETS_SERVER_USER__/bug-16718047265472/upload/main/README.md
```

### Steps to reproduce the bug

```python
# reproduce.py
from datasets import Dataset
import time

USER = "__DUMMY_DATASETS_SERVER_USER__"
USER_TOKEN = "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"
dataset = Dataset.from_dict({"a": [1, 2, 3]})
repo_id = f"{USER}/bug-{int(time.time() * 10e3)}"
dataset.push_to_hub(repo_id=repo_id, private=False, token=USER_TOKEN, embed_external_files=True)

```

```bash
$ HF_ENDPOINT="https://hub-ci.huggingface.co" python reproduce.py
```

### Expected behavior

No error and the dataset should be uploaded to the Hub with the README file (which generates the error).

### Environment info

- `datasets` version: 2.8.0
- Platform: Linux-5.15.0-1026-aws-x86_64-with-glibc2.35
- Python version: 3.9.15
- PyArrow version: 7.0.0
- Pandas version: 1.5.2
