push to hub fails with huggingface-hub 0.5.0
MEMBER
Hi ! Indeed there was a breaking change in `huggingface_hub` 0.5.0 in `HfApi.create_repo`, which is called here in `datasets` by passing the org name in both the `repo_id` and the `organization` arguments:

https://github.com/huggingface/datasets/blob/2230f7f7d7fbaf102cff356f5a8f3bd1561bea43/src/datasets/arrow_dataset.py#L3363-L3369

I think we should fix that in `huggingface_hub`, will keep you posted. In the meantime please use `huggingface_hub` 0.4.0
2022-04-06T09:06:25Z
https://github.com/huggingface/datasets/issues/4105#issuecomment-1090033690
https://api.github.com/repos/huggingface/datasets/issues/4105
IC_kwDODunzps5A-Jga
https://api.github.com/repos/huggingface/datasets/issues/comments/1090033690/reactions
2022-04-06T09:06:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1090033690
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
I'll be sending a fix for this later today on the `huggingface_hub` side.

The error would be converted to a `FutureWarning` if `datasets` uses kwargs instead of positional, for example here: 

https://github.com/huggingface/datasets/blob/2230f7f7d7fbaf102cff356f5a8f3bd1561bea43/src/datasets/arrow_dataset.py#L3363-L3369

to be:

``` python
            api.create_repo(
                name=dataset_name,
                token=token,
                repo_type="dataset",
                organization=organization,
                private=private,
            )
```

But `name` and `organization` are deprecated in `huggingface_hub=0.5`, and people should pass `repo_id='org/name` instead. Note that `repo_id` was introduced in 0.5 and if `datasets` wants to support older `huggingface_hub` versions (which I encourage it to do), there needs to be a helper function to do that. It can be something like:


```python
def create_repo(
    client,
    name: str,
    token: Optional[str] = None,
    organization: Optional[str] = None,
    private: Optional[bool] = None,
    repo_type: Optional[str] = None,
    exist_ok: Optional[bool] = False,
    space_sdk: Optional[str] = None,
) -> str:
    try:
        return client.create_repo(
            repo_id=f"{organization}/{name}",
            token=token,
            private=private,
            repo_type=repo_type,
            exist_ok=exist_ok,
            space_sdk=space_sdk,
        )
    except TypeError:
        return client.create_repo(
            name=name,
            organization=organization,
            token=token,
            private=private,
            repo_type=repo_type,
            exist_ok=exist_ok,
            space_sdk=space_sdk,
        )
```

in a `utils/_fixes.py` kinda file and and be used internally.

I'll be sending a patch to `huggingface_hub` to convert the error reported in this issue to a `FutureWarning`.
2022-04-06T09:13:45Z
https://github.com/huggingface/datasets/issues/4105#issuecomment-1090041204
https://api.github.com/repos/huggingface/datasets/issues/4105
IC_kwDODunzps5A-LV0
https://api.github.com/repos/huggingface/datasets/issues/comments/1090041204/reactions
2022-04-06T09:13:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1090041204
https://avatars.githubusercontent.com/u/1663864?v=4
https://api.github.com/users/adrinjalali/events{/privacy}
https://api.github.com/users/adrinjalali/followers
https://api.github.com/users/adrinjalali/following{/other_user}
https://api.github.com/users/adrinjalali/gists{/gist_id}
https://github.com/adrinjalali
adrinjalali
MDQ6VXNlcjE2NjM4NjQ=
https://api.github.com/users/adrinjalali/orgs
https://api.github.com/users/adrinjalali/received_events
https://api.github.com/users/adrinjalali/repos
https://api.github.com/users/adrinjalali/starred{/owner}{/repo}
https://api.github.com/users/adrinjalali/subscriptions
User
https://api.github.com/users/adrinjalali
public
NONE
PR with the hotfix on the `huggingface_hub` side: https://github.com/huggingface/huggingface_hub/pull/822
2022-04-06T09:34:32Z
https://github.com/huggingface/datasets/issues/4105#issuecomment-1090061702
https://api.github.com/repos/huggingface/datasets/issues/4105
IC_kwDODunzps5A-QWG
https://api.github.com/repos/huggingface/datasets/issues/comments/1090061702/reactions
2022-04-06T09:34:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1090061702
https://avatars.githubusercontent.com/u/1663864?v=4
https://api.github.com/users/adrinjalali/events{/privacy}
https://api.github.com/users/adrinjalali/followers
https://api.github.com/users/adrinjalali/following{/other_user}
https://api.github.com/users/adrinjalali/gists{/gist_id}
https://github.com/adrinjalali
adrinjalali
MDQ6VXNlcjE2NjM4NjQ=
https://api.github.com/users/adrinjalali/orgs
https://api.github.com/users/adrinjalali/received_events
https://api.github.com/users/adrinjalali/repos
https://api.github.com/users/adrinjalali/starred{/owner}{/repo}
https://api.github.com/users/adrinjalali/subscriptions
User
https://api.github.com/users/adrinjalali
public
MEMBER
We can definitely change `push_to_hub` to use `repo_id` in `datasets` and require `huggingface_hub>=0.5.0`.

Let me open a PR :)
2022-04-06T09:43:59Z
https://github.com/huggingface/datasets/issues/4105#issuecomment-1090070112
https://api.github.com/repos/huggingface/datasets/issues/4105
IC_kwDODunzps5A-SZg
https://api.github.com/repos/huggingface/datasets/issues/comments/1090070112/reactions
2022-04-06T09:43:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1090070112
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
`huggingface_hub` 0.5.1 just got released with a fix, feel free to update `huggingface_hub` ;)
2022-04-06T12:21:43Z
https://github.com/huggingface/datasets/issues/4105#issuecomment-1090204857
https://api.github.com/repos/huggingface/datasets/issues/4105
IC_kwDODunzps5A-zS5
https://api.github.com/repos/huggingface/datasets/issues/comments/1090204857/reactions
2022-04-06T12:21:43Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1090204857
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
## Describe the bug
`ds.push_to_hub` is failing when updating a dataset in the form "org_id/repo_id"

## Steps to reproduce the bug
```python
from datasets import load_dataset
ds = load_dataset("rubrix/news_test")
ds.push_to_hub("<your-user>/news_test", token="<your-token>")
```

## Expected results
The dataset is successfully uploaded

## Actual results
An error validation is raised:

```bash
if repo_id and (name or organization):
>           raise ValueError(
                "Only pass `repo_id` and leave deprecated `name` and "
                "`organization` to be None."
E               ValueError: Only pass `repo_id` and leave deprecated `name` and `organization` to be None.
```

## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 1.18.1
- `huggingface-hub`: 0.5
- Platform: macOS
- Python version: 3.8.12
- PyArrow version: 6.0.0

cc @adrinjalali 
