load_dataset for winoground returning decoding error
CONTRIBUTOR
I thought I had fixed it with this after some helpful hints from @severo
```python
import datasets 
token = 'hf_XXXXX'
dataset = datasets.load_dataset(
    'facebook/winoground', 
    name='facebook--winoground', 
    split='train', 
    streaming=True,
    use_auth_token=token,
)
```
but I found out that wasn't the case
```python
[x for x in dataset]
...
ClientResponseError: 401, message='Unauthorized', url=URL('https://huggingface.co/datasets/facebook/winoground/resolve/a86a60456fbbd242e9a744199071a6bd3e7fd9de/examples.jsonl')
```
2022-04-12T15:02:49Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1096847007
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5BYI6f
https://api.github.com/repos/huggingface/datasets/issues/comments/1096847007/reactions
2022-04-12T15:14:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1096847007
https://avatars.githubusercontent.com/u/4686956?v=4
https://api.github.com/users/odellus/events{/privacy}
https://api.github.com/users/odellus/followers
https://api.github.com/users/odellus/following{/other_user}
https://api.github.com/users/odellus/gists{/gist_id}
https://github.com/odellus
odellus
MDQ6VXNlcjQ2ODY5NTY=
https://api.github.com/users/odellus/orgs
https://api.github.com/users/odellus/received_events
https://api.github.com/users/odellus/repos
https://api.github.com/users/odellus/starred{/owner}{/repo}
https://api.github.com/users/odellus/subscriptions
User
https://api.github.com/users/odellus
public
MEMBER
Hi ! This dataset structure (image + labels in a JSON file) is not supported yet, though we're adding support for this in  in #4069 

The following structure will be supported soon:
```
metadata.json
images/
     image0.png
     image1.png
    ...
```
Where `metadata.json` is a JSON Lines file with labels or other metadata, and each line must have a "file_name" field with the name of the image file.

For the moment are only supported:
- JSON files only
- image files only

Since this dataset is a mix of the two, at the moment it fails trying to read the images as JSON.

Therefore to be able to load this dataset we need to wait for the new structure to be supported (very soon ^^), or add a dataset script in the repository that reads both the JSON and the images cc @TristanThrush 

2022-04-13T14:27:11Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1098118976
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5Bc_dA
https://api.github.com/repos/huggingface/datasets/issues/comments/1098118976/reactions
2022-04-13T14:27:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1098118976
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
We'll also investigate the issue with the streaming download manager in https://github.com/huggingface/datasets/issues/4139 ;) thanks for reporting
2022-04-13T14:27:56Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1098119868
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5Bc_q8
https://api.github.com/repos/huggingface/datasets/issues/comments/1098119868/reactions
2022-04-13T14:27:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1098119868
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Are there any updates on this?
2022-04-22T13:49:11Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1106535307
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5B9GOL
https://api.github.com/repos/huggingface/datasets/issues/comments/1106535307/reactions
2022-04-22T13:49:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1106535307
https://avatars.githubusercontent.com/u/25319044?v=4
https://api.github.com/users/kshitijkg/events{/privacy}
https://api.github.com/users/kshitijkg/followers
https://api.github.com/users/kshitijkg/following{/other_user}
https://api.github.com/users/kshitijkg/gists{/gist_id}
https://github.com/kshitijkg
kshitijkg
MDQ6VXNlcjI1MzE5MDQ0
https://api.github.com/users/kshitijkg/orgs
https://api.github.com/users/kshitijkg/received_events
https://api.github.com/users/kshitijkg/repos
https://api.github.com/users/kshitijkg/starred{/owner}{/repo}
https://api.github.com/users/kshitijkg/subscriptions
User
https://api.github.com/users/kshitijkg
public
CONTRIBUTOR
In the meantime, anyone can always download the images.zip and examples.jsonl files directly from huggingface.co - let me know if anyone has issues with that.
2022-04-22T16:40:33Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1106684076
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5B9qis
https://api.github.com/repos/huggingface/datasets/issues/comments/1106684076/reactions
2022-04-22T22:06:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1106684076
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
CONTRIBUTOR
I mirrored the files at https://huggingface.co/datasets/facebook/winoground in a folder on my local machine `winground`
and when I tried
```python
import datasets
ds = datasets.load_from_disk('./winoground')
```
I get the following error
```python
--------------------------------------------------------------------------
FileNotFoundError                         Traceback (most recent call last)
Input In [2], in <cell line: 1>()
----> 1 ds = datasets.load_from_disk('./winoground')

File ~/.local/lib/python3.8/site-packages/datasets/load.py:1759, in load_from_disk(dataset_path, fs, keep_in_memory)
   1757     return DatasetDict.load_from_disk(dataset_path, fs, keep_in_memory=keep_in_memory)
   1758 else:
-> 1759     raise FileNotFoundError(
   1760         f"Directory {dataset_path} is neither a dataset directory nor a dataset dict directory."
   1761     )

FileNotFoundError: Directory ./winoground is neither a dataset directory nor a dataset dict directory.
```
so still some work to be done on the backend imo.
2022-04-22T19:40:27Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1106805196
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5B-IHM
https://api.github.com/repos/huggingface/datasets/issues/comments/1106805196/reactions
2022-04-22T19:40:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1106805196
https://avatars.githubusercontent.com/u/4686956?v=4
https://api.github.com/users/odellus/events{/privacy}
https://api.github.com/users/odellus/followers
https://api.github.com/users/odellus/following{/other_user}
https://api.github.com/users/odellus/gists{/gist_id}
https://github.com/odellus
odellus
MDQ6VXNlcjQ2ODY5NTY=
https://api.github.com/users/odellus/orgs
https://api.github.com/users/odellus/received_events
https://api.github.com/users/odellus/repos
https://api.github.com/users/odellus/starred{/owner}{/repo}
https://api.github.com/users/odellus/subscriptions
User
https://api.github.com/users/odellus
public
MEMBER
Note that `load_from_disk` is the function that reloads an Arrow dataset saved with `my_dataset.save_to_disk`.

Once we do support images with metadata you'll be able to use `load_dataset("facebook/winoground")` directly (or `load_dataset("./winoground")` of you've cloned the winoground repository locally).
2022-04-27T10:37:27Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1110846169
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5CNirZ
https://api.github.com/repos/huggingface/datasets/issues/comments/1110846169/reactions
2022-04-27T10:37:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1110846169
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Apologies for the delay. I added a custom dataset loading script for winoground. It should work now, with an auth token:

`examples = load_dataset('facebook/winoground', use_auth_token=<your auth token>)`

Let me know if there are any issues
2022-05-04T23:00:41Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1118009570
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5Co3ji
https://api.github.com/repos/huggingface/datasets/issues/comments/1118009570/reactions
2022-05-04T23:00:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1118009570
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
CONTRIBUTOR
Adding the dataset loading script definitely didn't take as long as I thought it would 😅
2022-05-04T23:01:32Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1118010015
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5Co3qf
https://api.github.com/repos/huggingface/datasets/issues/comments/1118010015/reactions
2022-05-04T23:01:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1118010015
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
CONTRIBUTOR
killer
2022-05-04T23:40:38Z
https://github.com/huggingface/datasets/issues/4149#issuecomment-1118029144
https://api.github.com/repos/huggingface/datasets/issues/4149
IC_kwDODunzps5Co8VY
https://api.github.com/repos/huggingface/datasets/issues/comments/1118029144/reactions
2022-05-04T23:40:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1118029144
https://avatars.githubusercontent.com/u/4686956?v=4
https://api.github.com/users/odellus/events{/privacy}
https://api.github.com/users/odellus/followers
https://api.github.com/users/odellus/following{/other_user}
https://api.github.com/users/odellus/gists{/gist_id}
https://github.com/odellus
odellus
MDQ6VXNlcjQ2ODY5NTY=
https://api.github.com/users/odellus/orgs
https://api.github.com/users/odellus/received_events
https://api.github.com/users/odellus/repos
https://api.github.com/users/odellus/starred{/owner}{/repo}
https://api.github.com/users/odellus/subscriptions
User
https://api.github.com/users/odellus
public
## Describe the bug
I am trying to use datasets to load winoground and I'm getting a JSON decoding error.

## Steps to reproduce the bug
```python
from datasets import load_dataset
token = 'hf_XXXXX' # my HF access token
datasets = load_dataset('facebook/winoground', use_auth_token=token)
```

## Expected results
I downloaded images.zip and examples.jsonl manually. I was expecting to have some trouble decoding json so I didn't use jsonlines but instead was able to get a complete set of 400 examples by doing
```python
import json

with open('examples.jsonl', 'r') as f:
    examples = f.read().split('\n')

# Thinking this would error if the JSON is not utf-8 encoded
json_data = [json.loads(x) for x in examples]
print(json_data[-1])
```
and I see
```python
{'caption_0': 'someone is overdoing it',
 'caption_1': 'someone is doing it over',
 'collapsed_tag': 'Relation',
 'id': 399,
 'image_0': 'ex_399_img_0',
 'image_1': 'ex_399_img_1',
 'num_main_preds': 1,
 'secondary_tag': 'Morpheme-Level',
 'tag': 'Scope, Preposition'}

```
so I'm not sure what's going on here honestly. The file `examples.jsonl` doesn't have non-UTF-8 encoded text.

## Actual results
During the split operation after downloading, datasets encounters an error in the JSON ([trace](https://gist.github.com/odellus/e55d390ca203386bf551f38e0c63a46b) abbreviated for brevity).
```
datasets/packaged_modules/json/json.py:144 in Json._generate_tables(self, files)
...
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
```


## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 1.18.4
- Platform: Linux-5.13.0-39-generic-x86_64-with-glibc2.29
- Python version: 3.8.10
- PyArrow version: 7.0.0
