can not flatten natural_questions dataset
NONE
same issue. downgrade it to a lower version.
2022-03-17T03:15:55Z
https://github.com/huggingface/datasets/issues/3795#issuecomment-1070124685
https://api.github.com/repos/huggingface/datasets/issues/3795
IC_kwDODunzps4_yM6N
https://api.github.com/repos/huggingface/datasets/issues/comments/1070124685/reactions
2022-03-17T03:16:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1070124685
https://avatars.githubusercontent.com/u/56542320?v=4
https://api.github.com/users/Boltzmachine/events{/privacy}
https://api.github.com/users/Boltzmachine/followers
https://api.github.com/users/Boltzmachine/following{/other_user}
https://api.github.com/users/Boltzmachine/gists{/gist_id}
https://github.com/Boltzmachine
Boltzmachine
MDQ6VXNlcjU2NTQyMzIw
https://api.github.com/users/Boltzmachine/orgs
https://api.github.com/users/Boltzmachine/received_events
https://api.github.com/users/Boltzmachine/repos
https://api.github.com/users/Boltzmachine/starred{/owner}{/repo}
https://api.github.com/users/Boltzmachine/subscriptions
User
https://api.github.com/users/Boltzmachine
public
MEMBER
Thanks for reporting, I'll take a look tomorrow :)
2022-03-17T17:50:54Z
https://github.com/huggingface/datasets/issues/3795#issuecomment-1071146565
https://api.github.com/repos/huggingface/datasets/issues/3795
IC_kwDODunzps4_2GZF
https://api.github.com/repos/huggingface/datasets/issues/comments/1071146565/reactions
2022-03-17T17:50:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1071146565
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
## Describe the bug
after downloading the natural_questions dataset, can not flatten the dataset considering there are `long answer` and `short answer` in `annotations`.

## Steps to reproduce the bug
```python
from datasets import load_dataset

dataset = load_dataset('natural_questions',cache_dir = 'data/dataset_cache_dir')
dataset['train'].flatten()
```

## Expected results
a dataset with `long_answer` as features

## Actual results
Traceback (most recent call last):
  File "temp.py", line 5, in <module>
    dataset['train'].flatten()
  File "/Users/hannibal046/anaconda3/lib/python3.8/site-packages/datasets/fingerprint.py", line 413, in wrapper
    out = func(self, *args, **kwargs)
  File "/Users/hannibal046/anaconda3/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 1296, in flatten
    dataset._data = update_metadata_with_features(dataset._data, dataset.features)
  File "/Users/hannibal046/anaconda3/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 536, in update_metadata_with_features
    features = Features({col_name: features[col_name] for col_name in table.column_names})
  File "/Users/hannibal046/anaconda3/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 536, in <dictcomp>
    features = Features({col_name: features[col_name] for col_name in table.column_names})
KeyError: 'annotations.long_answer'
## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 1.8.13
- Platform: MBP
- Python version: 3.8
- PyArrow version: 6.0.1
