Concatenate several datasets with removed columns is not working.
COLLABORATOR
Hi,

did you fill out the env info section manually or by copy-pasting the output of the `datasets-cli env` command?

This code should work without issues on 1.6.2 version (I'm working on master (1.6.2.dev0 version) and can't reproduce this error).
2021-05-25T00:49:56Z
https://github.com/huggingface/datasets/issues/2400#issuecomment-847449924
https://api.github.com/repos/huggingface/datasets/issues/2400
MDEyOklzc3VlQ29tbWVudDg0NzQ0OTkyNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/847449924/reactions
2021-05-25T00:49:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/847449924
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
@mariosasko you are right I was still on `1.5.0`. 
2021-05-25T05:51:59Z
https://github.com/huggingface/datasets/issues/2400#issuecomment-847556526
https://api.github.com/repos/huggingface/datasets/issues/2400
MDEyOklzc3VlQ29tbWVudDg0NzU1NjUyNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/847556526/reactions
2021-05-25T05:51:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/847556526
https://avatars.githubusercontent.com/u/32632186?v=4
https://api.github.com/users/philschmid/events{/privacy}
https://api.github.com/users/philschmid/followers
https://api.github.com/users/philschmid/following{/other_user}
https://api.github.com/users/philschmid/gists{/gist_id}
https://github.com/philschmid
philschmid
MDQ6VXNlcjMyNjMyMTg2
https://api.github.com/users/philschmid/orgs
https://api.github.com/users/philschmid/received_events
https://api.github.com/users/philschmid/repos
https://api.github.com/users/philschmid/starred{/owner}{/repo}
https://api.github.com/users/philschmid/subscriptions
User
https://api.github.com/users/philschmid
public
## Describe the bug

You can't concatenate datasets when you removed columns before.

## Steps to reproduce the bug
```python
from datasets import load_dataset, concatenate_datasets

wikiann= load_dataset("wikiann","en")

wikiann["train"] = wikiann["train"].remove_columns(["langs","spans"])
wikiann["test"] = wikiann["test"].remove_columns(["langs","spans"])

assert wikiann["train"].features.type == wikiann["test"].features.type

concate = concatenate_datasets([wikiann["train"],wikiann["test"]])
```

## Expected results
Merged dataset 


## Actual results
```python
ValueError: External features info don't match the dataset:
Got
{'tokens': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None), 'ner_tags': Sequence(feature=ClassLabel(num_classes=7, names=['O', 'B-PER', 'I-PER', 'B-ORG', 'I-ORG', 'B-LOC', 'I-LOC'], names_file=None, id=None), length=-1, id=None), 'langs': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None), 'spans': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None)}
with type
struct<langs: list<item: string>, ner_tags: list<item: int64>, spans: list<item: string>, tokens: list<item: string>>

but expected something like
{'ner_tags': Sequence(feature=Value(dtype='int64', id=None), length=-1, id=None), 'tokens': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None)}
with type
struct<ner_tags: list<item: int64>, tokens: list<item: string>>
```
## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: ~1.6.2~ 1.5.0
- Platform: macos
- Python version: 3.8.5
- PyArrow version: 3.0.0
