Insert Extractive QA templates for SQuAD-like datasets
MEMBER
hi @lhoestq @SBrandeis i've now added the missing YAML tags, so this PR should be good to go :)
2021-06-01T17:10:55Z
https://github.com/huggingface/datasets/pull/2435#issuecomment-852295414
https://api.github.com/repos/huggingface/datasets/issues/2435
MDEyOklzc3VlQ29tbWVudDg1MjI5NTQxNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/852295414/reactions
2021-06-01T17:10:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/852295414
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
urgh, the windows tests are failing because of encoding issues 😢 

```
dataset_name = 'squad_kor_v1'

    @pytest.mark.parametrize("dataset_name", get_changed_datasets(repo_path))
    def test_changed_dataset_card(dataset_name):
        card_path = repo_path / "datasets" / dataset_name / "README.md"
        assert card_path.exists()
        error_messages = []
        try:
            ReadMe.from_readme(card_path)
        except Exception as readme_error:
            error_messages.append(f"The following issues have been found in the dataset cards:\nREADME:\n{readme_error}")
        try:
            DatasetMetadata.from_readme(card_path)
        except Exception as metadata_error:
            error_messages.append(
                f"The following issues have been found in the dataset cards:\nYAML tags:\n{metadata_error}"
            )
    
        if error_messages:
>           raise ValueError("\n".join(error_messages))
E           ValueError: The following issues have been found in the dataset cards:
E           README:
E           'charmap' codec can't decode byte 0x90 in position 2283: character maps to <undefined>
E           The following issues have been found in the dataset cards:
E           YAML tags:
E           'charmap' codec can't decode byte 0x90 in position 2283: character maps to <undefined>
```
2021-06-01T17:20:29Z
https://github.com/huggingface/datasets/pull/2435#issuecomment-852301315
https://api.github.com/repos/huggingface/datasets/issues/2435
MDEyOklzc3VlQ29tbWVudDg1MjMwMTMxNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/852301315/reactions
2021-06-01T17:20:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/852301315
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
Seems like the encoding issues on windows is also being tackled in #2418 - will see if this solves the problem in the current PR
2021-06-01T19:31:28Z
https://github.com/huggingface/datasets/pull/2435#issuecomment-852390886
https://api.github.com/repos/huggingface/datasets/issues/2435
MDEyOklzc3VlQ29tbWVudDg1MjM5MDg4Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/852390886/reactions
2021-06-01T19:31:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/852390886
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
This PR adds task templates for 9 SQuAD-like templates with the following properties:

* 1 config
* A schema that matches the `squad` one (i.e. same column names, especially for the nested `answers` column because the current implementation does not support casting with mismatched columns. see #2434)
* Less than 20GB (my laptop can't handle more right now)

The aim of this PR is to provide a few datasets to experiment with the task template integration in other libraries / services. 

PR #2429 should be merged before this one.

cc @abhi1thakur 