Concat only unique fields in DatasetInfo.from_merge
CONTRIBUTOR
Hi @mariosasko,
Just came across this PR and I was wondering if we can use
`description = "\n\n".join(OrderedDict.fromkeys([info.description for info in dataset_infos]))`

This will obviate the need for `unique` and is almost as fast as `set`. We could have used `dict` inplace of `OrderedDict` but it's available 3.7+ onwards
2021-04-04T14:27:50Z
https://github.com/huggingface/datasets/pull/2163#issuecomment-813042621
https://api.github.com/repos/huggingface/datasets/issues/2163
MDEyOklzc3VlQ29tbWVudDgxMzA0MjYyMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/813042621/reactions
2021-04-04T14:27:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/813042621
https://avatars.githubusercontent.com/u/19718818?v=4
https://api.github.com/users/bhavitvyamalik/events{/privacy}
https://api.github.com/users/bhavitvyamalik/followers
https://api.github.com/users/bhavitvyamalik/following{/other_user}
https://api.github.com/users/bhavitvyamalik/gists{/gist_id}
https://github.com/bhavitvyamalik
bhavitvyamalik
MDQ6VXNlcjE5NzE4ODE4
https://api.github.com/users/bhavitvyamalik/orgs
https://api.github.com/users/bhavitvyamalik/received_events
https://api.github.com/users/bhavitvyamalik/repos
https://api.github.com/users/bhavitvyamalik/starred{/owner}{/repo}
https://api.github.com/users/bhavitvyamalik/subscriptions
User
https://api.github.com/users/bhavitvyamalik
public
COLLABORATOR
Hi,

let's see what @lhoestq thinks. Although my approach adds more code, it's more readable IMO.
2021-04-04T15:06:17Z
https://github.com/huggingface/datasets/pull/2163#issuecomment-813048247
https://api.github.com/repos/huggingface/datasets/issues/2163
MDEyOklzc3VlQ29tbWVudDgxMzA0ODI0Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/813048247/reactions
2021-04-04T16:21:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/813048247
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
Yeah, that's true. Your approach is more readable.
2021-04-04T15:28:23Z
https://github.com/huggingface/datasets/pull/2163#issuecomment-813052229
https://api.github.com/repos/huggingface/datasets/issues/2163
MDEyOklzc3VlQ29tbWVudDgxMzA1MjIyOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/813052229/reactions
2021-04-04T15:28:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/813052229
https://avatars.githubusercontent.com/u/19718818?v=4
https://api.github.com/users/bhavitvyamalik/events{/privacy}
https://api.github.com/users/bhavitvyamalik/followers
https://api.github.com/users/bhavitvyamalik/following{/other_user}
https://api.github.com/users/bhavitvyamalik/gists{/gist_id}
https://github.com/bhavitvyamalik
bhavitvyamalik
MDQ6VXNlcjE5NzE4ODE4
https://api.github.com/users/bhavitvyamalik/orgs
https://api.github.com/users/bhavitvyamalik/received_events
https://api.github.com/users/bhavitvyamalik/repos
https://api.github.com/users/bhavitvyamalik/starred{/owner}{/repo}
https://api.github.com/users/bhavitvyamalik/subscriptions
User
https://api.github.com/users/bhavitvyamalik
public
I thought someone from the community with less experience would be interested in fixing this issue, but that wasn't the case.

Fixes #2103 