[Feature] Keep the list of labels of a dataset as metadata
MEMBER
Yes! I see mostly two options for this:
- a `Feature` approach like currently (but we might deprecate features)
- wrapping in a smart way the Dictionary arrays of Arrow: https://arrow.apache.org/docs/python/data.html?highlight=dictionary%20encode#dictionary-arrays
2020-04-15T21:25:47Z
https://github.com/huggingface/datasets/issues/4#issuecomment-614288243
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDYxNDI4ODI0Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/614288243/reactions
2020-04-15T21:25:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/614288243
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
CONTRIBUTOR
I would have a preference for the second bullet point.
2020-04-16T10:05:51Z
https://github.com/huggingface/datasets/issues/4#issuecomment-614549885
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDYxNDU0OTg4NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/614549885/reactions
2020-04-16T10:05:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/614549885
https://avatars.githubusercontent.com/u/959590?v=4
https://api.github.com/users/jplu/events{/privacy}
https://api.github.com/users/jplu/followers
https://api.github.com/users/jplu/following{/other_user}
https://api.github.com/users/jplu/gists{/gist_id}
https://github.com/jplu
jplu
MDQ6VXNlcjk1OTU5MA==
https://api.github.com/users/jplu/orgs
https://api.github.com/users/jplu/received_events
https://api.github.com/users/jplu/repos
https://api.github.com/users/jplu/starred{/owner}{/repo}
https://api.github.com/users/jplu/subscriptions
User
https://api.github.com/users/jplu
public
MEMBER
This should be accessible now as a feature in dataset.info.features (and even have the mapping methods).
2020-05-03T13:47:43Z
https://github.com/huggingface/datasets/issues/4#issuecomment-623112863
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDYyMzExMjg2Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/623112863/reactions
2020-05-03T13:47:43Z
https://api.github.com/repos/huggingface/datasets/issues/comments/623112863
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
CONTRIBUTOR
Perfect! Well done!!
2020-05-04T06:11:57Z
https://github.com/huggingface/datasets/issues/4#issuecomment-623276549
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDYyMzI3NjU0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/623276549/reactions
2020-05-04T06:11:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/623276549
https://avatars.githubusercontent.com/u/959590?v=4
https://api.github.com/users/jplu/events{/privacy}
https://api.github.com/users/jplu/followers
https://api.github.com/users/jplu/following{/other_user}
https://api.github.com/users/jplu/gists{/gist_id}
https://github.com/jplu
jplu
MDQ6VXNlcjk1OTU5MA==
https://api.github.com/users/jplu/orgs
https://api.github.com/users/jplu/received_events
https://api.github.com/users/jplu/repos
https://api.github.com/users/jplu/starred{/owner}{/repo}
https://api.github.com/users/jplu/subscriptions
User
https://api.github.com/users/jplu
public
NONE
Hi,
I hope we could get a better documentation.
It took me more than 1 hour to found this way to get the label information.
2020-07-08T14:15:55Z
https://github.com/huggingface/datasets/issues/4#issuecomment-655548033
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDY1NTU0ODAzMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/655548033/reactions
2020-07-08T14:15:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/655548033
https://avatars.githubusercontent.com/u/2521628?v=4
https://api.github.com/users/ydshieh/events{/privacy}
https://api.github.com/users/ydshieh/followers
https://api.github.com/users/ydshieh/following{/other_user}
https://api.github.com/users/ydshieh/gists{/gist_id}
https://github.com/ydshieh
ydshieh
MDQ6VXNlcjI1MjE2Mjg=
https://api.github.com/users/ydshieh/orgs
https://api.github.com/users/ydshieh/received_events
https://api.github.com/users/ydshieh/repos
https://api.github.com/users/ydshieh/starred{/owner}{/repo}
https://api.github.com/users/ydshieh/subscriptions
User
https://api.github.com/users/ydshieh
public
MEMBER
Yes we are working on the doc right now, should be in the next release quite soon.
2020-07-08T16:59:45Z
https://github.com/huggingface/datasets/issues/4#issuecomment-655639982
https://api.github.com/repos/huggingface/datasets/issues/4
MDEyOklzc3VlQ29tbWVudDY1NTYzOTk4Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/655639982/reactions
2020-07-08T16:59:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/655639982
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
It would be useful to keep the list of the labels of a dataset as metadata. Either directly in the `DatasetInfo` or in the Arrow metadata.