video dataset loader/parser
COLLABORATOR
Hi! We've just started discussing the video support in `datasets` (decoding backends, video feature type, etc.), so I believe we should have something tangible by the end of this year.

Also, if you have additional video features in mind that you would like to see, feel free to let us know
2022-08-09T16:08:54Z
https://github.com/huggingface/datasets/issues/4799#issuecomment-1209585650
https://api.github.com/repos/huggingface/datasets/issues/4799
IC_kwDODunzps5IGM_y
https://api.github.com/repos/huggingface/datasets/issues/comments/1209585650/reactions
2022-08-09T16:08:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1209585650
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
Coool thanks @mariosasko 
2022-08-09T16:42:33Z
https://github.com/huggingface/datasets/issues/4799#issuecomment-1209619794
https://api.github.com/repos/huggingface/datasets/issues/4799
IC_kwDODunzps5IGVVS
https://api.github.com/repos/huggingface/datasets/issues/comments/1209619794/reactions
2022-08-09T16:42:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1209619794
https://avatars.githubusercontent.com/u/26421036?v=4
https://api.github.com/users/verbiiyo/events{/privacy}
https://api.github.com/users/verbiiyo/followers
https://api.github.com/users/verbiiyo/following{/other_user}
https://api.github.com/users/verbiiyo/gists{/gist_id}
https://github.com/verbiiyo
verbiiyo
MDQ6VXNlcjI2NDIxMDM2
https://api.github.com/users/verbiiyo/orgs
https://api.github.com/users/verbiiyo/received_events
https://api.github.com/users/verbiiyo/repos
https://api.github.com/users/verbiiyo/starred{/owner}{/repo}
https://api.github.com/users/verbiiyo/subscriptions
User
https://api.github.com/users/verbiiyo
public
NONE
Hey @mariosasko, I was wondering if there's a way to load video data currently in the library? 
Alternatively is there a way I could hack it through the dataset.from_dict() method? I tried to hack it, but the issue I run into is that earlier I was doing a `cast_column()` call for the `Image` feature, but now I'm not sure about to do if I want the dataset to have the following keys when I call from_dict on it:
`{"caption":[list of text captions], "video_frames": [list of image lists with one image list corresponding to one video]}`

Maybe something like `cast_column("video_frames", List(Image))` ..
(This is assuming I have already extracted frames from video)
2023-09-30T23:54:09Z
https://github.com/huggingface/datasets/issues/4799#issuecomment-1741884880
https://api.github.com/repos/huggingface/datasets/issues/4799
IC_kwDODunzps5n0w3Q
https://api.github.com/repos/huggingface/datasets/issues/comments/1741884880/reactions
2023-10-01T00:08:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1741884880
https://avatars.githubusercontent.com/u/8274753?v=4
https://api.github.com/users/gunshi/events{/privacy}
https://api.github.com/users/gunshi/followers
https://api.github.com/users/gunshi/following{/other_user}
https://api.github.com/users/gunshi/gists{/gist_id}
https://github.com/gunshi
gunshi
MDQ6VXNlcjgyNzQ3NTM=
https://api.github.com/users/gunshi/orgs
https://api.github.com/users/gunshi/received_events
https://api.github.com/users/gunshi/repos
https://api.github.com/users/gunshi/starred{/owner}{/repo}
https://api.github.com/users/gunshi/subscriptions
User
https://api.github.com/users/gunshi
public
you know how you can [use `load_dataset` with any arbitrary csv file](https://huggingface.co/docs/datasets/loading#csv)? and you can also [use it to load a local image dataset](https://huggingface.co/docs/datasets/image_load#local-files)?

could you please add functionality to load a video dataset? it would be really cool if i could point it to a bunch of video files and use pytorch to start looping through batches of videos. like if my batch size is 16, each sample in the batch is a frame from a video. i'm competing in the [minerl challenge](https://www.aicrowd.com/challenges/neurips-2022-minerl-basalt-competition), and it would be awesome to use the HF ecosystem.