505 495 677

Sylvain Filoni

fffiloni

AI & ML interests

ML for Animation • Alumni Arts Déco Paris • PSL

Recent Activity

new activity 3 days ago

fffiloni/expression-editor:Facial Expression Editor

replied to their post 3 days ago

I'm happy to announce that ✨ Image to Music v2 ✨ is ready for you to try and i hope you'll like it too ! 😌 This new version has been crafted with transparency in mind, so you can understand the process of translating an image to a musical equivalent. How does it works under the hood ? 🤔 First, we get a very literal caption from https://huggingface.co/microsoft/kosmos-2-patch14-224; this caption is then given to a LLM Agent (currently https://huggingface.co/HuggingFaceH4/zephyr-7b-beta )which task is to translate the image caption to a musical and inspirational prompt for the next step. Once we got a nice musical text from the LLM, we can send it to the text-to-music model of your choice: MAGNet, MusicGen, AudioLDM-2, Riffusion or Mustango Instead of the previous version of Image to Music which used Mubert API, and could output curious and obscure combinations, we only provide open sourced models available on the hub, called via the gradio API. Also i guess the music result should be more accurate to the atmosphere of the image input, thanks to the LLM Agent step. Pro tip, you can adjust the inspirational prompt to match your expectations, according to the chosen model and specific behavior of each one 👌 Try it, explore different models and tell me which one is your favorite 🤗 —› https://huggingface.co/spaces/fffiloni/image-to-music-v2

updated a Space 3 days ago

fffiloni/image-to-music-v2

View all activity

Organizations

Posts 12

Post

17757

I was thinking i need to step up my game on training Flux LoRas models, time to have some fun ! ☀️

Expect a new drop per week on aesthetics that catched my attention, here are 3 of them that worked really well !

fffiloni/cute-comic-800
fffiloni/carbo-800
fffiloni/oniric-750

View all Posts