Scripts fpr finetuning this model on custom data

#9
by Mrigank - opened

Hi! This model seems super interesting. I was wondering if there are scripts for finetuning this model on custom datasets?

And to add this how about finetuning on different languages?

IBM Granite org

Hi, thanks for the interest in our model. We're in the process of creating such scripts (our model was trained with a different toolkit and then converted to HF format). As to different languages, our future models will be multilingual.

@gsaon Super exciting stuff! This model is looking really cool. Any idea when the fine-tuning scripts will be finalized and published? Hoping to use this as the base model for a fine-tuning job for work. Cheers!

Please consider if possible to add greek language. Not only for this for all granite models even text or vision

A fine tune for german would be great!

IBM Granite org

@Buttermilk03 German is one of the supported input languages for ASR as of revision 3.3.2 that was released on June 19, maybe give it a try?

Hi, thanks for the interest in our model. We're in the process of creating such scripts (our model was trained with a different toolkit and then converted to HF format). As to different languages, our future models will be multilingual.

Sorry, I see you reacted to my previous comment, but you didn’t answer my question. Any ETA for fine-tuning script?

Hi @jacktol @Mrigank @myrulezzz @gsaon
Thanks for your interest in our work.
Following your request, I wrote a minimal finetuning script.
Have a look at this pull request: https://github.com/huggingface/cookbook/pull/307
Once the PR is merged, we'll add it to the docs.

@gsaon : Nice! Do you offer an API?

IBM Granite org

@Buttermilk03 Not at the moment, sorry.

@Gsaon :
I would very much appreciate if you would like to think about offering an API. Your model is great, but it needs to be accessible as well. The size of the model right now means that most users without a strong computer won't be able to use it ever. An API on the other hand could be priced competitively and make your model available available on a broad basis. It could also be integrated into Android Keyboard via an API Access. There are many desktop AI applications that use API speech-to-text models that could profit from your services as well.

IBM Granite org

@Buttermilk03 I should've been more precise. We are working on offering API access to our models, it just hasn't happened yet.

@gsaon : Do you have a date on when you will offer an API for the granite speech models?

IBM Granite org

Great, thank you @gsaon !

Sign up or log in to comment