Changing "eos_token" to eot-id fix the issue of overflow of model response - at least using the Messages API.
#73
by
myonlyeye - opened
Changing "eos_token" to eot-id fix the issue of overflow of model response - at least using the Messages API.