Repeated questions in chat function seem to maintain history causing the Gpu Vram to increase after each question.
#5
by
HaiderCG
- opened
Is there a function or parameter to turn (keeping history in memory) to off or not keeping history at all like we have for not returning it "return_history" by setting it to OFF.
You could set return_history=False and don't pass a history parameter to chat.