Gradio Demo

#11
by mrfakename - opened

Hi,
I made a Gradio demo for this chatbot here.

not working :(

hyperparameters and prompt are wrong :D

sorry what are the correct ones?

like by example the ones default of lm studio for chatml prompt. The temp, top_k, etc seems the one of a coder model :D

hmm can you suggest some values to put in?

Screenshot 2023-12-09 at 2.54.30 AM.png

OK, changed params :) thanks for the suggestions

fblgit changed discussion status to closed

Sign up or log in to comment