New discussion

流式的什么时候出啊

#35 opened about 1 year ago by dingxiang000

中文对话,模型总吐英文

1
#28 opened over 1 year ago by BestSongEver

--num-gpus 2 error

#26 opened over 1 year ago by zjtzpanxb

体验执行compute报错

1
#21 opened over 1 year ago by Kaibiao

体验报错

#20 opened over 1 year ago by Kaibiao

为什么分词里没有pad_id?

1
#19 opened over 1 year ago by cos0sin0

如何让模型能以stream方式输出?

5
#10 opened over 1 year ago by zlei

不支持流式输出?

1
#7 opened over 1 year ago by betterme

llama.cpp format?

2
#5 opened over 1 year ago by joorei