How to load this model in LM Studio without random outputs?
#2
by
77helen
- opened
When I use this model in LM Studio，it responses random outputs although I turn on the Flash Attention .
The file I used is qwen2-72b-instruct-q4_k_m.gguf