YugoGPT-Quantized-GGUF / YugoGPT-Quantized.GGUF.Q4_K_M.gguf

q4_k_m: Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K

212c3cf verified 8 months ago

4.37 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.