Senku-70B-GPTQ-4bit / README.md
bigquant's picture
Update README.md
753967e verified
metadata
library_name: transformers
tags:
  - GPTQ
  - Miqu
  - Senku

A quantized version of Shinoji Research's Senku 70B Full. Quantized through GPTQ:

Quantization settings:

4bits-128g-desc_act_True-damp_0.01