shuttleai
/

shuttle-3-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shuttle-3-mini-GPTQ-Int4

1 contributor

History: 5 commits

xtristan's picture

Upload quantize_config.json

c523809 verified about 2 months ago

.gitattributes

1.52 kB

initial commit about 2 months ago
README.md

5.17 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False about 2 months ago
config.json

725 Bytes

Update config.json about 2 months ago
generation_config.json

248 Bytes

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False about 2 months ago
model-00001-of-00002.safetensors

4.99 GB
LFS

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False about 2 months ago
model-00002-of-00002.safetensors

4.99 GB
LFS

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False about 2 months ago
model.safetensors.index.json

129 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False about 2 months ago
quantize_config.json

265 Bytes

Upload quantize_config.json about 2 months ago
special_tokens_map.json

613 Bytes

Upload 4 files about 2 months ago
tokenizer.json

7.03 MB

Upload 4 files about 2 months ago
tokenizer_config.json

4.97 kB

Upload 4 files about 2 months ago