phatjk
/

vietcuna-7b-v3-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

vietcuna-7b-v3-AWQ / README.md

phatjk's picture

Create README.md

c948833 12 months ago

|

history blame contribute delete

109 Bytes

metadata

pipeline_tag: text-generation

"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"