ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (2)

Clinical Quant

#5 opened 6 months ago by

One needs a Qwen 72B AQLM

#4 opened 8 months ago by

ZN2at4_ops15sum_IntList_out4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbSt8optionalINS5_10ScalarTypeEERS2

#3 opened 8 months ago by