fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-asym

Text Generation

text-generation-inference

4-bit precision

intel/auto-round

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-asym

1 contributor

History: 3 commits

fbaldassarri's picture

Upload README.md

929fb04 verified 10 days ago