fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-sym

Text Generation

text-generation-inference

4-bit precision

intel/auto-round

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-sym

1 contributor

History: 3 commits

fbaldassarri's picture

Upload README.md

56cbb02 verified 3 days ago