TheFloat16
/

Llama3-70b-Instruct-TRTLLM

Text Generation

Model card Files Files and versions Community

Llama3-70b-Instruct-TRTLLM

1 contributor

History: 9 commits

matichon's picture

Upload folder using huggingface_hub

494657e verified 6 months ago

quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp1-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp2-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp4-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvfp16-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvfp8-gs64
Upload folder using huggingface_hub 6 months ago
quantized-llama-3-70b-pp1-tp8-awq-w4a16-kvint8-gs64
Upload folder using huggingface_hub 6 months ago
.gitattributes

1.52 kB

initial commit 6 months ago
.gitignore

58 Bytes

Update .gitignore 6 months ago
README.md

34 kB

Update README.md 6 months ago