iwaitu
/

llama-3.1-70b-chinese-chat-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

base on shenzhi-wang/Llama3.1-70B-Chinese-Chat

推荐使用 2x H100 来运行

或者使用4x RTX6000 ADA 48G 来运行

Downloads last month: 11

Safetensors

Model size

70.6B params

Tensor type

BF16

·

F8_E4M3

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Model tree for iwaitu/llama-3.1-70b-chinese-chat-FP8

Base model

meta-llama/Meta-Llama-3.1-70B

Finetuned

meta-llama/Meta-Llama-3.1-70B-Instruct

Quantized

shenzhi-wang/Llama3.1-70B-Chinese-Chat

Quantized

this model