https://huggingface.co/meta-llama/Llama-3.2-3B with ONNX weights to be compatible with Transformers.js.

Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).

Downloads last month: 43

Inference Examples

Text Generation

Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Model tree for onnx-community/Llama-3.2-3B

Base model

meta-llama/Llama-3.2-3B

Quantized

(16)

this model