solidrust
/

Llama-3-Orca-1.0-8B-AWQ

Text Generation

4-bit precision

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

Locutusque/Llama-3-Orca-1.0-8B AWQ

Model creator: Locutusque
Original model: Llama-3-Orca-1.0-8B

Model Summary

I fine-tuned llama-3 8B on mainly SlimOrca, along with other datasets to improve performance in math, coding, and writing.

This model has great performance in writing and coding.

Conversational AI.

Downloads last month: 5

Safetensors

Model size

1.98B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for solidrust/Llama-3-Orca-1.0-8B-AWQ

Base model

Locutusque/Llama-3-Orca-1.0-8B

Quantized

(1)

this model

Datasets used to train solidrust/Llama-3-Orca-1.0-8B-AWQ

Collection including solidrust/Llama-3-Orca-1.0-8B-AWQ

8B AWQ

164 items • Updated Sep 3 • 1