solidrust/Trillama-8B-AWQ

senseable/Trillama-8B AWQ

• Model creator: senseable
• Original model: Trillama-8B

Model Summary

Trillama-8B is a 8B LLM that builds upon the foundation of Llama-3-8B, the lastest model from Meta. It's a fine-tune focused on improving the model's already strong logic and reasoning.

import transformers
import torch

model_id = "senseable/Trillama-8B"

pipeline = transformers.pipeline(
    "text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto"
)
pipeline("Explain the meaning of life.")