georgesung
/

llama3_8b_chat_uncensored

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

Long time to get answer

#2

by LorenzoM29 - opened Jun 9

Jun 9

It takes roughly 1 minute to generate the answer. I'm running with GPU A100 on google collab. Any tips?

LorenzoM29 changed discussion status to closed Jun 29

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment