Hugging Face's logo

meta-llama
/
Meta-Llama-3-8B

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-3
text-generation-inference
Inference Endpoints
Model card Files Community
208

Rotary position embeddings not loaded

#39
by cwbc - opened
Discussion
cwbc

When I load the model weights to transformers.LlavaLlamaForCausalLM, it says the rotary position embeddings rotary_emb.inv_freq are loaded from the checkpoint. Does it affect the model performance?

ArthurZ
 Meta Llama org

No

Sign up or log in to comment