https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-FP8/blob/f6b70b010c2a119cdb3401d158f3d1a347118b1d/config.json#L19
Yep it should
· Sign up or log in to comment