Hugging Face's logo

meta-llama
/
Llama-3.1-405B

Text Generation
Transformers
Safetensors
PyTorch
llama
facebook
meta
llama-3
text-generation-inference
Inference Endpoints
Model card Files Community
30

8-kv-heads

#21
by ArthurZ HF staff - opened
base: refs/heads/main
←
from: refs/pr/21
Discussion Files changed
+253
-1396
ArthurZ
 Meta Llama org
No description provided.
Upload model-00001-of-00191.safetensors with huggingface_hub1a48daac
Upload model-00003-of-00191.safetensors with huggingface_hub877865c5
Upload model-00004-of-00191.safetensors with huggingface_hubbf46f1e5
Upload model-00006-of-00191.safetensors with huggingface_hub20213ce9
Upload model-00007-of-00191.safetensors with huggingface_hub5ac623b0
Upload model-00009-of-00191.safetensors with huggingface_hubbf6497b2
Upload model-00010-of-00191.safetensors with huggingface_hub1f9f5425
Upload model-00012-of-00191.safetensors with huggingface_hubfda9e8fc
Upload model-00013-of-00191.safetensors with huggingface_hub46a6d366
Upload model-00015-of-00191.safetensors with huggingface_hub9c8a532a
Upload model-00016-of-00191.safetensors with huggingface_hub984db446
Upload model-00018-of-00191.safetensors with huggingface_hub3800138c
Upload model-00019-of-00191.safetensors with huggingface_hub05c80dce
Upload model-00021-of-00191.safetensors with huggingface_hub3358a66e
Upload model-00022-of-00191.safetensors with huggingface_huba9b0b8a8
Upload model-00024-of-00191.safetensors with huggingface_hubbb578221
Upload model-00025-of-00191.safetensors with huggingface_hub854b3926
Upload model-00027-of-00191.safetensors with huggingface_hub6f56595b
Upload model-00028-of-00191.safetensors with huggingface_hub1a6b03f0
Upload model-00030-of-00191.safetensors with huggingface_hub95b56293
Upload model-00031-of-00191.safetensors with huggingface_hubcd34a191
Upload model-00033-of-00191.safetensors with huggingface_hub50682cc3
Upload model-00034-of-00191.safetensors with huggingface_hub78ea28e3
Upload model-00036-of-00191.safetensors with huggingface_hub7cab4be3
Upload model-00037-of-00191.safetensors with huggingface_huba854fd5c
Upload model-00039-of-00191.safetensors with huggingface_hubf78e9502
Upload model-00040-of-00191.safetensors with huggingface_hubf1a97f51
Upload model-00042-of-00191.safetensors with huggingface_hub22db6b2b
Upload model-00043-of-00191.safetensors with huggingface_hub24cae41f
Upload model-00045-of-00191.safetensors with huggingface_hubcd5a8c8a
Upload model-00046-of-00191.safetensors with huggingface_hub249c380f
Upload model-00048-of-00191.safetensors with huggingface_hub427d89cc
Upload model-00049-of-00191.safetensors with huggingface_hub3742e067
Upload model-00051-of-00191.safetensors with huggingface_hub5c2e72f7
Upload model-00052-of-00191.safetensors with huggingface_hub5c67181e
Upload model-00054-of-00191.safetensors with huggingface_hub2f0ed6a9
Upload model-00055-of-00191.safetensors with huggingface_hubeaa09335
Upload model-00057-of-00191.safetensors with huggingface_hubca5105c6
Upload model-00058-of-00191.safetensors with huggingface_hub151eb34f
Upload model-00060-of-00191.safetensors with huggingface_hub59f1ea83
Upload model-00061-of-00191.safetensors with huggingface_hub4459314b
Upload model-00063-of-00191.safetensors with huggingface_huba3bd30b1
Upload model-00064-of-00191.safetensors with huggingface_hub49b9836b
Upload model-00066-of-00191.safetensors with huggingface_hub177ab5b2
Upload model-00067-of-00191.safetensors with huggingface_hub699d15b8
Upload model-00069-of-00191.safetensors with huggingface_hubbb0b5b59
Upload model-00070-of-00191.safetensors with huggingface_hubb098e026
Upload model-00072-of-00191.safetensors with huggingface_hub8a64374d
Upload model-00073-of-00191.safetensors with huggingface_hub8c7437d4
Upload model-00075-of-00191.safetensors with huggingface_hub362a268e
Upload model-00076-of-00191.safetensors with huggingface_hub754accab
Upload model-00078-of-00191.safetensors with huggingface_hub0e79d804
Upload model-00079-of-00191.safetensors with huggingface_hube9702059
Upload model-00081-of-00191.safetensors with huggingface_hubb84d3bb2
Upload model-00082-of-00191.safetensors with huggingface_hub6650ab65
Upload model-00084-of-00191.safetensors with huggingface_huba9f33543
Upload model-00085-of-00191.safetensors with huggingface_hubaf48480d
Upload model-00087-of-00191.safetensors with huggingface_hubb75cbc3e
Upload model-00088-of-00191.safetensors with huggingface_hub5f02a8f7
Upload model-00090-of-00191.safetensors with huggingface_hubb3811e43
Upload model-00091-of-00191.safetensors with huggingface_hub9f3bef0e
Upload model-00093-of-00191.safetensors with huggingface_hube0e40ea3
Upload model-00094-of-00191.safetensors with huggingface_hub78014c5c
Upload model-00096-of-00191.safetensors with huggingface_hub4df20b1c
Upload model-00097-of-00191.safetensors with huggingface_hubda61f8f0
Upload model-00099-of-00191.safetensors with huggingface_hub2dc3a281
Upload model-00100-of-00191.safetensors with huggingface_hub7ea7f691
Upload model-00102-of-00191.safetensors with huggingface_hube83ced97
Upload model-00103-of-00191.safetensors with huggingface_hubfa3cd91f
Upload model-00105-of-00191.safetensors with huggingface_hub205e536c
Upload model-00106-of-00191.safetensors with huggingface_hubfaa8668d
Upload model-00108-of-00191.safetensors with huggingface_hub18cf92b6
Upload model-00109-of-00191.safetensors with huggingface_hub8a1114e3
Upload model-00111-of-00191.safetensors with huggingface_hub4d5448bd
Upload model-00112-of-00191.safetensors with huggingface_hub38f4846c
Upload model-00114-of-00191.safetensors with huggingface_hub8fb2e5b9
Upload model-00115-of-00191.safetensors with huggingface_hube0c222e7
Upload model-00117-of-00191.safetensors with huggingface_hubbb2b1772
Upload model-00118-of-00191.safetensors with huggingface_hubb17dbb95
Upload model-00120-of-00191.safetensors with huggingface_huba0458c9c
Upload model-00121-of-00191.safetensors with huggingface_hub565d7017
Upload model-00123-of-00191.safetensors with huggingface_hub332a2de1
Upload model-00124-of-00191.safetensors with huggingface_hub0772b983
Upload model-00126-of-00191.safetensors with huggingface_hubf1c02d99
Upload model-00127-of-00191.safetensors with huggingface_huba8a67c24
Upload model-00129-of-00191.safetensors with huggingface_hub1490fb79
Upload model-00130-of-00191.safetensors with huggingface_hub64952c83
Upload model-00132-of-00191.safetensors with huggingface_hub020663ac
Upload model-00133-of-00191.safetensors with huggingface_hubc19c739e
Upload model-00135-of-00191.safetensors with huggingface_hub32315a11
Upload model-00136-of-00191.safetensors with huggingface_hubaad626f6
Upload model-00138-of-00191.safetensors with huggingface_hub6a42716a
Upload model-00139-of-00191.safetensors with huggingface_hub2b7c7b62
Upload model-00141-of-00191.safetensors with huggingface_hubf2720061
Upload model-00142-of-00191.safetensors with huggingface_hub852726fb
Upload model-00144-of-00191.safetensors with huggingface_hubab7356d4
Upload model-00145-of-00191.safetensors with huggingface_hub81959e65
Upload model-00147-of-00191.safetensors with huggingface_huba329715b
Upload model-00148-of-00191.safetensors with huggingface_hub587f52a7
Upload model-00150-of-00191.safetensors with huggingface_huba7fffbf1
Upload model-00151-of-00191.safetensors with huggingface_hub801e51f8
Upload model-00153-of-00191.safetensors with huggingface_hub5f4d1ff8
Upload model-00154-of-00191.safetensors with huggingface_hube249246a
Upload model-00156-of-00191.safetensors with huggingface_hub497da813
Upload model-00157-of-00191.safetensors with huggingface_hub1f94289f
Upload model-00159-of-00191.safetensors with huggingface_hub13587b92
Upload model-00160-of-00191.safetensors with huggingface_hub0d29c648
Upload model-00162-of-00191.safetensors with huggingface_hub3bf05c58
Upload model-00163-of-00191.safetensors with huggingface_hub421b0311
Upload model-00165-of-00191.safetensors with huggingface_hub59c884c6
Upload model-00166-of-00191.safetensors with huggingface_hub315751f3
Upload model-00168-of-00191.safetensors with huggingface_hub14a76d01
Upload model-00169-of-00191.safetensors with huggingface_hubba0ad720
Upload model-00171-of-00191.safetensors with huggingface_hub9abf1c29
Upload model-00172-of-00191.safetensors with huggingface_huba0600fb6
Upload model-00174-of-00191.safetensors with huggingface_hub99d8c41f
Upload model-00175-of-00191.safetensors with huggingface_hub923a3b01
Upload model-00177-of-00191.safetensors with huggingface_huba125bff1
Upload model-00178-of-00191.safetensors with huggingface_hub64cb0398
Upload model-00180-of-00191.safetensors with huggingface_hub7efe5ef5
Upload model-00181-of-00191.safetensors with huggingface_hub460ce67d
Upload model-00183-of-00191.safetensors with huggingface_hubf709dd32
Upload model-00184-of-00191.safetensors with huggingface_hub74cf6076
Upload model-00186-of-00191.safetensors with huggingface_hubf24ac790
Upload model-00187-of-00191.safetensors with huggingface_hubf283df8b
Upload model-00189-of-00191.safetensors with huggingface_hub7caea331
Upload model.safetensors.index.json with huggingface_hub55a753f8
mgoin

@ArthurZ are you going to land this soon?

ArthurZ changed pull request status to open
ArthurZ changed pull request status to merged
ArthurZ
 Meta Llama org

Sorry for the delay

152334H

why was this done? what is the difference between the 8-kv model and the 16-kv model?

Sign up or log in to comment