mlabonne
/

Meta-Llama-3-120B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-120B-Instruct / mergekit_config.yml

mlabonne's picture

Upload folder using huggingface_hub

45fcb6c verified 6 months ago

history blame contribute delete

644 Bytes


	slices:
	- sources:
	- layer_range: [0, 20]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [10, 30]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [20, 40]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [30, 50]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [40, 60]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [50, 70]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	- sources:
	- layer_range: [60, 80]
	model: meta-llama/Meta-Llama-3-70B-Instruct
	merge_method: passthrough
	dtype: float16