ddh0
/

Mistral-10.7B-Instruct-v0.2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mistral-10.7B-Instruct-v0.2 / mergekit_config.yml

ddh0's picture

Create mergekit_config.yml

2b2e95b verified 6 months ago

history blame contribute delete

No virus

195 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 24]
	model: Mistral-7B-Instruct-v0.2
	- sources:
	- layer_range: [8, 32]
	model: Mistral-7B-Instruct-v0.2