merged_llemma_codeLlama-ties / mergekit_config.yml
JyoP's picture
Upload folder using huggingface_hub
25eb0be
raw
history blame contribute delete
303 Bytes
models:
- model: codellama/CodeLlama-7b-hf
parameters:
density: 0.5
weight: 0.5
- model: EleutherAI/llemma_7b
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: codellama/CodeLlama-7b-hf
parameters:
normalize: true
int8_mask: true
dtype: float16