Llama3.1-8B-PlumMath / mergekit_config.yml
sequelbox's picture
ddfb51ccc772f847fbc19d649c0375dc7f8bc9dc2a1a338d52da1d80a16baa75
c0b0146 verified
raw
history blame
No virus
337 Bytes
merge_method: della
dtype: bfloat16
parameters:
normalize: true
models:
- model: ValiantLabs/Llama3.1-8B-ShiningValiant2
parameters:
density: 0.5
weight: 0.3
- model: ValiantLabs/Llama3.1-8B-Cobalt
parameters:
density: 0.5
weight: 0.2
merge_method: della
base_model: meta-llama/Llama-3.1-8B-Instruct