Grafted-Hermetic-Platypus-C-2x7B / mergekit_moe_config.yml
lodrick-the-lafted's picture
Upload folder using huggingface_hub
7de81d0 verified
base_model: lodrick-the-lafted/Platyboros-Instruct-7B
gate_mode: hidden
dtype: bfloat16
experts:
- source_model: lodrick-the-lafted/Platyboros-Instruct-7B
positive_prompts: ["math", "gsm8k", "algebra", "problem solving", "instruct", "geometry", "grade school math"]
- source_model: lodrick-the-lafted/Hermes-Instruct-7B-217K
positive_prompts: ["instruct", "roleplay", "coding", "general purpose"]