mergekit_moe_config.yml

base_model: chihoonlee10/T3Q-EN-DPO-Mistral-7B
gate_mode: hidden # one of "hidden", "cheap_embed", or "random"
dtype: bfloat16 # output dtype (float32, float16, or bfloat16)
## (optional)
experts_per_token: 2
experts:
  - source_model: Kukedlc/Jupiter-k-7B-slerp
    positive_prompts:
        - "This puzzle involves identifying a repeating pattern. Can you analyze the examples and complete the missing element?"
        - "These grids seem to follow a specific visual pattern. Can you analyze the examples and apply the pattern to solve the puzzle?"
        - "Look for a consistent rule in how the elements are arranged. Can you use that rule to predict the missing element?"
        - "This task requires applying logical deduction. Can you analyze the information and choose the answer that follows logically?"
        - "Reason through the cause-and-effect relationships in the examples. Can you use that logic to solve the puzzle?"
        - "Analyze the relationship between the input and output in the examples. Can you apply that relationship to solve the new problem?"
        - "This puzzle requires modifying the image based on a specific rule. Can you analyze the changes in the examples and apply them to solve the puzzle?"
        - "Focus on the visual changes demonstrated in the training examples. Can you replicate those changes to solve the new problem?"
        - "This task involves manipulating shapes or colors based on a pattern. Can you analyze the examples and apply the pattern to the new image?"
        - "These puzzles involve manipulating numbers according to a specific rule. Can you analyze the pattern and solve the missing number?"
        - "Focus on the mathematical operations demonstrated in the examples. Can you apply those operations to solve the new equation?"
        - "Look for relationships between the numbers in the training examples. Can you use that relationship to predict the missing number?"
        - "This task requires understanding the arrangement of objects in space. Can you analyze the movement patterns in the examples and predict the next step?"
        - "Focus on the spatial relationships between elements in the grids. Can you replicate those relationships to solve the new puzzle?"
        - "Analyze the rotation, reflection, or translation demonstrated in the examples. Can you apply that manipulation to solve the new problem?"  
  - source_model: InferenceIllusionist/Excalibur-7b-DPO
    positive_prompts:
        - "This passage contains factual information. Can you summarize the key details about [topic]?"
        - "Based on the information provided, what can you tell me about [entity]?"
        - "Is the following statement true or false according to the passage: [statement]?"
        - "What caused [event] to happen in the passage?"
        - "Why did [character] take the action of [action]?"
        - "If [condition] were true, what would likely happen next?"
        - "How are [entity A] and [entity B] similar/different?"
        - "Which option, [A] or [B], is more likely based on the information provided?"
        - "Rank the following options ([list]) based on [criteria] according to the passage."
        - "Does the following statement logically follow from the information provided: [statement]?"
        - "Identify any inconsistencies or contradictions in the passage."
        - "Can you draw a logical conclusion based on the evidence presented?"
        - "What can be inferred about [concept] based on the information provided?"
        - "What is the underlying meaning or implication of the author's statement?"
        - "Can you fill in the blanks with the most likely word(s) based on the context?"
        - "What are some potential consequences of [event]?"
        - "Can you generate creative solutions to the problem presented in the passage?"
        - "Based on the information provided, propose a course of action for [character]."
  - source_model: yam-peleg/Experiment21-7B
    positive_prompts:
        - "Be truthful and objective in your response. Avoid speculation or making claims that cannot be verified."
        - "Focus on providing factual information based on the evidence presented in the source material."
        - "If you are unsure about something, it's okay to say 'I don't know' or 'I can't find information to support that claim'."
        - "Be aware of potential biases in the source material and strive to present a neutral perspective."
        - "If a source seems biased, identify the bias and consider alternative viewpoints."
        - "Avoid using language that promotes stereotypes or prejudices."
        - "Cite your sources when referencing information from external materials."
        - "Acknowledge the limitations of your knowledge and the potential for different interpretations."
        - "Be transparent about your confidence level in your answer."
        - "Explain your reasoning process and how you arrived at your answer."
        - "Provide evidence to support your claims whenever possible."
        - "If there are multiple perspectives on an issue, present them fairly and objectively."
  - source_model: senseable/WestLake-7B-v2
    positive_prompts:
        - "This sentence contains a pronoun ('he' or 'she'). Pay close attention to the context to determine who the pronoun refers to."
        - "Identify the two potential referents for the pronoun ('he' or 'she') in this sentence. Analyze the context to choose the correct one."
        - "This scenario describes two individuals. Use the information provided to understand who the pronoun refers to in the sentence."
        - "Focus on the actions described in the sentence and the roles of the individuals involved. This will help determine the pronoun referent."
        - "Analyze the relationship between the individuals mentioned in the sentence. The pronoun likely refers to the one performing the action."
        - "Consider the animacy of the potential referents. Pronouns typically refer to animate beings (people or animals) in the context."
        - "Don't rely solely on the pronoun itself. Utilize the entire sentence and surrounding context to understand its meaning."
        - "Look for clues in the sentence that indicate who the pronoun refers to. This could include gender, possession, or actions described."
        - "Imagine the scenario described in the sentence. Visualizing the situation can help you identify the intended referent."
        - "Evaluate the plausibility of each potential referent for the pronoun. Choose the one that makes the most logical sense in the context."
        - "Think about the actions described and the roles of the individuals involved. Does it make more sense for one or the other to perform the action?"
        - "Consider the world knowledge you possess. Does the sentence describe a situation where one referent is more likely than the other?"