Stealth
Collection
This is designed to enhance Mathematical and Logical abilities.
β’
5 items
β’
Updated
β’
1
ChatML
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
You can run this model using Jan Desktop on Mac, Windows, or Linux.
Jan is an open source, ChatGPT alternative that is:
1337
with OpenAI compatible endpointsJan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.
Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 70.68 |
AI2 Reasoning Challenge (25-Shot) | 66.38 |
HellaSwag (10-Shot) | 86.14 |
MMLU (5-Shot) | 64.33 |
TruthfulQA (0-shot) | 54.23 |
Winogrande (5-shot) | 80.74 |
GSM8k (5-shot) | 72.25 |