cgus commited on
Commit
2dede9b
1 Parent(s): 7fca729

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -8
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: apache-2.0
3
  datasets:
4
  - FreedomIntelligence/ApolloMoEDataset
5
  language:
@@ -50,12 +50,28 @@ language:
50
  metrics:
51
  - accuracy
52
  base_model:
53
- - google/gemma-2-9b
54
  pipeline_tag: question-answering
55
  tags:
56
  - biology
57
  - medical
58
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  # Democratizing Medical LLMs For Much More Languages
60
 
61
  Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
@@ -68,7 +84,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
68
 
69
 
70
 
71
- ![Apollo](assets/apollo_medium_final.png)
72
 
73
 
74
  ## 🌈 Update
@@ -82,7 +98,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
82
  <details>
83
  <summary>Click to view the Languages Coverage</summary>
84
 
85
- ![ApolloMoE](assets/languages.png)
86
 
87
  </details>
88
 
@@ -92,7 +108,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
92
  <details>
93
  <summary>Click to view the MoE routing image</summary>
94
 
95
- ![ApolloMoE](assets/hybrid_routing.png)
96
 
97
  </details>
98
 
@@ -106,7 +122,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
106
  <details>
107
  <summary>Click to view the Dense Models Results</summary>
108
 
109
- ![ApolloMoE](assets/dense_results.png)
110
 
111
  </details>
112
 
@@ -117,7 +133,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
117
  <details>
118
  <summary>Click to view the Post-MoE Models Results</summary>
119
 
120
- ![ApolloMoE](assets/post_moe_results.png)
121
 
122
  </details>
123
 
@@ -140,7 +156,7 @@ Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish,
140
 
141
  <details><summary>Click to expand</summary>
142
 
143
- ![ApolloMoE](assets/Dataset.png)
144
 
145
  - [Data category](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus/tree/main/train)
146
 
 
1
  ---
2
+ license: gemma
3
  datasets:
4
  - FreedomIntelligence/ApolloMoEDataset
5
  language:
 
50
  metrics:
51
  - accuracy
52
  base_model:
53
+ - FreedomIntelligence/Apollo2-9B
54
  pipeline_tag: question-answering
55
  tags:
56
  - biology
57
  - medical
58
  ---
59
+ # Apollo2-9B-exl2
60
+ Original model: [Apollo2-9B](https://huggingface.co/FreedomIntelligence/Apollo2-9B)
61
+ Made by: [FreedomIntelligence](https://huggingface.co/FreedomIntelligence)
62
+ ## Quants
63
+ [4bpw h6 (main)](https://huggingface.co/cgus/Apollo2-9B-exl2/tree/main)
64
+ [4.5bpw h6](https://huggingface.co/cgus/Apollo2-9B-exl2/tree/4.5bpw-h6)
65
+ [5bpw h6](https://huggingface.co/cgus/Apollo2-9B-exl2/tree/5bpw-h6)
66
+ [6bpw h6](https://huggingface.co/cgus/Apollo2-9B-exl2/tree/6bpw-h6)
67
+ [8bpw h8](https://huggingface.co/cgus/Apollo2-9B-exl2/tree/8bpw-h8)
68
+
69
+ ## Quantization notes
70
+ Made with Exllamav2 0.2.3 with the default dataset. This model needs software with Exllamav2 library such as Text-Generation-WebUI, TabbyAPI, etc.
71
+ This model has to fit your GPU to be usable and it's mainly meant for RTX cards on Windows/Linux or AMD on Linux.
72
+ For computers with incompatible hardware it's better to use GGUF versions of the model, you can find them [here](https://huggingface.co/models?other=base_model:quantized:FreedomIntelligence/Apollo2-9B).
73
+
74
+ # Original model card
75
  # Democratizing Medical LLMs For Much More Languages
76
 
77
  Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
 
84
 
85
 
86
 
87
+ ![Apollo](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/apollo_medium_final.png)
88
 
89
 
90
  ## 🌈 Update
 
98
  <details>
99
  <summary>Click to view the Languages Coverage</summary>
100
 
101
+ ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/languages.png)
102
 
103
  </details>
104
 
 
108
  <details>
109
  <summary>Click to view the MoE routing image</summary>
110
 
111
+ ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/hybrid_routing.png)
112
 
113
  </details>
114
 
 
122
  <details>
123
  <summary>Click to view the Dense Models Results</summary>
124
 
125
+ ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/dense_results.png)
126
 
127
  </details>
128
 
 
133
  <details>
134
  <summary>Click to view the Post-MoE Models Results</summary>
135
 
136
+ ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/post_moe_results.png)
137
 
138
  </details>
139
 
 
156
 
157
  <details><summary>Click to expand</summary>
158
 
159
+ ![ApolloMoE](https://huggingface.co/FreedomIntelligence/Apollo2-9B/blob/main/assets/Dataset.png)
160
 
161
  - [Data category](https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus/tree/main/train)
162