codegood commited on
Commit
e1fd8ba
1 Parent(s): eef5112

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +122 -0
README.md ADDED
@@ -0,0 +1,122 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Writer/Palmyra-Med-70B-32K
3
+ language:
4
+ - en
5
+ license: other
6
+ license_name: writer-open-model-license
7
+ license_link: https://writer.com/legal/open-model-license/
8
+ tags:
9
+ - instruct
10
+ - finetune
11
+ - DPO
12
+ - distillation
13
+ - heathcare
14
+ - medical
15
+ - clinical
16
+ - med
17
+ - lifescience
18
+ - Pharmaceutical
19
+ - Pharma
20
+ - Enterprise LLM
21
+ - Enterprise
22
+ - Enterprise ready
23
+ - mlc-ai
24
+ - MLC-Weight-Conversion
25
+ extra_gated_prompt: By clicking "Agree", you agree to the [License Agreement](https://writer.com/legal/open-model-license/)
26
+ and acknowledge Writer's [Privacy Policy](https://writer.com/legal/acceptable-use/).
27
+ extra_gated_fields:
28
+ Name: text
29
+ Email: text
30
+ Organization or Affiliation: text
31
+ Receive email updates and promotions on Writer products, services, and research?:
32
+ type: select
33
+ options:
34
+ - 'Yes'
35
+ - 'No'
36
+ I acknowledge that this model is for non-commercial use only unless I acquire a separate license from Writer: checkbox
37
+ widget:
38
+ - example_title: Palmyra-Med-70B-32k
39
+ messages:
40
+ - role: system
41
+ content: You are a highly knowledgeable and experienced expert in the healthcare
42
+ and biomedical field, possessing extensive medical knowledge and practical expertise.
43
+ - role: user
44
+ content: Does danzhi Xiaoyao San ameliorate depressive-like behavior by shifting
45
+ toward serotonin via the downregulation of hippocampal indoleamine 2,3-dioxygenase?
46
+ output:
47
+ text: Danzhi Xiaoyao San (DXS) exhibited significant antidepressant-like effects
48
+ in rats subjected to chronic unpredictable mild stress (CUMS), a commonly used
49
+ model for inducing depressive-like behavior. The administration of DXS led to
50
+ a notable reduction in the activity of indoleamine 2,3-dioxygenase (IDO) in
51
+ the hippocampus. This reduction in IDO activity is crucial because IDO is an
52
+ enzyme that catalyzes the degradation of tryptophan into kynurenine (Kyn), thereby
53
+ diverting tryptophan away from the serotonin (5-HT) synthesis pathway. By downregulating
54
+ IDO, DXS effectively shifts the balance of tryptophan metabolism towards increased
55
+ serotonin production, thereby enhancing the availability of serotonin. This
56
+ shift in the Kyn/5-HT pathway favoring serotonin is likely a key mechanism underlying
57
+ the antidepressant effects observed with DXS treatment. Enhanced serotonin levels
58
+ in the hippocampus are associated with improved mood and reduction of depressive
59
+ symptoms, suggesting that DXS could be a promising therapeutic agent for managing
60
+ depression.
61
+ model-index:
62
+ - name: Palmyra-Med-70B-32k
63
+ results: []
64
+ ---
65
+ ---
66
+ library_name: mlc-llm
67
+ base_model: Writer/Palmyra-Med-70B-32K
68
+ tags:
69
+ - mlc-llm
70
+ - web-llm
71
+ ---
72
+
73
+ # codegood/Palmyra-Med-70B-32K-q4f16_1-MLC
74
+
75
+ This is the [Palmyra-Med-70B-32K](https://huggingface.co/Writer/Palmyra-Med-70B-32K) model in MLC format `q4f16_1`.
76
+ The conversion was done using the [MLC-Weight-Conversion](https://huggingface.co/spaces/mlc-ai/MLC-Weight-Conversion) space.
77
+ The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
78
+
79
+ ## Example Usage
80
+
81
+ Here are some examples of using this model in MLC LLM.
82
+ Before running the examples, please install MLC LLM by following the [installation documentation](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
83
+
84
+ ### Chat
85
+
86
+ In command line, run
87
+ ```bash
88
+ mlc_llm chat HF://mlc-ai/codegood/Palmyra-Med-70B-32K-q4f16_1-MLC
89
+ ```
90
+
91
+ ### REST Server
92
+
93
+ In command line, run
94
+ ```bash
95
+ mlc_llm serve HF://mlc-ai/codegood/Palmyra-Med-70B-32K-q4f16_1-MLC
96
+ ```
97
+
98
+ ### Python API
99
+
100
+ ```python
101
+ from mlc_llm import MLCEngine
102
+
103
+ # Create engine
104
+ model = "HF://mlc-ai/codegood/Palmyra-Med-70B-32K-q4f16_1-MLC"
105
+ engine = MLCEngine(model)
106
+
107
+ # Run chat completion in OpenAI API.
108
+ for response in engine.chat.completions.create(
109
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
110
+ model=model,
111
+ stream=True,
112
+ ):
113
+ for choice in response.choices:
114
+ print(choice.delta.content, end="", flush=True)
115
+ print("\n")
116
+
117
+ engine.terminate()
118
+ ```
119
+
120
+ ## Documentation
121
+
122
+ For more information on MLC LLM project, please visit our [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](http://github.com/mlc-ai/mlc-llm).