AMKCode commited on
Commit
1d1f18c
1 Parent(s): 936e38e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: google/gemma-2-2b-jpn-it
3
+ language:
4
+ - ja
5
+ library_name: transformers
6
+ license: gemma
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - conversational
10
+ - mlc-ai
11
+ - MLC-Weight-Conversion
12
+ extra_gated_heading: Access Gemma on Hugging Face
13
+ extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and
14
+ agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging
15
+ Face and click below. Requests are processed immediately.
16
+ extra_gated_button_content: Acknowledge license
17
+ ---
18
+
19
+ # AMKCode/gemma-2-2b-jpn-it-q4f32_1-MLC
20
+ This model was compiled using MLC-LLM with q4f32_1 quantization from [google/gemma-2-2b-jpn-it](https://huggingface.co/google/gemma-2-2b-jpn-it).
21
+ The conversion was done using the [MLC-Weight-Conversion](https://huggingface.co/spaces/mlc-ai/MLC-Weight-Conversion) space.
22
+
23
+ To run this model, please first install [MLC-LLM](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
24
+
25
+ To chat with the model on your terminal:
26
+ ```bash
27
+ mlc_llm chat HF://AMKCode/gemma-2-2b-jpn-it-q4f32_1-MLC
28
+ ```
29
+
30
+ For more information on how to use MLC-LLM, please visit the MLC-LLM [documentation](https://llm.mlc.ai/docs/index.html).