Create AK
Browse files
AK
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
name: AK Model
|
| 2 |
+
context_size: 2048
|
| 3 |
+
f16: true
|
| 4 |
+
threads: 11
|
| 5 |
+
gpu_layers: 90
|
| 6 |
+
mmap: true
|
| 7 |
+
parameters:
|
| 8 |
+
# CAMB-AI/MARS5-TTS
|
| 9 |
+
model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
|
| 10 |
+
temperature: 0.2
|
| 11 |
+
top_k: 40
|
| 12 |
+
top_p: 0.95
|
| 13 |
+
template:
|
| 14 |
+
|
| 15 |
+
chat: &template |
|
| 16 |
+
Instruct: {{Text}}
|
| 17 |
+
Output: {{Speech}}
|
| 18 |
+
#Convert text to speech
|
| 19 |
+
completion: *template
|
| 20 |
+
## Important! Substitute with your gist's URL!
|
| 21 |
+
docker run -p 8080:8080 localai/localai:v2.18.1-ffmpeg-corehttps://gist.github.com/ahiyan357/06846661e2fe11eb5ea0246432291d74
|