BlackSamorez
commited on
Commit
•
bcbdc05
1
Parent(s):
c09a2c9
Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ Article: https://blacksamorez.substack.com/p/aqlm-executorch-android
|
|
4 |
|
5 |
## Usage
|
6 |
|
7 |
-
- Download and install the `.apk` file on your Android phone.
|
8 |
- Download the `.pte` and `.model` files and put them into the `/data/local/tmp/llama` folder on your Android phone.
|
9 |
- Running the app you will see the option to load the `.pte` and `.model` files. After loading them, you'll be able to chat with the model.
|
10 |
|
|
|
4 |
|
5 |
## Usage
|
6 |
|
7 |
+
- Download and install the `.apk` file on your Android phone. (`llama3-aqlm.apk` for ~1.1 tok/s at low power consumption. `llama3-aqlm-4cores.apk` for ~2.7 tok/s at high loads)
|
8 |
- Download the `.pte` and `.model` files and put them into the `/data/local/tmp/llama` folder on your Android phone.
|
9 |
- Running the app you will see the option to load the `.pte` and `.model` files. After loading them, you'll be able to chat with the model.
|
10 |
|