Running Llama on Android Device
#7
by
Shivagond
- opened
Are there any instructions or documentation on how to run Llama model on android device ?
We're actively working to provide more information on this topic.
@shreyajn
Any update?
One more question. How do you process with tokinzer? I want to use tokenizer to get text from output_ids. Could you give me a reference?
@AICoding91 , please take a look at our instructions on running Llama models on device via AI Hub: https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/llama_v2_7b_chat_quantized/README.md