Llama 2 Chat 13B for RK3588
This is a conversion from https://huggingface.co/meta-llama/Llama-2-13b-chat-hf to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588.
Latest update: April 2024. Converted with RKLLM runtime 1.0.0. Not compatible with newer versions
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM:
https://huggingface.co/meta-llama/Llama-2-13b-chat-hf/blob/main/LICENSE.txt