Spaces:
Running
Running
config conversion from llava repo (2)
#4
by
mjbooo
- opened
Hi!
Previously, I was informed that I could convert a custom LLaVA 1.5 model, trained using the original author's repository (https://github.com/haotian-liu/LLaVA), with the provided script (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/convert_llava_weights_to_hf.py).
Can I use the same script for a custom LLaVA-OneVision model trained with the LLaVA-NeXT repository (https://github.com/LLaVA-VL/LLaVA-NeXT) as well?
Thank you again for the excellent work!
Hi,
Each model in the Transformers library has a dedicated conversion script, see here for LLaVa-OneVision: https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava_onevision/convert_llava_onevision_weights_to_hf.py.