Merging technique

by khoantap - opened Aug 23, 2023

Aug 23, 2023

Hi, Thank you for sharing such a great model.
Could you elaborate on how the 2 models were merge? Was it merged by combining the lora weight to the base model? Was any further finetuning conduct?

Thank you

odellus

Aug 24, 2023

Reading the paper it looks like yeah they just apply the lora adapter to merge.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment