Is it possible to use the pre-trained PEFT model with other models with different parameters?

#17
by NovaYear - opened

TR: dostlar merhaba, şimdi biz eğitimden sonra, base ve peft modeli ayrı şekilde kullanıyoruz, eğitirken "CohereForAI/aya-23-8b" yani 8B modeli kullanıldı, aynı modelin birde daha çok parametreli "CohereForAI/aya-23-35b" yani 35B olanı var. ben 8B modeli ile fine tune ettiğim peft modelini 35B modeli ile kullanabilir miyim ?
EN: Hello friends, now after the training, we use the base and peft model separately. While training, the "CohereForAI/aya-23-8b", i.e. 8B model was used. The same model also has a more parameterized "CohereForAI/aya-23-35b", i.e. 35B model. . Can I use the PEFT model, which I fine tuned with the 8B model, with the 35B model?
@ahmetustun

Sign up or log in to comment