Different rms_norm_eps

by djuna - opened 14 days ago

djuna

14 days ago

Hi,
I noticed that from 14B onward, the value of the base and instruct is different. is this intentional?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment