Wrong position embedding size?
#1
by
lanking
- opened
Should that be 131072 as of 128k?
4k is 4096, 8k is 8192. Do powers of two and you get 131072 for 128k.
lanking
changed discussion status to
closed