Rope scaling value?
#2
by
jurassicpark
- opened
In the config.json, I don't see any rope scaling values, and the context len is set to 4096.
For inference, does a rope scaling value need to be set? (Also linear or dynamic?)
Thanks!
Linear, scale = 8