Rope scaling value?

#2
by jurassicpark - opened

In the config.json, I don't see any rope scaling values, and the context len is set to 4096.

For inference, does a rope scaling value need to be set? (Also linear or dynamic?)

Thanks!

Linear, scale = 8

Sign up or log in to comment