Can anyone extend Stheno to 10-14B?

#5
by Varkoyote - opened

If possible, I would really appreciate a version of Stheno with more parameters. The only problem I've faced with this model is a loss of coherence for long stories, otherwise it's nearly perfect. If anyone could make a bigger version that would allow it to be slightly smarter (or less hallucinating), that would be the dream... thanks!

Nevermind, I just realized there is already a 15B version to try!

Got the same problem, 8k context is cool for short dialoques, but longer rpg action does need more power

Sign up or log in to comment