What's the context window on Orenguteng/Llama-3-8B-Lexi-Uncensored-GGUF?
#4
by
askyforever
- opened
Hi Orenguteng,
Just wondering what's the context window on this, sorry if noob question. I was thinking originally context window is set by the foundational model, but now starting to see and think it is dependent on the tuned version.
I'm deploying this model as something like continuing a story. I think I got lucky on my first shot and it remembered alot of things, but 10 runs in a row after so far, it forgets everything with the same base story given and system prompt.
Thanks
@askyforever The context window is as the original 8k, I'm experimenting longer context windows atm
Thanks that would be very nice to have!
askyforever
changed discussion status to
closed