Context Length Set to 8K?
#4
by
Mazyod
- opened
As far as I can tell, context length is set to 8K on Ollama and in the config.json. Is this intended? The readme states context length should be 128K.
Hi I've answered this in a previously opened issue - https://huggingface.co./CohereForAI/aya-expanse-32b/discussions/1#671a6d73c34e087289d73364
Apologies for the duplicate, didn’t realize closed issues are hidden. Thank you.
Mazyod
changed discussion status to
closed