KoboldAI

community

AI & ML interests

Fiction Models made by the KoboldAI community. All uploaded models are either uploaded by their original finetune authors or with the finetune authors permission. Visit our Discord at https://koboldai.org/discord

Recent Activity

concedo updated a model 7 days ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Henk717 updated a Space 16 days ago

KoboldAI/Koboldcpp-Tiefighter

concedo updated a Space 16 days ago

KoboldAI/Koboldcpp-Tiefighter

View all activity

KoboldAI's activity

concedo

updated a model 7 days ago

KoboldAI/LLaMA2-13B-Tiefighter-GGUF

Updated 7 days ago • 54.6k • 85

Henk717

updated a Space 16 days ago

Running on T4

🦎

Koboldcpp Tiefighter

concedo

updated a Space 16 days ago

Running on T4

🦎

Koboldcpp Tiefighter

Henk717

updated 2 models 30 days ago

KoboldAI/Llama-3.1-8B-BookAdventures-GGUF

Updated 30 days ago • 2.27k • 1

KoboldAI/Llama-3.1-8B-BookAdventures

Updated 30 days ago • 116 • 5

elinas

posted an update 5 months ago

Post

2268

We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B