Smaug-LLaMa-3-8B-Instruct in the works?
Will you guys make an 8B version too? Please 🙏 😋
Actually we already have one! https://huggingface.co./abacusai/Llama-3-Smaug-8B This doesn't have instruct in the name but it is an instruct model. Although we have improved on the recipe since the 8B release so we might update it soon...
Actually we already have one! https://huggingface.co./abacusai/Llama-3-Smaug-8B This doesn't have instruct in the name but it is an instruct model. Although we have improved on the recipe since the 8B release so we might update it soon...
I think they wanted Smaug 8B trained on LLama 8B Instruct instead of the base model. Models trained on instruct tend to do a lot better, as I'm sure you have noticed with Smaug 70B Instruct.
It was trained on Llama 8B Instruct! We just didn't say so in the model card. I've fixed that now.
@ArkaAbacus
May I ask if you are already planning to update the 8B model with the new recipe and if you have an approximate ETA?
No hurry, I'm just planning to make my own quantization for the ollama library and would like to avoid the new model comes out the day after I'm done with it :P