Most models aren't useable directly on HuggingFace. Even "small" models (like llama3-8bs) require expensive enough hardware that they aren't stood up to operate for free. | |
At featherless, we've taken a different approach, and are able to serve models "serverlessly" at an entirely different scale. | |
This space allows you to test any 15B or smaller model directly within HF, but we have bigger models too. Check out https://featherless.ai to see the full range of supported models. |