Aphrodite/VLLM/SGLang all refuse to load this model
2
#5 opened 2 months ago
by
fullstack
Dealing with the split safetensor files
#4 opened 3 months ago
by
BallisticAI
How to create gguf fromm this
5
#3 opened 3 months ago
by
DerErnst
hidden state is nan
1
#2 opened 3 months ago
by
ShelterW
whats the best tool to run this model
1
#1 opened 4 months ago
by
Boffy