CohereForAI
/

c4ai-command-r-plus-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (7)

请问这个4bit模型支持vllm启动吗？

#11 opened 8 months ago by

AWQ quantised?

#8 opened 10 months ago by

Possible to do inference on long contexts with limited VRAM?

#6 opened 10 months ago by

Excellant model, fine tuning resources

#5 opened 11 months ago by

Running on 3x24 GB RAM?

#3 opened 11 months ago by