lllyasviel
/

omost-phi-3-mini-128k-8bits

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

omost-phi-3-mini-128k-8bits is Omost's phi-3-mini model with 128k context length in fp8.

Downloads last month: 46

Safetensors

Model size

3.82B params

Tensor type

F32

·

BF16

·

I8

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.