Hugging Face's logo

darthhexx
/
Phi-3-medium-128k-instruct-fp8

Text Generation
Transformers
Safetensors
multilingual
phi3
nlp
code
conversational
custom_code
text-generation-inference
Inference Endpoints
fp8
Model card Files Community
2

Model Summary

This moded is an FP8 quantization of the microsoft/Phi-3-medium-128k-instruct model in safetensors format.

License

The model is licensed under the MIT license.

Downloads last month
19
Safetensors
Model size
14B params
Tensor type
BF16
·
F8_E4M3
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.