You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

decisionslab/Phi-3.5-mini-instruct-4bit-HK

The Model decisionslab/Phi-3.5-mini-instruct-4bit-HK was converted to MLX format from microsoft/Phi-3.5-mini-instruct using mlx-lm version 0.17.1.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("decisionslab/Phi-3.5-mini-instruct-4bit-HK")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Downloads last month
4
Safetensors
Model size
597M params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Collection including decisionslab/Phi-3.5-mini-instruct-4bit-HK