PrunaAI
/

Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Inference Endpoints

Model card Files Files and versions Community

Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Commit History

Upload Phi-3-mini-128k-instruct.Q5_1.gguf with huggingface_hub

30c8b54
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q3_K_M.gguf with huggingface_hub

1713412
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.fp16.bin with huggingface_hub

b489eb9
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ1_S.gguf with huggingface_hub

1874ab8
verified

johnrachwanpruna commited on Apr 26

Upload README.md with huggingface_hub

83904a5
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ2_M.gguf with huggingface_hub

977e445
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ3_XS.gguf with huggingface_hub

bbc6cce
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ3_XXS.gguf with huggingface_hub

e53c059
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ2_S.gguf with huggingface_hub

41f7e83
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q2_K.gguf with huggingface_hub

0dc8f76
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ2_XXS.gguf with huggingface_hub

1c6ad2a
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q3_K_L.gguf with huggingface_hub

959f657
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.IQ2_XS.gguf with huggingface_hub

48715ff
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q3_K_S.gguf with huggingface_hub

643faac
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q5_K_M.gguf with huggingface_hub

dc7879b
verified

johnrachwanpruna commited on Apr 26

Upload Phi-3-mini-128k-instruct.Q5_0.gguf with huggingface_hub

a16f25f
verified

johnrachwanpruna commited on Apr 26

Update README.md

8067570
verified

johnrachwanpruna commited on Apr 25

Upload Phi-3-mini-128k-instruct.Q6_K.gguf with huggingface_hub

666c0d5
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ3_S.gguf with huggingface_hub

6fdb6b0
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q4_K_S.gguf with huggingface_hub

13cdc2f
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q8_0.gguf with huggingface_hub

a3bc7f0
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q4_K_M.gguf with huggingface_hub

455cd65
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.imatrix.dat with huggingface_hub

36f3efd
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q4_0.gguf with huggingface_hub

86d50b3
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ1_M.gguf with huggingface_hub

402d157
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q5_K_S.gguf with huggingface_hub

03ab459
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ4_NL.gguf with huggingface_hub

c295bdc
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ3_M.gguf with huggingface_hub

37eaeb9
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ4_XS.gguf with huggingface_hub

16480eb
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q4_1.gguf with huggingface_hub

ef6a457
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q5_1.gguf with huggingface_hub

9da29fe
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q3_K_M.gguf with huggingface_hub

797d27c
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.fp16.bin with huggingface_hub

6e142cd
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ1_S.gguf with huggingface_hub

4f78631
verified

johnrachwanpruna commited on Apr 24

Upload README.md with huggingface_hub

f410df1
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ2_M.gguf with huggingface_hub

b11bc29
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ3_XS.gguf with huggingface_hub

0921211
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ3_XXS.gguf with huggingface_hub

9210ffa
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ2_S.gguf with huggingface_hub

d010e2b
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q2_K.gguf with huggingface_hub

51a96f9
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ2_XXS.gguf with huggingface_hub

43c3627
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q3_K_L.gguf with huggingface_hub

75a7e7a
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ2_XS.gguf with huggingface_hub

a00a13b
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q3_K_S.gguf with huggingface_hub

7e72533
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q5_K_M.gguf with huggingface_hub

5217a63
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q5_0.gguf with huggingface_hub

ba11176
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.Q6_K.gguf with huggingface_hub

4cde025
verified

johnrachwanpruna commited on Apr 24

Upload Phi-3-mini-128k-instruct.IQ3_S.gguf with huggingface_hub

de454ba
verified

johnrachwanpruna commited on Apr 23

Upload Phi-3-mini-128k-instruct.Q4_K_S.gguf with huggingface_hub

1d00db7
verified

johnrachwanpruna commited on Apr 23

Upload Phi-3-mini-128k-instruct.Q8_0.gguf with huggingface_hub

3ec8007
verified

johnrachwanpruna commited on Apr 23