Hugging Face's logo
Mark Mealman's picture
20 12

Mark Mealman

Dracones
vurkan's profile picture asdfsafd's profile picture Unsterile's profile picture
·

AI & ML interests

None yet

Organizations

MLX Community's profile picture

Dracones's activity

New activity in Wi-zz/joy-caption-pre-alpha 2 months ago

Fix for multiple graphics cards

4
#2 opened 3 months ago by Ataylorm

weights_only=True error

4
#4 opened 3 months ago by Dracones
New activity in NeverSleep/Llama-3-Lumimaid-70B-v0.1 6 months ago

feedback

22
#2 opened 6 months ago by Szarka
New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 7 months ago

3.75 please?

2
#2 opened 7 months ago by jackboot
New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_3.0bpw 7 months ago

2.75 bpw high EQ bench

1
#1 opened 7 months ago by koesn
New activity in Qwen/CodeQwen1.5-7B-Chat 7 months ago

EXL2 Quants are up

2
#2 opened 7 months ago by Dracones
New activity in Dracones/WizardLM-2-8x22B_exl2_2.5bpw 7 months ago

Could you help to create the 3.25bpw model so it can fits on A100?

4
#1 opened 7 months ago by davideuler
New activity in Dracones/WizardLM-2-8x22B_exl2_4.0bpw 7 months ago

Can this version be loaded with vllm?

2
#1 opened 7 months ago by wawoshashi
New activity in fireworks-ai/mixtral-8x22b-instruct-oh 7 months ago

A good tune
#3 opened 7 months ago by Dracones
New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 7 months ago

Question about prompting and System prompt in Vicuna format

4
#10 opened 7 months ago by houmie
New activity in Dracones/miqu-1-70b-sf_exl2_2.25bpw 7 months ago

Update README.md

2
#1 opened 7 months ago by vvekthkr
New activity in Dracones/Midnight-Miqu-70B-v1.5_exl2_4.0bpw 7 months ago

Measurments

4
#1 opened 8 months ago by altomek
New activity in miqudev/miqu-1-70b 8 months ago

Any chance anyone is quantizing this into a 2.4bpw EXL2 version for those of us with a single 24GB video cards?

1
#30 opened 8 months ago by clevnumb
New activity in Dracones/Midnight-Miqu-70B-v1.0_exl2_2.24bpw 8 months ago

3.5bpw request

4
#1 opened 8 months ago by Gesard
New activity in Dracones/Midnight-Miqu-103B-v1.0_exl2_4.25bpw 8 months ago

Error

3
#1 opened 8 months ago by Hardcore7651
New activity in sophosympatheia/Midnight-Miqu-103B-v1.0 8 months ago

EXL2 Quants

9
#2 opened 8 months ago by Dracones

GGUF Quants

2
#3 opened 8 months ago by Dracones
New activity in sophosympatheia/Midnight-Miqu-70B-v1.0 8 months ago

5.0 bpw exl2 quant request

4
#2 opened 8 months ago by BeefyRook
New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 9 months ago

VRAM requirements

8
#1 opened 9 months ago by sophosympatheia
New activity in nsfwthrowitaway69/Venus-103b-v1.0 11 months ago

Excellent model

4
#1 opened 11 months ago by Dracones