Hugging Face's logo
mobicham's picture
36 5 29

mobicham

mobicham
21world's profile picture victor's profile picture appoose's profile picture
·
https://www.mobiuslabs.com/

AI & ML interests

Model pruning, quantization, computer vision, LLMs

Recent Activity

new activity 3 days ago
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0:Open Source Distillation Approach?
new activity 3 days ago
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1:Will there be a 32b and 70b too?
liked a model 4 days ago
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1
View all activity

Organizations

Mobius Labs GmbH's profile picture Distillation Hugs's profile picture

mobicham's activity

New activity in mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0 3 days ago

Open Source Distillation Approach?

1
#1 opened 10 days ago by
nbroad
New activity in mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1 3 days ago

Will there be a 32b and 70b too?

1
#1 opened 3 days ago by
AlgorithmicKing
New activity in open-llm-leaderboard/deepseek-ai__DeepSeek-R1-Distill-Qwen-1.5B-details 12 days ago

Benchmark numbers are too low and don't match the numbers run locally
#1 opened 12 days ago by
mobicham
New activity in mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq 5 months ago

CPU support

1
#2 opened 5 months ago by
Essa20001
New activity in mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq 6 months ago

Decensored version?

5
#1 opened 6 months ago by
KnutJaegersberg
New activity in mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib 6 months ago

Oobabooga?

1
#1 opened 6 months ago by
AIGUYCONTENT
New activity in mobiuslabsgmbh/Llama-3-8b-instruct_2bitgs64_hqq 6 months ago

the coder from the model card has errors when executing on google colab

1
#1 opened 6 months ago by
vasilee
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 6 months ago

QUANTIZED VERSION GGUF

1
#5 opened 6 months ago by
ar08
New activity in open-llm-leaderboard/open_llm_leaderboard 8 months ago

GSM8K (5-shot) performance is quite different compared to running lm_eval locally

5
#755 opened 9 months ago by
mobicham
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 9 months ago

Details about this model

1
#4 opened 9 months ago by
at676

Make it usageable for cpu

2
#3 opened 9 months ago by
ar08
New activity in mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq 10 months ago

Error with adapter ?

3
#2 opened 10 months ago by
nelkh

Any plan for making HQQ+ 2bit quant for Mixtral or larger models?

1
#1 opened 10 months ago by
raincandy-u
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 10 months ago

Runs out of memory on free tier Google Colab

3
#3 opened 10 months ago by
sudhir2016
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bitgs8-metaoffload-HQQ 10 months ago

Either README is wrong, or the wrong model file is uploaded?

1
#1 opened 10 months ago by
andysalerno
New activity in liuhaotian/llava-v1.6-34b 10 months ago

Quantizations?

2
#1 opened about 1 year ago by
musicurgy
New activity in mobiuslabsgmbh/aanaphi2-v0.1 11 months ago

Which Dataset ?

1
#4 opened 11 months ago by
xxxTEMPESTxxx

How do I run this on cpu?

5
#3 opened 11 months ago by
ARMcPro
New activity in mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ 11 months ago

gguf format

1
#2 opened 11 months ago by
GyroO
New activity in mobiuslabsgmbh/aanaphi2-v0.1 11 months ago

Stop overgenerating. Need EOS token?

11
#1 opened 11 months ago by
vicplus