Hugging Face's logo

Neural Magic

company
Verified
https://neuralmagic.com/
neuralmagic
neuralmagic
Activity Feed

AI & ML interests

LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV

Recent Activity

dsikka  updated a model 8 days ago
neuralmagic/Llama-3.2-1B-quantized.w8a8
mgoin  updated a model 15 days ago
neuralmagic/pixtral-12b-FP8-dynamic
mgoin  updated a model about 1 month ago
neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic
View all activity

neuralmagic's activity

dsikka 
updated a model 8 days ago
mgoin 
updated a model 15 days ago
mgoin 
updated 3 models about 1 month ago
nm-research 
updated 6 models about 1 month ago
dsikka 
in neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16 about 1 month ago

Model only outputs "!!!!!!!!!!"

1
#1 opened about 1 month ago by
mrhendrey
markurtz 
in neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8-dynamic about 1 month ago

What is the difference between this and "neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8"

1
#1 opened about 1 month ago by
RonanMcGovern
nm-research 
updated a model about 1 month ago
mgoin 
in neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic about 1 month ago

Model does not run with VLLM

2
#3 opened about 1 month ago by
aswad546
nm-research 
updated a collection about 1 month ago
mgoin 
in neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic about 1 month ago

Thanks!
#2 opened about 2 months ago by
Jindows
nm-research 
updated a model about 1 month ago