Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
13.5
TFLOPS
37
39
67
Marc Sun
marcsun13
Follow
nbroad's profile picture
osanseviero's profile picture
Solshine's profile picture
99 followers
·
129 following
_marcsun
SunMarc
AI & ML interests
LLM, Quantization, Training, Inference
Articles
Introducing SynthID Text
18 days ago
•
34
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
Sep 18
•
198
Accelerate 1.0.0
Sep 13
•
50
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
Jul 23
•
213
quanto: a pytorch quantization toolkit
Mar 18
•
31
Overview of natively supported quantization schemes in 🤗 Transformers
Sep 12, 2023
•
10
Making LLMs lighter with AutoGPTQ and transformers
Aug 23, 2023
•
32
Organizations
marcsun13
's activity
All
Models
Datasets
Spaces
Papers
Collections
Community
Posts
Upvotes
Likes
New activity in
meta-llama/Llama-3.1-405B-Instruct-FP8
4 months ago
Upload folder using huggingface_hub
2
#4 opened 4 months ago by
marcsun13
New activity in
meta-llama/Llama-3.1-405B-FP8
4 months ago
Upload folder using huggingface_hub
2
#8 opened 4 months ago by
marcsun13
New activity in
meta-llama/Llama-3.1-405B-Instruct
4 months ago
Update original/mp8/README.md
#2 opened 4 months ago by
marcsun13
Update original/mp16/README.md
#1 opened 4 months ago by
marcsun13
New activity in
meta-llama/Llama-3.1-405B
4 months ago
Update original/mp16/README.md
#5 opened 4 months ago by
marcsun13
Update original/mp8/README.md
#4 opened 4 months ago by
marcsun13
New activity in
meta-llama/Llama-3.1-405B-Instruct-FP8
4 months ago
Upload folder using huggingface_hub
2
#2 opened 4 months ago by
marcsun13
New activity in
meta-llama/Llama-3.1-405B-FP8
4 months ago
Upload folder using huggingface_hub
2
#7 opened 4 months ago by
marcsun13
[WIP] Upload folder using huggingface_hub (multi-commit 015597a9a84fd3a9cd8c9844ceb2b85ce89bb1a387968fd94159cb19e4200044)
#6 opened 4 months ago by
marcsun13
Upload folder using huggingface_hub
2
#4 opened 4 months ago by
marcsun13
Upload folder using huggingface_hub
2
#3 opened 4 months ago by
marcsun13
Upload folder using huggingface_hub
2
#2 opened 4 months ago by
marcsun13
Upload folder using huggingface_hub
2
#1 opened 4 months ago by
marcsun13
New activity in
google/flan-t5-xxl
8 months ago
ValueError: Need either a `state_dict` or a `save_folder` containing offloaded weights.
5
#53 opened over 1 year ago by
tuannguyends
New activity in
huggingface/documentation-images
8 months ago
Upload NousResearch-Llama-2-7b-hf_Perplexity.png
1
#292 opened 8 months ago by
marcsun13
Upload NousResearch-Llama-2-7b-hf_Perplexity.png
#291 opened 8 months ago by
marcsun13
New activity in
mlx-community/Llama-2-7b-chat-4-bit
11 months ago
Update README.md
1
#4 opened 11 months ago by
marcsun13
Update README.md
#3 opened 11 months ago by
marcsun13
Update README.md
#3 opened 11 months ago by
marcsun13
New activity in
mlx-community/Mistral-7B-Instruct-v0.2-4-bit
11 months ago
Update README.md
#5 opened 11 months ago by
marcsun13
Load more