Hugging Face's logo

v2ray
/
GPT4chan-8B-FP8

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
v2ray commited on
Commit
f4f51a9
·
1 Parent(s): eec15d9

Added banner.

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -10,6 +10,8 @@ pipeline_tag: text-generation
10
  library_name: transformers
11
  ---
12
  # GPT4chan 8B FP8
 
 
13
  This model is [v2ray/GPT4chan-8B](https://huggingface.co/v2ray/GPT4chan-8B) quantized to fp8 using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor).
14
 
15
  Trained using 8x H100 with global batch size 64, using 2e-4 learning rate, for 4000 steps, which is approximately 5 epochs.
 
10
  library_name: transformers
11
  ---
12
  # GPT4chan 8B FP8
13
+ ![GPT4chan Banner](https://huggingface.co/v2ray/GPT4chan-24B-QLoRA/resolve/main/images/banner.avif)
14
+
15
  This model is [v2ray/GPT4chan-8B](https://huggingface.co/v2ray/GPT4chan-8B) quantized to fp8 using [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor).
16
 
17
  Trained using 8x H100 with global batch size 64, using 2e-4 learning rate, for 4000 steps, which is approximately 5 epochs.