OwenArli commited on
Commit
4a78bcc
1 Parent(s): f186021

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -13,6 +13,8 @@ This repository is based on the Meta-Llama-3.1-8B-Instruct model and is governed
13
 
14
  Llama-3.1-8B-ArliAI-RPMax-v1.1 is a variant of the Meta-Llama-3.1-8B model, trained on a diverse set of curated RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive, with a unique approach to training that minimizes repetition.
15
 
 
 
16
  ### Training Details
17
 
18
  * **Sequence Length**: 8192
@@ -22,7 +24,7 @@ Llama-3.1-8B-ArliAI-RPMax-v1.1 is a variant of the Meta-Llama-3.1-8B model, trai
22
 
23
  ## Quantization
24
 
25
- The model is available in two quantized formats:
26
 
27
  * **FP16**: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.1
28
  * **GGUF**: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.1-GGUF
 
13
 
14
  Llama-3.1-8B-ArliAI-RPMax-v1.1 is a variant of the Meta-Llama-3.1-8B model, trained on a diverse set of curated RP datasets with a focus on variety and deduplication. This model is designed to be highly creative and non-repetitive, with a unique approach to training that minimizes repetition.
15
 
16
+ v1.1 is just a small fix to not train and save the embeddings layer, since v1.0 had the lm_head unnecessarily trained on accident.
17
+
18
  ### Training Details
19
 
20
  * **Sequence Length**: 8192
 
24
 
25
  ## Quantization
26
 
27
+ The model is available in quantized formats:
28
 
29
  * **FP16**: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.1
30
  * **GGUF**: https://huggingface.co/ArliAI/Llama-3.1-8B-ArliAI-Formax-v1.1-GGUF