End of training

README.md

@@ -3,9 +3,16 @@ library_name: transformers
 license: llama3.2
 base_model: ZhangShenao/SELM-Llama-3.2-3B-Instruct-re-00-iter-1
 tags:
+- alignment-handbook
 - trl
 - dpo
 - generated_from_trainer
+- trl
+- dpo
+- generated_from_trainer
+datasets:
+- updated
+- original
 model-index:
 - name: SELM-Llama-3.2-3B-Instruct-re-00-iter-2
   results: []
@@ -16,7 +23,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # SELM-Llama-3.2-3B-Instruct-re-00-iter-2
 
-This model is a fine-tuned version of [ZhangShenao/SELM-Llama-3.2-3B-Instruct-re-00-iter-1](https://huggingface.co/ZhangShenao/SELM-Llama-3.2-3B-Instruct-re-00-iter-1) on the None dataset.
+This model is a fine-tuned version of [ZhangShenao/SELM-Llama-3.2-3B-Instruct-re-00-iter-1](https://huggingface.co/ZhangShenao/SELM-Llama-3.2-3B-Instruct-re-00-iter-1) on the updated and the original datasets.
 
 ## Model description
 

config.json

@@ -35,6 +35,6 @@
   "tie_word_embeddings": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.45.0",
-  "use_cache": false,
+  "use_cache": true,
   "vocab_size": 128256
 }