Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,49 @@
+---
+base_model: meta-llama/Llama-3.2-3B-Instruct
+datasets:
+- tatsu-lab/alpaca
+language: en
+tags:
+- torchtune
+---
+
+# my_cool_model 
+
+This model is a finetuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on the [tatsu-lab/alpaca](https://huggingface.co/tatsu-lab/alpaca) dataset.
+
+# Model description
+
+More information needed
+
+# Training and evaluation results
+
+More information needed
+
+# Training procedure
+
+This model was trained using the [torchtune](https://github.com/pytorch/torchtune) library using the following command:
+
+```bash
+ppo_full_finetune_single_device.py \
+ --config ./target/7B_full_ppo_low_memory_single_device.yaml \
+ device=cuda \
+ metric_logger._component_=torchtune.utils.metric_logging.WandBLogger \
+ metric_logger.project=torchtune_ppo \
+ forward_batch_size=2 \
+ batch_size=64 \
+ ppo_batch_size=32 \
+ gradient_accumulation_steps=16 \
+ compile=True \
+ optimizer._component_=bitsandbytes.optim.PagedAdamW \
+ optimizer.lr=3e-4
+```
+
+
+
+# Framework versions
+
+- torchtune 
+- torchao 0.5.0
+- datasets 2.20.0
+- sentencepiece 0.2.0
+