| base_model: meta-llama/Llama-3.2-3B-Instruct | |
| datasets: | |
| - tatsu-lab/alpaca | |
| language: en | |
| tags: | |
| - torchtune | |
| # my_cool_model | |
| This model is a finetuned version of [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co./meta-llama/Llama-3.2-3B-Instruct) on the [tatsu-lab/alpaca](https://huggingface.co./tatsu-lab/alpaca) dataset. | |
| # Model description | |
| More information needed | |
| # Training and evaluation results | |
| More information needed | |
| # Training procedure | |
| This model was trained using the [torchtune](https://github.com/pytorch/torchtune) library using the following command: | |
| ```bash | |
| ppo_full_finetune_single_device.py\ | |
| --config ./target/7B_full_ppo_low_memory_single_device.yaml\ | |
| device=cuda\ | |
| metric_logger._component_=torchtune.utils.metric_logging.WandBLogger\ | |
| metric_logger.project=torchtune_ppo\ | |
| forward_batch_size=2\ | |
| batch_size=64\ | |
| ppo_batch_size=32\ | |
| gradient_accumulation_steps=16\ | |
| compile=True\ | |
| optimizer._component_=bitsandbytes.optim.PagedAdamW\ | |
| optimizer.lr=3e-4 | |
| ``` | |
| # Framework versions | |
| - torchtune | |
| - torchao 0.5.0 | |
| - datasets 2.20.0 | |
| - sentencepiece 0.2.0 | |