Hugging Face's logo

Spaces:
gustavoaq
/
llama_7b_ft_2
Paused

App Files Community
5
gustavoaq commited on
Commit
7a9e7c3
·
1 Parent(s): bbf226a

Update finetune.py

Browse files
Files changed (1) hide show
  1. finetune.py +1 -1
finetune.py CHANGED
@@ -19,7 +19,7 @@ from peft import (
19
  # Parameters
20
  MICRO_BATCH_SIZE = int(32)
21
  BATCH_SIZE = 16
22
- size = 7b
23
  GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE
24
  EPOCHS = 1
25
  LEARNING_RATE = float(0.00015)
 
19
  # Parameters
20
  MICRO_BATCH_SIZE = int(32)
21
  BATCH_SIZE = 16
22
+ size = "7b"
23
  GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE
24
  EPOCHS = 1
25
  LEARNING_RATE = float(0.00015)