ValueError: Please specify `target_modules` in `peft_config`
#34
by
Tapendra
- opened
While training with SFTTrainer
trainer = SFTTrainer(
model=model,
train_dataset=dataset,
peft_config=peft_config,
dataset_text_field="text",
max_seq_length=max_seq_length,
tokenizer=tokenizer,
args=training_arguments,
packing=packing,
)
Train model
trainer.train()
@harpercarroll What is the minimum requirement of System RAM, GPU RAM to inference the bitsandbytes nf4 ,use_4bit = True train model. I train model of bnb_4bit_quant_type = "nf4" after training model size is same like 15GB. How we can reduce model Size ?
