| license: cc-by-nc-4.0 | |
| language: | |
| - en | |
| - ko | |
| - ja | |
| tags: | |
| - inteiror | |
| - defective | |
| Finetuned Hansoldeco Domain dataset | |
| (Specialized on interiror Q&A and defective things on it.) | |
| load_in_8bit=True | |
| batch_size = 1 | |
| num_epochs = 3 | |
| micro_batch = 1 | |
| gradient_accumulation_steps = batch_size // micro_batch | |
| lora target | |
| 2 X A100 80GB | |
| Base Model = CohereForAI/c4ai-command-r-plus | |
| license : cc-by-nc-4.0 (non-commercial as cohere mentioned) |