This is an instruct model, which may not be ideal for further finetuning.
#100
by
rakeshda
- opened
This is an instruct model, which may not be ideal for further finetuning. If you are interested in building your own instruct/chat model, we recommend starting from Falcon-7B.
We did fine tune the instruct with some Q&A of our own domain specific data... and it seems to be working as expected.
Wanted to understand that, if there is any risk in getting further on this?
Any specific known issues/behaviours we should be aware of?
What was your raw format? or .json format?
Was it {instruction: xyz, output: abc}?