Update README.md

README.md

@@ -1,6 +1,51 @@
 ---
 library_name: peft
+license: wtfpl
+language:
+- en
+pipeline_tag: text-generation
 ---
+
+## Model description
+
+togethercomputer/RedPajama-INCITE-Base-3B-v1 finetuned for paraphrasing and changing the tone of the input sentence(to casual/professional/witty).
+
+Sample training data:
+```json
+{
+  "fname": "train_664",
+  "dialogue": "#Person1#: Hello, Happy Time Catering Services, Vitoria speaking. How can I help you?\n#Person2#: Hello, Victoria. This is Joe Smith from country holidays. I wondered if you could do some catering for us next week, we are having a small reception. It's to launch our summer holiday advertising campaign. Will you be free?\n#Person1#: When exactly is it? Mr. Smith?\n#Person2#: April 21st, that's Thursday. Oh, sorry, no. It should be Friday.\n#Person1#: Oh, yes I can do that where will you be holding it?\n#Person2#: We thought we'd have that at head office and use the conference room, because there is enough room for everyone there.\n#Person1#: Ok. What sort of things would you like?\n#Person2#: Just a light lunch I think, so that people can eat while they move around and talk to each other. You did some thing similar for us last year. We'd be happy to have the same menu again.\n#Person1#: Right. I'll look at my diary and see what you had last time. Oh, I nearly forgot to ask you how many should I cater for?\n#Person2#: Well, I think most people will be able to come, perhaps around 30. No, let's say 35, to be sure.\n#Person1#: Right, thank you for getting in touch, Mr. Smith. I'll send you confirmation of the arrangements by the end of this week.\n#Person2#: Ok.",
+  "summary": "Joe Smith calls Happy Time Catering Service and wants some catering for next week. Victoria asks his requirements and will send him confirmation of the arrangements by the end of this week.",
+  "topic": "Catering service"
+}
+```
+
+## Training params
+
+```json
+{
+  "batch_size": 1,
+  "eval_ratio": 0.05,
+  "eval_steps": 100,
+  "gradient_accumulation_steps": 4,
+  "learning_rate": 0.0001,
+  "logging_steps": 100,
+  "lora_alpha": 32,
+  "lora_dropout": 0.05,
+  "lora_r": 16,
+  "max_length": 1024,
+  "model_name": "togethercomputer/RedPajama-INCITE-Base-3B-v1",
+  "num_train_epochs": 2,
+  "seed": 0,
+  "task_type": "dialogue_summary_topic",
+  "use_aim": True
+}
+```
+
+## Training curve
+
+![train_eval_loss](RedPajama-INCITE-Base-3B-v1-dialogue-summary-topic.jpeg)
+
 ## Training procedure
 
 
@@ -17,4 +62,4 @@ The following `bitsandbytes` quantization config was used during training:
 ### Framework versions
 
 
-- PEFT 0.4.0.dev0
+- PEFT 0.4.0.dev0