TheBloke float-trip commited on
Commit
a888282
1 Parent(s): c2fd046

Update prompt format (#16)

Browse files

- Update prompt format (768e13b8c802de0083c00ac7f1abe4f7e56a1e8a)


Co-authored-by: float trip <[email protected]>

Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -45,7 +45,8 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
45
  [INST] <<SYS>>
46
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
47
  <</SYS>>
48
- {prompt}[/INST]
 
49
  ```
50
 
51
  To continue a conversation:
@@ -54,8 +55,8 @@ To continue a conversation:
54
  [INST] <<SYS>>
55
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
56
  <</SYS>>
57
- {prompt}[/INST]{model_reply}
58
- [INST]{prompt}[/INST]
59
  ```
60
 
61
  ## Provided files
@@ -146,7 +147,8 @@ prompt = "Tell me about AI"
146
  prompt_template=f'''[INST] <<SYS>>
147
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
148
  <</SYS>>
149
- {prompt}[/INST]'''
 
150
 
151
  print("\n\n*** Generate:")
152
 
 
45
  [INST] <<SYS>>
46
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
47
  <</SYS>>
48
+
49
+ {prompt} [/INST]
50
  ```
51
 
52
  To continue a conversation:
 
55
  [INST] <<SYS>>
56
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
57
  <</SYS>>
58
+
59
+ {prompt} [/INST] {model_reply} [INST] {prompt} [/INST]
60
  ```
61
 
62
  ## Provided files
 
147
  prompt_template=f'''[INST] <<SYS>>
148
  You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
149
  <</SYS>>
150
+
151
+ {prompt} [/INST]'''
152
 
153
  print("\n\n*** Generate:")
154