asiansoul commited on
Commit
3be6b1c
β€’
1 Parent(s): c9653e8

Update Modelfile_Q4_K_M

Browse files
Files changed (1) hide show
  1. Modelfile_Q4_K_M +8 -4
Modelfile_Q4_K_M CHANGED
@@ -9,12 +9,16 @@ TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
9
 
10
 
11
  SYSTEM """
12
- μΉœμ ˆν•œ μ±—λ΄‡μœΌλ‘œμ„œ μƒλŒ€λ°©μ˜ μš”μ²­μ— μ΅œλŒ€ν•œ μžμ„Έν•˜κ³  μΉœμ ˆν•˜κ²Œ λ‹΅ν•˜μž. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄(Korean)으둜 λŒ€λ‹΅ν•΄μ€˜.
 
13
  """
14
 
 
15
  PARAMETER num_keep 24
16
- PARAMETER temperature 0.7
17
- PARAMETER num_predict 3000
 
 
18
  PARAMETER stop "<|start_header_id|>"
19
  PARAMETER stop "<|end_header_id|>"
20
- PARAMETER stop "<|eot_id|>"
 
9
 
10
 
11
  SYSTEM """
12
+ 당신은 μœ μš©ν•œ AI μ–΄μ‹œμŠ€ν„΄νŠΈμž…λ‹ˆλ‹€. μ‚¬μš©μžμ˜ μ§ˆμ˜μ— λŒ€ν•΄ μΉœμ ˆν•˜κ³  μ •ν™•ν•˜κ²Œ λ‹΅λ³€ν•΄μ•Ό ν•©λ‹ˆλ‹€.
13
+ You are a helpful AI assistant, you'll need to answer users' queries in a friendly and accurate manner.
14
  """
15
 
16
+ PARAMETER num_ctx 1024
17
  PARAMETER num_keep 24
18
+ PARAMETER temperature 0.6
19
+ PARAMETER top_p 0.9
20
+ PARAMETER num_predict 2048
21
+ PARAMETER num_thread 20
22
  PARAMETER stop "<|start_header_id|>"
23
  PARAMETER stop "<|end_header_id|>"
24
+ PARAMETER stop "<|eot_id|>"