Hugging Face's logo

asiansoul
/
Llama-3-MAAL-8B-Instruct-v0.1-GGUF

GGUF
English
Korean
facebook
meta
llama
llama-3
llama-3-ko
Model card Files Community
asiansoul commited on
Commit
dda9c40
β€’
1 Parent(s): 0072fea

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +5 -0
  2. Modelfile_Q5_K_M +23 -0
  3. llama-3-maal-8b-instruct-v0.1-Q3_K_M.gguf +3 -0
  4. llama-3-maal-8b-instruct-v0.1-Q4_K_M.gguf +3 -0
  5. llama-3-maal-8b-instruct-v0.1-Q5_K_M.gguf +3 -0
  6. llama-3-maal-8b-instruct-v0.1-Q6_K.gguf +3 -0
  7. llama-3-maal-8b-instruct-v0.1-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ llama-3-maal-8b-instruct-v0.1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ llama-3-maal-8b-instruct-v0.1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ llama-3-maal-8b-instruct-v0.1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ llama-3-maal-8b-instruct-v0.1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ llama-3-maal-8b-instruct-v0.1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Modelfile_Q5_K_M ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM llama-3-maal-8b-instruct-v0.1-Q5_K_M.gguf
2
+ TEMPLATE """
3
+ {{- if .System }}
4
+ system
5
+ <s>{{ .System }}</s>
6
+ {{- end }}
7
+ user
8
+ <s>Human:
9
+ {{ .Prompt }}</s>
10
+ assistant
11
+ <s>Assistant:
12
+ """
13
+
14
+ SYSTEM """
15
+ μΉœμ ˆν•œ μ±—λ΄‡μœΌλ‘œμ„œ μƒλŒ€λ°©μ˜ μš”μ²­μ— μ΅œλŒ€ν•œ μžμ„Έν•˜κ³  μΉœμ ˆν•˜κ²Œ λ‹΅ν•˜μž. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄(Korean)으둜 λŒ€λ‹΅ν•΄μ€˜.
16
+ """
17
+
18
+ PARAMETER temperature 0.7
19
+ PARAMETER num_predict 3000
20
+ PARAMETER num_ctx 4096
21
+ PARAMETER stop "<s>"
22
+ PARAMETER stop "</s>"
23
+
llama-3-maal-8b-instruct-v0.1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c776d918657130ce5e098c05b5ed8206bd62c1ac09c2c1ef3e8024578358678
3
+ size 4018922816
llama-3-maal-8b-instruct-v0.1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e773b5cb2fc6cf0d297ca207fb3044642a727a7486b4c0adab954a5a3caaf323
3
+ size 4920739680
llama-3-maal-8b-instruct-v0.1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ec7092d04f420050903a218b0c4353111c75a317276151253f80bb7a9eb602e
3
+ size 5732993376
llama-3-maal-8b-instruct-v0.1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:947e1c195368b81046d11e6a7129c07993d231126aea5d64f576e051b297b5c5
3
+ size 6596012928
llama-3-maal-8b-instruct-v0.1-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b0516a363d98f98f9cb28cc64e52b155195e14be416d10fe2cd122704e5106f
3
+ size 8540779328