tainc commited on
Commit
bf38f40
·
verified ·
1 Parent(s): 3c2e543

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -54,8 +54,8 @@ This repo contains `GGUF` format model files for [aisingapore/llama3.1-70B-cpt-s
54
  - [llama3.1-70B-cpt-sea-lionv3-instruct-Q6_K](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q6_K-00001-of-00002.gguf)
55
  - [llama3.1-70B-cpt-sea-lionv3-instruct-Q8_0](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q8_0-00001-of-00003.gguf)
56
  > [!NOTE]
57
- > Take note that some GGUFs are split into parts. Most tools such as [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and those built on it do support split GGUFs, pointing the platform to the first split will be sufficient for it to function.<br>
58
- > In the event where a merge is necessary, it can be done using `llama.cpp`'s `gguf-split`: `./gguf-split --merge ./path/to/first-split ./path/to/output-gguf`<br>
59
  > More details: [gguf-split guide](https://github.com/ggerganov/llama.cpp/discussions/6404) & [README](https://github.com/ggerganov/llama.cpp/tree/master/examples/gguf-split)
60
 
61
  ### Caveats
 
54
  - [llama3.1-70B-cpt-sea-lionv3-instruct-Q6_K](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q6_K-00001-of-00002.gguf)
55
  - [llama3.1-70B-cpt-sea-lionv3-instruct-Q8_0](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q8_0-00001-of-00003.gguf)
56
  > [!NOTE]
57
+ > Take note that some GGUFs are split into parts. Most tools such as [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and those built on it do support split GGUFs, pointing the platform to the first split will be sufficient for it to function.
58
+ > In the event where a merge is necessary, it can be done using `llama.cpp`'s `gguf-split`: `./gguf-split --merge ./path/to/first-split ./path/to/output-gguf`
59
  > More details: [gguf-split guide](https://github.com/ggerganov/llama.cpp/discussions/6404) & [README](https://github.com/ggerganov/llama.cpp/tree/master/examples/gguf-split)
60
 
61
  ### Caveats