Update README.md
Browse files
README.md
CHANGED
@@ -54,8 +54,8 @@ This repo contains `GGUF` format model files for [aisingapore/llama3.1-70B-cpt-s
|
|
54 |
- [llama3.1-70B-cpt-sea-lionv3-instruct-Q6_K](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q6_K-00001-of-00002.gguf)
|
55 |
- [llama3.1-70B-cpt-sea-lionv3-instruct-Q8_0](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q8_0-00001-of-00003.gguf)
|
56 |
> [!NOTE]
|
57 |
-
> Take note that some GGUFs are split into parts. Most tools such as [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and those built on it do support split GGUFs, pointing the platform to the first split will be sufficient for it to function
|
58 |
-
> In the event where a merge is necessary, it can be done using `llama.cpp`'s `gguf-split`: `./gguf-split --merge ./path/to/first-split ./path/to/output-gguf
|
59 |
> More details: [gguf-split guide](https://github.com/ggerganov/llama.cpp/discussions/6404) & [README](https://github.com/ggerganov/llama.cpp/tree/master/examples/gguf-split)
|
60 |
|
61 |
### Caveats
|
|
|
54 |
- [llama3.1-70B-cpt-sea-lionv3-instruct-Q6_K](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q6_K-00001-of-00002.gguf)
|
55 |
- [llama3.1-70B-cpt-sea-lionv3-instruct-Q8_0](https://huggingface.co/aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct-gguf/blob/main/llama3.1-70b-cpt-sea-lionv3-instruct-Q8_0-00001-of-00003.gguf)
|
56 |
> [!NOTE]
|
57 |
+
> Take note that some GGUFs are split into parts. Most tools such as [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and those built on it do support split GGUFs, pointing the platform to the first split will be sufficient for it to function.
|
58 |
+
> In the event where a merge is necessary, it can be done using `llama.cpp`'s `gguf-split`: `./gguf-split --merge ./path/to/first-split ./path/to/output-gguf`
|
59 |
> More details: [gguf-split guide](https://github.com/ggerganov/llama.cpp/discussions/6404) & [README](https://github.com/ggerganov/llama.cpp/tree/master/examples/gguf-split)
|
60 |
|
61 |
### Caveats
|