Update README.md

README.md

@@ -15,18 +15,21 @@ This repo contains GGML files for for CPU inference using [llama.cpp](https://gi
 * [4bit and 5bit GGML models for CPU inference in llama.cpp](https://huggingface.co/TheBloke/dromedary-65B-lora-GGML)
 * [float16 unquantised model for GPU](https://huggingface.co/TheBloke/dromedary-65B-lora-HF)
 
+## REQUIRES LATEST LLAMA.CPP (May 12th 2023 - commit b9fd7ee)!
+
+llama.cpp recently made a breaking change to its quantisation methods.
+
+I have re-quantised the GGML files in this repo. Therefore you will require llama.cpp compiled on May 12th or later (commit `b9fd7ee` or later) to use them.
+
+The previous files, which will still work in older versions of llama.cpp, can be found in branch `previous_llama`.
+
 ## Provided files
 | Name | Quant method | Bits | Size | RAM required | Use case |
 | ---- | ---- | ---- | ---- | ---- | ----- |
-`dromedary-lora-65B.ggml.q4_0.bin` | q4_0 | 4bit | 40.8GB | 43GB | Maximum compatibility |
-`dromedary-lora-65B.ggml.q4_2.bin` | q4_2 | 4bit | 40.8GB | 43GB | Best compromise between resources, speed and quality |
-`dromedary-lora-65B.ggml.q5_0.bin` | q5_0 | 5bit | 44.9GB | 47GB | Brand new 5bit method. Potentially higher quality than 4bit, at cost of slightly higher resources. |
-`dromedary-lora-65B.ggml.q5_1.bin` | q5_1 | 5bit | 49GB | 51GB | Brand new 5bit method. Slightly higher resource usage than q5_0.|
-
-* The q4_0 file provides lower quality, but maximal compatibility. It will work with past and future versions of llama.cpp
-* The q4_2 file offers the best combination of performance and quality. This format is still subject to change and there may be compatibility issues, see below.
-* The q5_0 file is using brand new 5bit method released 26th April. This is the 5bit equivalent of q4_0.
-* The q5_1 file is using brand new 5bit method released 26
+`dromedary-lora-65B.ggml.q4_0.bin` | q4_0 | 4bit | 40.8GB | 43GB | 4-bit. |
+`dromedary-lora-65B.ggml.q5_0.bin` | q5_0 | 5bit | 44.9GB | 47GB | 5-bit. Higher accuracy, higher resource usage and slower inference.  |
+`dromedary-lora-65B.ggml.q5_1.bin` | q5_1 | 5bit | 49GB | 51GB | 5-bit. Even higher accuracy, higher resource usage and slower inference. |
+
 
 # Original Dromedary Model Card