EXL2_Measurements / README.md
Dracones's picture
Upload folder using huggingface_hub
8eca10d verified
|
raw
history blame
3.87 kB
# Midnight Miqu EXL2 Measurement Files
This repository contains EXL2 measurement files for quants made here.
## Contents
| Filename | Description | Model Link |
|---------------------------------|---------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------|
| `midnight70b.json` | EXL2 measurement file for Midnight Miqu 70b | [sophosympatheia/Midnight-Miqu-70B-v1.0](https://huggingface.co./sophosympatheia/Midnight-Miqu-70B-v1.0) |
| `midnight103b.json` | EXL2 measurement file for Midnight Miqu 103b | [sophosympatheia/Midnight-Miqu-103B-v1.0](https://huggingface.co./sophosympatheia/Midnight-Miqu-103B-v1.0) |
| `midnight70b-v15.json` | EXL2 measurement file for Midnight Miqu 70b v1.5 | [sophosympatheia/Midnight-Miqu-70B-v1.5](https://huggingface.co./sophosympatheia/Midnight-Miqu-70B-v1.5) |
| `Merged-RP-Stew-V2-34B.json` | EXL2 measurement file for Merged RP Stew V2 34B | [ParasiticRogue/Merged-RP-Stew-V2-34B](https://huggingface.co./ParasiticRogue/Merged-RP-Stew-V2-34B) |
| `perky70b.json` | EXL2 measurement file for Perky 70b | [Dracones/perky-70b-v0.1](https://huggingface.co./Dracones/perky-70b-v0.1) |
| `perky103b.json` | EXL2 measurement file for Perky 103b | [Dracones/perky-103b-v0.1](https://huggingface.co./Dracones/perky-103b-v0.1) |
| `miqu-1-70b-sf.json` | EXL2 measurement file for miqu-1-70b-sf | [152334H/miqu-1-70b-sf](https://huggingface.co./152334H/miqu-1-70b-sf) |
| `c4ai-command-r-v01.json` | EXL2 measurement file for Cohere Command R | [CohereForAI/c4ai-command-r-v01](https://huggingface.co./CohereForAI/c4ai-command-r-v01) |
| `c4ai-command-r-v01-rpcal.json` | EXL2 measurement file for Cohere Command R, RP Calibrated again PIPPA-cleaned | [CohereForAI/c4ai-command-r-v01](https://huggingface.co./CohereForAI/c4ai-command-r-v01) |
| `Mixtral-8x22B-v0.1.json` | EXL2 measurement file for Mixtral 8x22 v0.1 | [mistral-community/Mixtral-8x22B-v0.1](https://huggingface.co./mistral-community/Mixtral-8x22B-v0.1) |
| `mixtral-8x22b-instruct-oh.json` | EXL2 measurement file for mixtral-8x22b-instruct-oh | [fireworks-ai/mixtral-8x22b-instruct-oh](https://huggingface.co./fireworks-ai/mixtral-8x22b-instruct-oh) |
| `WizardLM-2-8x22B.json` | EXL2 measurement file for WizardLM-2-8x22B | [microsoft/WizardLM-2-8x22B](https://huggingface.co./microsoft/WizardLM-2-8x22B) |
| `CodeQwen1.5-7B-Chat.json` | EXL2 measurement file for CodeQwen1.5-7B-Chat | [Qwen/CodeQwen1.5-7B-Chat](https://huggingface.co./Qwen/CodeQwen1.5-7B-Chat) |