Exllamav2 quant (exl2 / 8.0 bpw) made with ExLlamaV2 v0.1.3

Other EXL2 quants:

Quant Model Size lm_head
2.2
3126 MB
6
2.5
3469 MB
6
3.0
4092 MB
6
3.5
4717 MB
6
3.75
5029 MB
6
4.0
5341 MB
6
4.25
5653 MB
6
5.0
6589 MB
6
6.0
7862 MB
8
6.5
8467 MB
8
8.0
9713 MB
8

cute

Chunky-Lemon-Cookie-11B

This is a merge of pre-trained language models created using mergekit.

GGUF quants:

Merge Details

Merge Method

This model was merged using the following methods:

Models Merged

The following models were included in the merge:

Configuration

The following YAML configurations were used to produce this model:

slices:
  - sources:
    - model: mistralai/Mistral-7B-v0.1
      layer_range: [0, 24]
  - sources:
    - model: mistralai/Mistral-7B-v0.1
      layer_range: [8, 32]
merge_method: passthrough
dtype: float16
name: Mistral-11B

---

slices:
  - sources:
    - model: SanjiWatsuki/Kunoichi-7B
      layer_range: [0, 24]
  - sources:
    - model: SanjiWatsuki/Silicon-Maid-7B
      layer_range: [8, 24]
  - sources:
    - model: KatyTheCutie/LemonadeRP-4.5.3
      layer_range: [24, 32]
merge_method: passthrough
dtype: float16
name: Big-Lemon-Cookie-11B

---

models:
  - model: Big-Lemon-Cookie-11B
    parameters:
      weight: 0.85
  - model: Sao10K/Fimbulvetr-11B-v2
    parameters:
      weight: 0.15
merge_method: task_arithmetic
base_model: Mistral-11B
dtype: float16
name: Chunky-Lemon-Cookie-11B

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 70.23
AI2 Reasoning Challenge (25-Shot) 69.62
HellaSwag (10-Shot) 86.55
MMLU (5-Shot) 65.35
TruthfulQA (0-shot) 61.59
Winogrande (5-shot) 79.79
GSM8k (5-shot) 58.45
Downloads last month
8
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Zoyd/FallenMerick_Chunky-Lemon-Cookie-11B-8_0bpw_exl2

Evaluation results