RioShiina
/

Swallow-70b-NVE-instruct-exl2

Text Generation

Model card Files Files and versions Community

Edit model card

2.2bpw (high quality loss, only for 24GB vRAM test.)
4.0bpw
6.0bpw
8.0bpw

Swallow-70b-NVE-instruct-exl2

Model creator: tokyotech-llm
Original model: Swallow-70b-NVE-instruct-hf

Prompt template

### 指示:
{instruction}

### 入力:
{input}

### 応答:

Licence

Llama 2 is licensed under the LLAMA 2 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for RioShiina/Swallow-70b-NVE-instruct-exl2

Base model

tokyotech-llm/Swallow-70b-NVE-instruct-hf

Finetuned

(1)

this model