GGUF llama.cpp quantized version of:

Recommended Prompt Format (Gemma)

<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn> 
<start_of_turn>model
AI message goes here<end_of_turn>model

Quant Version: b3450 with imatrix

Downloads last month: 19

GGUF

Model size

27.2B params

Architecture

gemma2

2-bit

4-bit

5-bit

8-bit

View +1 file

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for AI-Engine/gemma-2-27b-it-GGUF

Base model

google/gemma-2-27b

Finetuned

google/gemma-2-27b-it

Quantized

(55)

this model