mlx-community/Pearl-3x7B

This model was converted to MLX format from louisbrulenaudet/Pearl-3x7B using mlx-vlm version 0.16.1. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm
python -m mlx_vlm.generate --model  mlx-community/Pearl-3x7B --max-tokens 100 --temp 0.0
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Pearl-3x7B")
response = generate(model, tokenizer, prompt="hello", verbose=True)

Citing & Authors

If you use this code in your research, please use the following BibTeX entry.

@misc{louisbrulenaudet2024,
  author =       {Louis Brulé Naudet},
  title =        {Pearl-3x7B, an xtraordinary Mixture of Experts (MoE) for data science},
  year =         {2024}
  howpublished = {\url{https://huggingface.co./mlx-community/Pearl-3x7B}},
}

Feedback

If you have any feedback, please reach out at [email protected].

Downloads last month
14
Safetensors
Model size
3B params
Tensor type
FP16
·
U32
·
Inference Examples
Inference API (serverless) does not yet support mlx models for this pipeline type.

Model tree for mlx-community/Pearl-3x7B

Finetuned
(1)
this model