SepKeyPro commited on
Commit
cb51bb9
·
verified ·
1 Parent(s): ac0b635

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -28
README.md CHANGED
@@ -3,13 +3,14 @@ tags:
3
  - merge
4
  - mergekit
5
  - lazymergekit
 
6
  ---
7
 
8
- # Merged-8B-slerp
9
 
10
- Merged-8B-slerp is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
11
 
12
- ## 🧩 Configuration
13
 
14
  ```yaml
15
  models:
@@ -19,29 +20,4 @@ models:
19
  merge_method: model_stock
20
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
21
  dtype: bfloat16
22
- ```
23
-
24
- ## 💻 Usage
25
-
26
- ```python
27
- !pip install -qU transformers accelerate
28
-
29
- from transformers import AutoTokenizer
30
- import transformers
31
- import torch
32
-
33
- model = "SepKeyPro/Merged-8B-slerp"
34
- messages = [{"role": "user", "content": "What is a large language model?"}]
35
-
36
- tokenizer = AutoTokenizer.from_pretrained(model)
37
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
38
- pipeline = transformers.pipeline(
39
- "text-generation",
40
- model=model,
41
- torch_dtype=torch.float16,
42
- device_map="auto",
43
- )
44
-
45
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
46
- print(outputs[0]["generated_text"])
47
  ```
 
3
  - merge
4
  - mergekit
5
  - lazymergekit
6
+ license: apache-2.0
7
  ---
8
 
9
+ # Merged-OpenLlama3-8B
10
 
11
+ Merged-OpenLlama3-8B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
12
 
13
+ ## Configuration
14
 
15
  ```yaml
16
  models:
 
20
  merge_method: model_stock
21
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
22
  dtype: bfloat16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ```