| tags: | |
| - merge | |
| - mergekit | |
| license: apache-2.0 | |
| # Merged-OpenLlama3-8B | |
| Merged-OpenLlama3-8B is a merge of the following models using Mergekit: | |
| ## Configuration | |
| ```yaml | |
| models: | |
| - model: openchat/openchat-3.6-8b-20240522 | |
| - model: meta-llama/Meta-Llama-3-8B-Instruct | |
| - model: nbeerbower/llama-3-gutenberg-8B | |
| merge_method: model_stock | |
| base_model: meta-llama/Meta-Llama-3-8B-Instruct | |
| dtype: bfloat16 | |
| ``` |