Update README.md

README.md

@@ -2,11 +2,12 @@
 license: apache-2.0
 ---
 # Llama3 8B
+
 Llama 3 is the latest and most advanced LLM trained over 15T tokens, which improves its comprehension and handling of complex language nuances. It features an extended context window of 8k tokens allowing the model to access more information from lengthy passages for more informed decision-making.  
 
 **Model Intention:** The latest Llama 3 enabling more accurate and informative responses to complex queries in both English and multilingual contexts.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B)  
 
@@ -21,6 +22,7 @@ Llama 3 is the latest and most advanced LLM trained over 15T tokens, which impro
 **Context Length:** 8192 tokens  
 
 **Prompt Format:** 
+
 ```
 <|start_header_id|>user<|end_header_id|>
 
@@ -28,7 +30,7 @@ Llama 3 is the latest and most advanced LLM trained over 15T tokens, which impro
 
 assistant
 
-``` 
+```
 
 **Template Name:** llama  
 
@@ -42,11 +44,12 @@ assistant
 ---
 
 # LiteLlama
+
 It's a very small LLAMA2 model with only 460M parameters trained with 1T tokens. It's best for testing.  
 
 **Model Intention:** This is a 460 parameters' very small model for test purpose only  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/LiteLlama-460M-1T-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/LiteLlama-460M-1T-Q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LiteLlama-460M-1T-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/LiteLlama-460M-1T-Q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/ahxt/LiteLlama-460M-1T](https://huggingface.co/ahxt/LiteLlama-460M-1T)  
 
@@ -61,10 +64,11 @@ It's a very small LLAMA2 model with only 460M parameters trained with 1T tokens.
 **Context Length:** 1024 tokens  
 
 **Prompt Format:** 
+
 ```
 <human>: {{prompt}}
 <bot>:
-``` 
+```
 
 **Template Name:** TinyLlama  
 
@@ -78,11 +82,12 @@ It's a very small LLAMA2 model with only 460M parameters trained with 1T tokens.
 ---
 
 # TinyLlama-1.1B-chat
+
 The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of just 90 days using 16 A100-40G GPUs. The training has started on 2023-09-01.  
 
 **Model Intention:** It's good for question & answer.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/tinyllama-1.1B-chat-v1.0-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/tinyllama-1.1B-chat-v1.0-Q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/tinyllama-1.1B-chat-v1.0-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/tinyllama-1.1B-chat-v1.0-Q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)  
 
@@ -97,9 +102,10 @@ The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens.
 **Context Length:** 4096 tokens  
 
 **Prompt Format:** 
+
 ```
 <|user|>{{prompt}}</s><|assistant|>
-``` 
+```
 
 **Template Name:** TinyLlama  
 
@@ -113,11 +119,12 @@ The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens.
 ---
 
 # Mistral 7B v0.2
+
 The Mistral-7B-v0.2 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters. Mistral-7B-v0.2 outperforms Llama 2 13B on all benchmarks we tested.  
 
 **Model Intention:** It's a 7B large model for Q&A purpose. But it requires a high-end device to run.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/mistral-7b-instruct-v0.2.Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/mistral-7b-instruct-v0.2.Q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/mistral-7b-instruct-v0.2.Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/mistral-7b-instruct-v0.2.Q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)  
 
@@ -132,9 +139,10 @@ The Mistral-7B-v0.2 Large Language Model (LLM) is a pretrained generative text m
 **Context Length:** 4096 tokens  
 
 **Prompt Format:** 
+
 ```
 <s>[INST]{{prompt}}[/INST]</s>
-``` 
+```
 
 **Template Name:** Mistral  
 
@@ -148,11 +156,12 @@ The Mistral-7B-v0.2 Large Language Model (LLM) is a pretrained generative text m
 ---
 
 # OpenChat 3.5(0106)
+
 OpenChat is an innovative library of open-source language models, fine-tuned with C-RLFT - a strategy inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, even with a 7B model. Despite our simple approach, we are committed to developing a high-performance, commercially viable, open-source large language model, and we continue to make significant strides toward this vision.  
 
 **Model Intention:** It's a 7B large model and performs really good for Q&A. But it requires a high-end device to run.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/openchat-3.5-0106.Q3_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/openchat-3.5-0106.Q3_K_M.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/openchat-3.5-0106.Q3_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/openchat-3.5-0106.Q3_K_M.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/openchat/openchat_3.5](https://huggingface.co/openchat/openchat_3.5)  
 
@@ -167,9 +176,10 @@ OpenChat is an innovative library of open-source language models, fine-tuned wit
 **Context Length:** 8192 tokens  
 
 **Prompt Format:** 
+
 ```
 GPT4 Correct User: {{prompt}}<|end_of_turn|>GPT4 Correct Assistant: 
-``` 
+```
 
 **Template Name:** Mistral  
 
@@ -182,32 +192,35 @@ GPT4 Correct User: {{prompt}}<|end_of_turn|>GPT4 Correct Assistant:
 
 ---
 
-# Phi-2
-Phi-2 is a Transformer with 2.7 billion parameters. It was trained using the same data sources as Phi-1.5, augmented with a new data source that consists of various NLP synthetic texts and filtered websites (for safety and educational value). When assessed against benchmarks testing common sense, language understanding, and logical reasoning, Phi-2 showcased a nearly state-of-the-art performance among models with less than 13 billion parameters.  
+# Phi-3 4K
+
+The Phi-3 4K-Instruct is a 3.8B parameters, lightweight, state-of-the-art open model. It is optimized for the instruction following and safety measures. It is good at common sense, language understanding, math, code, long context and logical reasoning, Phi-3 Mini-4K-Instruct showcased a robust and state-of-the-art performance among models with less than 13 billion parameters.  
 
-**Model Intention:** It's a 2.7B model and is intended for QA, chat, and code purposes  
+**Model Intention:** It's a 3B model with 4K context optimized for language understanding, math, code and logical reasoning  
 
-**Model URL:** [https://huggingface.co/ggml-org/models/resolve/main/phi-2.Q5_K_M.gguf?download=true](https://huggingface.co/ggml-org/models/resolve/main/phi-2.Q5_K_M.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Phi-3-mini-4k-instruct-q4.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/Phi-3-mini-4k-instruct-q4.gguf?download=true)  
 
-**Model Info URL:** [https://huggingface.co/microsoft/phi-2](https://huggingface.co/microsoft/phi-2)  
+**Model Info URL:** [https://huggingface.co/microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct)  
 
 **Model License:** [License Info](https://opensource.org/license/mit)  
 
-**Model Description:** Phi-2 is a Transformer with 2.7 billion parameters. It was trained using the same data sources as Phi-1.5, augmented with a new data source that consists of various NLP synthetic texts and filtered websites (for safety and educational value). When assessed against benchmarks testing common sense, language understanding, and logical reasoning, Phi-2 showcased a nearly state-of-the-art performance among models with less than 13 billion parameters.  
+**Model Description:** The Phi-3 4K-Instruct is a 3.8B parameters, lightweight, state-of-the-art open model. It is optimized for the instruction following and safety measures. It is good at common sense, language understanding, math, code, long context and logical reasoning, Phi-3 Mini-4K-Instruct showcased a robust and state-of-the-art performance among models with less than 13 billion parameters.  
 
-**Developer:** [https://huggingface.co/microsoft/phi-2](https://huggingface.co/microsoft/phi-2)  
+**Developer:** [https://huggingface.co/microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct)  
 
-**File Size:** 2070 MB  
+**File Size:** 2320 MB  
 
-**Context Length:** 2048 tokens  
+**Context Length:** 4096 tokens  
 
 **Prompt Format:** 
+
+```
+<|user|>
+{{prompt}} <|end|>
+<|assistant|>
 ```
-Instruct: {{prompt}}
-Output: 
-``` 
 
-**Template Name:** PHI  
+**Template Name:** PHI3  
 
 **Add BOS Token:** Yes  
 
@@ -219,11 +232,12 @@ Output:
 ---
 
 # Yi 6B Chat
+
 The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI. Targeted as a bilingual language model and trained on 3T multilingual corpus, the Yi series models become one of the strongest LLM worldwide, showing promise in language understanding, commonsense reasoning, reading comprehension, and more. For example, For English language capability, the Yi series models ranked 2nd (just behind GPT-4), outperforming other LLMs (such as LLaMA2-chat-70B, Claude 2, and ChatGPT) on the AlpacaEval Leaderboard in Dec 2023. For Chinese language capability, the Yi series models landed in 2nd place (following GPT-4), surpassing other LLMs (such as Baidu ERNIE, Qwen, and Baichuan) on the SuperCLUE in Oct 2023.  
 
 **Model Intention:** It's a 6B model and can understand English and Chinese. It's good for QA and Chat  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/yi-chat-6b.Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/yi-chat-6b.Q4_K_M.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/yi-chat-6b.Q4_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/yi-chat-6b.Q4_K_M.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/01-ai/Yi-6B-Chat](https://huggingface.co/01-ai/Yi-6B-Chat)  
 
@@ -238,13 +252,14 @@ The Yi series models are the next generation of open-source large language model
 **Context Length:** 4096 tokens  
 
 **Prompt Format:** 
+
 ```
 <|im_start|>user
 <|im_end|>
 {{prompt}}
 <|im_start|>assistant
 
-``` 
+```
 
 **Template Name:** yi  
 
@@ -258,11 +273,12 @@ The Yi series models are the next generation of open-source large language model
 ---
 
 # Google Gemma 2B
+
 Gemma is a family of lightweight, state-of-the-art open models built from the same research and technology used to create the Gemini models. Developed by Google DeepMind and other teams across Google, Gemma is named after the Latin gemma, meaning 'precious stone.' The Gemma model weights are supported by developer tools that promote innovation, collaboration, and the responsible use of artificial intelligence (AI).  
 
 **Model Intention:** It's a 2B large model for Q&A purpose. But it requires a high-end device to run.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/gemma-2b-it-q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/gemma-2b-it-q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/gemma-2b-it-q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/gemma-2b-it-q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/google/gemma-2b](https://huggingface.co/google/gemma-2b)  
 
@@ -277,12 +293,13 @@ Gemma is a family of lightweight, state-of-the-art open models built from the sa
 **Context Length:** 8192 tokens  
 
 **Prompt Format:** 
+
 ```
 <bos><start_of_turn>user
 {{prompt}}<end_of_turn>
 <start_of_turn>model
 
-``` 
+```
 
 **Template Name:** gemma  
 
@@ -296,11 +313,12 @@ Gemma is a family of lightweight, state-of-the-art open models built from the sa
 ---
 
 # StarCoder2 3B
+
 StarCoder2-3B model is a 3B parameter model trained on 17 programming languages from The Stack v2, with opt-out requests excluded. The model uses Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and was trained using the Fill-in-the-Middle objective on 3+ trillion tokens  
 
 **Model Intention:** The model is good at 17 programming languages. By just start with your codes, the model will finish it.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/starcoder2-3b-instruct-gguf_Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/starcoder2-3b-instruct-gguf_Q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/starcoder2-3b-instruct-gguf_Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/starcoder2-3b-instruct-gguf_Q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/bigcode/starcoder2-3b](https://huggingface.co/bigcode/starcoder2-3b)  
 
@@ -315,10 +333,11 @@ StarCoder2-3B model is a 3B parameter model trained on 17 programming languages
 **Context Length:** 16384 tokens  
 
 **Prompt Format:** 
+
 ```
 {{prompt}}
 
-``` 
+```
 
 **Template Name:** starcoder  
 
@@ -332,11 +351,12 @@ StarCoder2-3B model is a 3B parameter model trained on 17 programming languages
 ---
 
 # Chinese Tiny LLM 2B
+
 Chinese Tiny LLM 2B 是首个以中文为中心的大型语言模型，主要在中文语料库上进行预训练和微调，提供了对潜在偏见、中文语言能力和多语言适应性的重要洞见。  
 
 **Model Intention:** 这是一个参数规模2B的中文模型，具有很好的中文理解和应答能力  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/chinese-tiny-llm-2b-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/chinese-tiny-llm-2b-Q8_0.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/chinese-tiny-llm-2b-Q8_0.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/chinese-tiny-llm-2b-Q8_0.gguf?download=true)  
 
 **Model Info URL:** [https://chinese-tiny-llm.github.io/](https://chinese-tiny-llm.github.io/)  
 
@@ -351,13 +371,14 @@ Chinese Tiny LLM 2B 是首个以中文为中心的大型语言模型，主要在
 **Context Length:** 4096 tokens  
 
 **Prompt Format:** 
+
 ```
 <|im_start|>user
 {{prompt}}
 <|im_end|>
 <|im_start|>assistant
 
-``` 
+```
 
 **Template Name:** chatml  
 
@@ -371,11 +392,12 @@ Chinese Tiny LLM 2B 是首个以中文为中心的大型语言模型，主要在
 ---
 
 # Qwen1.5 4B Chat
+
 Qwen is the large language model and large multimodal model series of the Qwen Team, Alibaba Group. It supports both Chinese and English. 通义千问是阿里巴巴公司开发的大大预言模型，支持中英文双语。  
 
 **Model Intention:** It's one of the best LLM that supports Chinese and English. 这是支持中英双语的最佳的大语言模型之一。  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/qwen1_5-4b-chat-q4_k_m.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/qwen1_5-4b-chat-q4_k_m.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/qwen1_5-4b-chat-q4_k_m.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/qwen1_5-4b-chat-q4_k_m.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/Qwen/Qwen1.5-4B-Chat-GGUF](https://huggingface.co/Qwen/Qwen1.5-4B-Chat-GGUF)  
 
@@ -390,13 +412,14 @@ Qwen is the large language model and large multimodal model series of the Qwen T
 **Context Length:** 32768 tokens  
 
 **Prompt Format:** 
+
 ```
 <|im_start|>user
 {{prompt}}
 <|im_end|>
 <|im_start|>assistant
 
-``` 
+```
 
 **Template Name:** chatml  
 
@@ -410,11 +433,12 @@ Qwen is the large language model and large multimodal model series of the Qwen T
 ---
 
 # Dophin 2.8 Mistralv02 7B
+
 This model is based on Mistral-7b-v0.2 with 16k context lengths. It's a uncensored model and supports a variety of instruction, conversational, and coding skills.  
 
 **Model Intention:** It's a uncensored and good skilled English modal best for high performance iPhone, iPad & Mac  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/dolphin-2.8-mistral-7b-v02-Q2_K.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/dolphin-2.8-mistral-7b-v02-Q2_K.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/dolphin-2.8-mistral-7b-v02-Q2_K.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/dolphin-2.8-mistral-7b-v02-Q2_K.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/cognitivecomputations/dolphin-2.8-mistral-7b-v02](https://huggingface.co/cognitivecomputations/dolphin-2.8-mistral-7b-v02)  
 
@@ -429,13 +453,14 @@ This model is based on Mistral-7b-v0.2 with 16k context lengths. It's a uncensor
 **Context Length:** 32768 tokens  
 
 **Prompt Format:** 
+
 ```
 <s><|im_start|>user
 {{prompt}}
 <|im_end|>
 <|im_start|>assistant
 
-``` 
+```
 
 **Template Name:** chatml  
 
@@ -449,11 +474,12 @@ This model is based on Mistral-7b-v0.2 with 16k context lengths. It's a uncensor
 ---
 
 # WizardLM-2 7B
+
 The WizardLM-2 is one of the next generation state-of-the-art large language models, which have improved performance on complex chat, multilingual, reasoning and agent.  
 
 **Model Intention:** It's a state-of-the-art large language model with improved performance on complex chat, multilingual, reasoning and agent.  
 
-**Model URL:** [https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/WizardLM-2-7B.Q3_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/goodmodels/resolve/main/WizardLM-2-7B.Q3_K_M.gguf?download=true)  
+**Model URL:** [https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/WizardLM-2-7B.Q3_K_M.gguf?download=true](https://huggingface.co/flyingfishinwater/good_and_small_models/resolve/main/WizardLM-2-7B.Q3_K_M.gguf?download=true)  
 
 **Model Info URL:** [https://huggingface.co/MaziyarPanahi/WizardLM-2-7B-GGUF](https://huggingface.co/MaziyarPanahi/WizardLM-2-7B-GGUF)  
 
@@ -468,11 +494,12 @@ The WizardLM-2 is one of the next generation state-of-the-art large language mod
 **Context Length:** 32768 tokens  
 
 **Prompt Format:** 
+
 ```
 A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. 
 USER: {{prompt}}
 ASSISTANT: 
-``` 
+```
 
 **Template Name:** chatml  
 
@@ -480,7 +507,4 @@ ASSISTANT:
 
 **Add EOS Token:** No  
 
-**Parse Special Tokens:** Yes  
-
-
----
+**Parse Special Tokens:** Yes