Update README.md

README.md

@@ -8,7 +8,7 @@ language:
 
 The language model Phi-1.5 is a Transformer with **1.3 billion** parameters. It was trained using the same data sources as [phi-1](https://huggingface.co/microsoft/phi-1), augmented with a new data source that consists of various NLP synthetic texts. When assessed against benchmarks testing common sense, language understanding, and logical reasoning, Phi-1.5 demonstrates a nearly state-of-the-art performance among models with less than 10 billion parameters.
 
-We've trained Microsoft Research's phi-1.5, 1.3B parameter model with multi-turn conversation datasets.
+We've trained Microsoft Research's phi-1.5, 1.3B parameter model with multi-turn conversation datasets and extended to 32k.
 
 ## How to Use
 
@@ -25,11 +25,11 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 
 torch.set_default_device("cuda")
 
-model = AutoModelForCausalLM.from_pretrained("voidful/phi-1_5_chat",trust_remote_code=True)
-tokenizer = AutoTokenizer.from_pretrained("voidful/phi-1_5_chat", trust_remote_code=True,device_map="auto")
+model = AutoModelForCausalLM.from_pretrained("voidful/phi-1_5_chat_32k",trust_remote_code=True)
+tokenizer = AutoTokenizer.from_pretrained("voidful/phi-1_5_chat_32k", trust_remote_code=True,device_map="auto")
 
 from fastchat.conversation import get_conv_template
-conv = get_conv_template('mistral')
+conv = get_conv_template('qwen-7b-chat')
 conv.append_message(conv.roles[0], "how to make a keyboard?")
 conv.append_message(conv.roles[1], """To make a keyboard, you will need the following materials:
 
@@ -50,30 +50,21 @@ Here is a basic outline of the steps involved in making a keyboard:
 Note that this is just a basic outline, and there are many additional steps and considerations that will depend on the specific design and requirements of your keyboard.</s>""")
 conv.append_message(conv.roles[0], "where to buy the circuit?")
 prompt = conv.get_prompt()
-inputs = tokenizer(prompt, return_tensors="pt", return_attention_mask=True)
-
-from transformers import StoppingCriteria
-class EosListStoppingCriteria(StoppingCriteria):
-    def __init__(self, eos_sequence = tokenizer.encode(".</s>[INST]")):
-        self.eos_sequence = eos_sequence
-
-    def __call__(self, input_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs) -> bool:
-        last_ids = input_ids[:,-len(self.eos_sequence):].tolist()
-        return self.eos_sequence in last_ids
 
-outputs = model.generate(**inputs, max_length=1024, stopping_criteria=[EosListStoppingCriteria()])
+inputs = tokenizer(prompt, return_tensors="pt", return_attention_mask=True)
+outputs = model.generate(**inputs, max_length=1024)
 text = tokenizer.batch_decode(outputs[:,inputs.input_ids.shape[-1]:])[0]
 print(text)
 ```
 
 ### Result
 ```
-There are many places where you can buy a MOSFET (Metal-Oxide-Semiconductor-Fluorescent) board for your keyboard. Here are a few options:
 
-1. Hardware stores: Many hardware stores carry a variety of MOSFET boards, as well as other components and tools that you may need.
-2. Online retailers: There are many online retailers that sell MOSFET boards, such as Amazon, Best Buy, and Walmart.
-3. Specialty stores: If you are looking for a specific type of MOSFET board that is not available at the above retailers, you may want to check with a specialty store that specializes in electronics components.
-4. Custom manufacturers: If you need a specific type of MOSFET board that is not available from the above retailers, you may want to consider ordering it from a custom manufacturer.
+You can buy the circuit board from a variety of sources, including:
+
+1. Online retailers: There are many online retailers that sell circuit boards, including Amazon, Best Buy, and Walmart.
+2. Electronics stores: Many electronics stores, such as Best Buy, Walmart, and Target, carry circuit boards.
+3. Specialty stores: There are also specialty stores that sell circuit boards, such as Circuit City, Best Buy, and Walmart.
 
-It's worth noting that MOSFET boards are relatively inexpensive and widely available, so you should be able to find a suitable board at a reasonable price. However, the specific board you choose will depend on your specific design and requirements.
+When buying a circuit board, it is important to consider factors such as the size and type of circuit board, the quality and reliability of the circuit board, and the cost and availability of the circuit board.<|im_end|>
 ```