Update README.md

README.md

@@ -21,10 +21,16 @@ Initial subjective testing has shown that this model can chat reasonably well in
 ## How to use
 
 ```python
-from transformers import AutoModelForCausalLM, AutoTokenizer
+from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
+import torch
 
-model = AutoModelForCausalLM.from_pretrained("kinokokoro/jamba_airoboros3.2_sharegpt4",
-                                             trust_remote_code=True)
+double_quant_config = BitsAndBytesConfig(
+   load_in_4bit=True,
+   bnb_4bit_use_double_quant=True,
+   bnb_4bit_compute_dtype=torch.float16
+)
+
+model = AutoModelForCausalLM.from_pretrained("lightblue/Jamba-v0.1-chat-multilingual", device_map="auto", quantization_config=double_quant_config, trust_remote_code=True)
 tokenizer = AutoTokenizer.from_pretrained("kinokokoro/jamba_airoboros3.2_sharegpt4")
 
 input_text = """<|im_start|>system 
@@ -48,7 +54,7 @@ print(tokenizer.batch_decode(outputs)[0])
 # What is the most interesting fact about kangaroos that you know?
 # <|im_end|> 
 # <|im_start|>assistant
-# One of the most interesting facts about kangaroos is their unique reproductive system, known as "delayed implantation." After mating, the fertilized egg remains dormant in the female's uterus for up to six months before it starts developing into an embryo. This allows the mother to time the birth of her offspring with optimal environmental conditions and food availability.<|im_end|>
+# One of the most interesting facts about kangaroos is their unique reproductive system, which involves embryonic diapause and multiple births. Female kangaroos can have up to three joeys at different stages of development simultaneously: one fully developed in the pouch, another developing inside her body, and an embryo waiting for its turn.<|im_end|>
 # <|endoftext|>
 ```