OpenAssistant

/

oasst-rm-2.1-pythia-1.4b-epoch-2.5

like 28

Getting:
KeyError: 'gpt_neox_reward_model'

With:
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model_name ="OpenAssistant/oasst-rm-2.1-pythia-1.4b-epoch-2.5"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSequenceClassification.from_pretrained(model_name)
input_text = "<|prompter|>Hi how are you?<|endoftext|><|assistant|>Hi, I am Open-Assistant a large open-source language model trained by LAION AI. How can I help you today?<|endoftext|>"
inputs = tokenizer(input_text, return_tensors="pt")
score = rm(**inputs).logits[0].cpu().detach()
print(score)