"observation" role in tokeniser

#11
by vicgalle - opened

Hi! Thank you very much for the release of this nice family of models!

I've noticed that there is a special role "observation" in the tokeniser specification (https://huggingface.co./THUDM/glm-4-9b-chat/blob/08914867436b750c287539795e63c24631273878/tokenization_chatglm.py#L134)

Could you please give an explanation for the use of that field?

Hi! Thank you very much for the release of this nice family of models!

I've noticed that there is a special role "observation" in the tokeniser specification (https://huggingface.co./THUDM/glm-4-9b-chat/blob/08914867436b750c287539795e63c24631273878/tokenization_chatglm.py#L134)

Could you please give an explanation for the use of that field?

It is the identifier triggered by function_call

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

这个角色是给function返回的时候用的,工具字段,代表工具的返回

vicgalle changed discussion status to closed

Sign up or log in to comment