WebRL-GLM-4-9B

Model Introduction

WebRL-GLM-4-9B is the open-source version of WebRL in GLM-4-9B released by Zhipu AI. It has the ability to complete web operations on five websites in WebArena: OpenStreetMap (Map), Reddit, GitLab, online store content management system (CMS) and OneStopShop (OSS).

Evaluation Results

We evaluated the WebRL-GLM-4-9B model on WebArena-Lite and obtained the following results:

Model Reddit Gitlab CMS Map OSS Avg.SR
Llama-3.1-8B-Instruct 0.0 3.3 2.9 3.3 11.1 4.8
GLM-4-9B-Chat 5.3 10.0 6.7 3.3 6.7 6.1
WebRL-GLM-4-9B 57.9 50.0 48.6 36.7 37.8 43.0

For more inference code and requirements, please visit our [github page](GitHub - THUDM/WebRL).

Citations

If you find our work useful, please consider citing the following paper.

@artical{qi2024webrl,
      title={WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning}, 
      author={Zehan Qi and Xiao Liu and Iat Long Iong and Hanyu Lai and Xueqiao Sun and Xinyue Yang and Jiadai Sun and Yu Yang and Shuntian Yao and Tianjie Zhang and Wei Xu and Jie Tang and Yuxiao Dong},
      journal={arXiv preprint arXiv:2411.02337},
      year={2024},
}
Downloads last month
48
Safetensors
Model size
9.4B params
Tensor type
BF16
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for THUDM/webrl-glm-4-9b

Base model

THUDM/glm-4-9b
Finetuned
(2)
this model