Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
yuchenlinΒ 
posted an update Jun 9
Post
2385
Introducing **BaseChat**!
https://huggingface.co./spaces/allenai/BaseChat_URIAL

This is a demo for our URIAL paper that enables base LLMs to chat with in-context alignment. You can talk directly with base, untuned LLMs to find out what knowledge and skills they have already learned from pre-training instead of SFT or xPO or RLHF. Also, you can use this to explore the pre-training data of base LLMs by chatting! I found a very interesting case: Base version of Llama-3-8B often thinks it is built by OpenAI, lol.
In this post