The LLMs dont have RL baked into them. They need that at the token prediction level to be able to do the sort of things humans can do