These tokens are almost universally used as stop tokens which causes generation to stop and return control to the user.
If you didn't do this, the model would happily continue generating user + assistant pairs w/o any human input.
These tokens are almost universally used as stop tokens which causes generation to stop and return control to the user.
If you didn't do this, the model would happily continue generating user + assistant pairs w/o any human input.