You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Many models use CoT finetuning or prompting which usually results in "thoughts" enclosed in "thinking" tags like: <thinking>Thought tokens<thinking> which are used to improve the quality of the output of the model. ChatGPT o1 hides its thinking and indicates to the user that thinking is occuring. It would be helpful to see the same in the Cohere chat, by hiding tokens when a tag is outputted and displaying them when the next tag is outputted.
Without this feature, the chat will display the thinking tags and tokens to the end user which is not the desired effect when using CoT.
Additional information
This could be a more general UI component which is a collapsable chat element and could also contain unwieldy information like large code outputs. I am open to discussing the implementation.
The text was updated successfully, but these errors were encountered:
bcicc
changed the title
CoT "Thinking" Support
CoT "Thinking" UI Support
Sep 19, 2024
What feature(s) would you like to see?
Many models use CoT finetuning or prompting which usually results in "thoughts" enclosed in "thinking" tags like:
<thinking>Thought tokens<thinking>
which are used to improve the quality of the output of the model. ChatGPT o1 hides its thinking and indicates to the user that thinking is occuring. It would be helpful to see the same in the Cohere chat, by hiding tokens when a tag is outputted and displaying them when the next tag is outputted.Without this feature, the chat will display the thinking tags and tokens to the end user which is not the desired effect when using CoT.
Additional information
This could be a more general UI component which is a collapsable chat element and could also contain unwieldy information like large code outputs. I am open to discussing the implementation.
The text was updated successfully, but these errors were encountered: