Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CoT "Thinking" UI Support #782

Open
bcicc opened this issue Sep 19, 2024 · 0 comments
Open

CoT "Thinking" UI Support #782

bcicc opened this issue Sep 19, 2024 · 0 comments

Comments

@bcicc
Copy link

bcicc commented Sep 19, 2024

What feature(s) would you like to see?

Many models use CoT finetuning or prompting which usually results in "thoughts" enclosed in "thinking" tags like: <thinking>Thought tokens<thinking> which are used to improve the quality of the output of the model. ChatGPT o1 hides its thinking and indicates to the user that thinking is occuring. It would be helpful to see the same in the Cohere chat, by hiding tokens when a tag is outputted and displaying them when the next tag is outputted.
Without this feature, the chat will display the thinking tags and tokens to the end user which is not the desired effect when using CoT.

Additional information

This could be a more general UI component which is a collapsable chat element and could also contain unwieldy information like large code outputs. I am open to discussing the implementation.

@bcicc bcicc changed the title CoT "Thinking" Support CoT "Thinking" UI Support Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant