Support Spontaneous or Consecutive Bot Messages #5

Open
opened 2024-12-05 10:18:02 +00:00 by james · 1 comment
Owner

Miku tends to send messages with incomplete thoughts. Since there's no real stop token in the text generation model, maybe I should give her the capability to send multiple bot messages in a row until the generation decides there should be a human message next.

Additionally, it would be cool to have Miku decide when to speak, rather than explicitly requiring her name to be mentioned or the bot to be tagged.

Miku tends to send messages with incomplete thoughts. Since there's no real stop token in the text generation model, maybe I should give her the capability to send multiple bot messages in a row until the generation decides there should be a human message next. Additionally, it would be cool to have Miku decide when to speak, rather than explicitly requiring her name to be mentioned or the bot to be tagged.
james added the
enhancement
label 2024-12-05 10:18:02 +00:00
Author
Owner

Will require increasing the max_tokens, should probably update the default value.

Will require increasing the max_tokens, should probably update the default value.
james changed title from Support Consecutive Bot Messages to Support Spontaneous or Consecutive Bot Messages 2024-12-22 02:01:04 +00:00
Sign in to join this conversation.
No Milestone
No project
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: james/MikuAI#5
No description provided.