Long-term Memory #3

New Issue

james · 2024-04-06T04:42:52Z

james commented

2024-04-06 04:42:52 +00:00

As discussed in #2, long-term memory could help boost Miku's performance in maintaining natural conversations. Because she has no memory greater than the <= 5 message context fed in during inference, she quickly forgets the subject of the conversation once it shifts to using pronouns only. She also contradicts opinions that she said earlier since she's trained on a hivemind of several people and she's incapable of remembering. Obviously, what we want to happen is for her to form an opinion once and then remember it.

I'm interested in the BrainChulo implementation specifically. GSWs may prove to be even more useful, too, once I stop fooling around and get back to doing real NLP research.

As discussed in #2, long-term memory could help boost Miku's performance in maintaining natural conversations. Because she has no memory greater than the <= 5 message context fed in during inference, she quickly forgets the subject of the conversation once it shifts to using pronouns only. She also contradicts opinions that she said earlier since she's trained on a hivemind of several people and she's incapable of remembering. Obviously, what we want to happen is for her to form an opinion once and then remember it. I'm interested in the [BrainChulo](https://github.com/ChuloAI/BrainChulo) implementation specifically. GSWs may prove to be even more useful, too, once I stop fooling around and get back to doing *real* NLP research.

james added the

enhancement

question

labels 2024-04-06 04:42:52 +00:00

james referenced this issue

2024-04-06 04:44:51 +00:00

New Training Methods #2

Sign in to join this conversation.