2822 shaares
32 private links
32 private links
The above command enters you into a chat loop. You can talk to the model and share information like your name. Every now and then /sleep the model to transition short-term memory to long-term memory
The /sleep command:
Generates Q&A pairs based on the context
LoRA fine-tunes the model on the new Q&A pairs plus any from previous sessions
Resets the KV cache
After the /sleep command the model should remember context from previous sessions even though that context is no longer in the KV cache.