#37 — Persistence for LLM chats

Repo: Twill-AI/facade State: open | Status: open Assignee: Unassigned

Created: 2024-07-09 · Updated: 2024-07-09

Description

Blocked by #13

Need to persist LlmEngine chats history. Aka LangChain *Message-s. Aka “session_state” in app.api.websocket_router.ConnectonManager.

AC:

• Implement persistence for LLM chats. There should be 2 storage items:
  • Raw MessageHistory storing for LlmEngine. It includes communication with LangChain tools and LangChain/LangSmith meta information.
  • User-facing prompt-answer pairs structured for “/llmchats” API.

Notes

Add implementation notes, blockers, and context here

Related

Add wikilinks to related people, meetings, or other tickets