Twill Brain

#169 Too long persisting of LlmChatItem-s

2 min read

#169 — Too long persisting of LlmChatItem-s

Repo: Twill-AI/facade State: open | Status: open Assignee: Unassigned

Created: 2024-10-28 · Updated: 2025-09-15

Description

From logs (2024-10-25 16:05:34.621|INFO|VxMdGrp31q|websockets_router:1054):

LLM Engine answered in 9.966 sec on text prompt in LLM Chat 2, persisted 2 items in 0.558 sec.
LLM Engine answered in 34.683 sec on text prompt in LLM Chat 2, persisted 2 items in 0.695 sec.
LLM Engine answered in 27.820 sec on text prompt in LLM Chat 2, persisted 3 items in 0.610 sec.
LLM Engine answered in 27.366 sec on text prompt in LLM Chat 2, persisted 3 items in 0.738 sec.
LLM Engine answered in 12.348 sec on text prompt in LLM Chat 2, persisted 3 items in 0.617 sec.
LLM Engine answered in 17.262 sec on text prompt in LLM Chat 2, persisted 4 items in 0.692 sec.
LLM Engine answered in 21.436 sec on text prompt in LLM Chat 1, persisted 3 items in 0.985 sec.
LLM Engine answered in 22.108 sec on text prompt in LLM Chat 1, persisted 3 items in 0.709 sec.

I.e. average persisting time is 0.65 sec, which is too much for 3 items.

AC:

  • Investigate what causes so long persisting. Fix if possible.

Notes

Add implementation notes, blockers, and context here

Add wikilinks to related people, meetings, or other tickets

Graph View