#65 — Optimize set role query in LLM

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-07-17 · Updated: 2025-01-09

Description

Ay the moment, the set role query is run before every query. Would be better to run it once per connection.

Add implementation notes, blockers, and context here

Add wikilinks to related people, meetings, or other tickets