#56 — Add context info to LLM engine (Umbrella Task)

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-07-09 · Updated: 2024-11-07

Description

When interacting in different scenarios we need the LLM to have context about:

  • #163
  • #164
  • #165

This context will be provided by facade when calling the EngineConnector.answer_in_chat method.

AC:

  • The LLM engine can receive this contextual information and use it accordingly
  • The interface is updated to receive the new context information from facade
  • Tests are written to cover this new functionality

- moved the AC to each new task.

Related facade side of this task https://github.com/Twill-AI/facade/issues/111

NOTE 1: We have split up this task into 3 separate, keeping this as an umbrella card. NOTE 2: Originally this task contained more “context” use cases like state of the UI and user/tenant memories. These are out of scope for now and have been moved to separate tasks: UI state task, memories task.

Notes

Add implementation notes, blockers, and context here

Add wikilinks to related people, meetings, or other tickets