#197 — Remove quick table selection step

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-11-20 · Updated: 2024-11-21

Description

We are taking out the fast get_relevant_tables step that uses precalculated embeddings here:

and replacing it with get_relevant_tables_presql which is slower and uses an LLM but is more accurate. The main reason the fast embedding step was added was to increase the speed of the system while keeping the longer running method as fallback. After observing issues in some cases and since accuracy is more valuable than speed for our product we are taking out the faster (but less reliable) method.

AC

• The get_relevant_tables step has been removed

Notes

Add implementation notes, blockers, and context here

Related

Add wikilinks to related people, meetings, or other tickets