#147 — [Bug]: How do we make the system give us the most relevant items when asked a question.

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-09-30 · Updated: 2025-01-09

Description

Steps to reproduce

To reproduce:

1. In staging login under username mike@twillpayments.com
2. ask “show me a chart comparing monthly expenses over the last 3 years”
3. ask “what caused the big jump in expenses in April of 2022?”
4. …

What was the expected behavior?

Two Issues here:

1 - I expected it to give me an outlier expense that was not present in other months that accounted for the large jump.

2 - I expected it to produce a chart with 3 lines, one for each year, on a January - December X axis. The system seems to have massive problems generating any overlaid charts, it doesn’t do it.

Screenshots

Here you can see the big spike in April:

Then we ask why this happened and it gives a bunch of smaller expenses that are normal, not causing the spike:

Then I asked what the biggest expense was and it found a large withdrawal, this should have been highlighted first, “the reason for this spike was a $400k… ”

Notes

Add implementation notes, blockers, and context here

Related

Add wikilinks to related people, meetings, or other tickets