#143 — [Bug]: LLM is pulling things like “document number” to describe expenses when it should be giving more descriptive information
Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta
Created: 2024-09-26 · Updated: 2024-10-01
Description
Steps to reproduce
To reproduce:
- In staging ask “show me my expenses from July this year”
- see tables produced
What was the expected behavior?
I expected it to … give me descriptive information of my expenses and show a visualization to help me understand.
Screenshots
This is a good conversation to dissect because there a few issues to address: https://fluffy-winner-lm32gle.pages.github.io/library/thread?id=13
-
You can see that two table are created, I’m assuming one is for “bills” and one is for “expenses” which is good that it brought in both tables.
-
However, In the first table there is no descriptive information about what that bill was for. You have “document number”, but I’m sure there is a vendor attached here per our discussion this morning.
- I’m also seeing the following quite a bit, must be related to the “bills” table. Instead of pulling in the amount of the bill in the table, it pulls in currency code for some reason. We don’t care about currency code in 99% of situations.
but then when you look at the data table that the chart was created off of,
Notes
Add implementation notes, blockers, and context here
Related
Add wikilinks to related people, meetings, or other tickets