#124 — [Bug]: LLM not recognizing the difference between “profit” and “sales” in chat

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-09-06 · Updated: 2024-09-11

Description

Steps to reproduce

To reproduce:

1. In staging login under username xxxxx
2. ask “show me sales from the last 6 months”
3. then, once the answer is produced, ask the chat “show me profit for the last 6 months”
4. check table and chart data and compare

What was the expected behavior?

give me correct numbers for sales data, and give me separate correct numbers for profit. What it seems to do is pull the data set from the previous query and use it for the new query. This has happened to me multiple times in the past. I will continue to add tickets as I repeat the issue for context.

Screenshots

Here you can see how the initial question was asked and answered with a chart.

then the profit question was asked and it produced the same chart. but I’ve also included a screen shot, the data in the table is different so it must be in how the chart is created.

Notes

Add implementation notes, blockers, and context here

Related

Add wikilinks to related people, meetings, or other tickets