#191 — [Bug]: When getting a tool error the LLM stops

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-11-12 · Updated: 2024-11-20

Description

Steps to reproduce

To reproduce: May happen with certain inputs but it is not 100% predictable. In this case it happened with the query: “show me a line graph instead”

See langsmith trace: https://smith.langchain.com/o/7b174b7e-8d5a-57f3-a607-0234b13a69eb/projects/p/4e82e501-500f-4c7e-abd5-08ce2a7ae642?timeModel=%7B%22duration%22%3A%227d%22%7D&peek=7d2d1da6-88aa-47f0-ba1a-b0edd17e6be7

What was the expected behavior?

No early stopping of the LLM engine. I.E. unhandled exception

Screenshots

image

Notes

Add implementation notes, blockers, and context here

Add wikilinks to related people, meetings, or other tickets