#240 — [Bug]: LlmEngine may not fail even without db an LLM iteractions

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2025-01-21 · Updated: 2025-01-27

Description

Caused by https://github.com/Twill-AI/twill-llm-engine/issues/238

Steps to reproduce

To reproduce:

  1. Open Facade tests, uncomment part of test_handle_chat_prompt_text__check_llm_engine_integration test in it.
  2. Execute the whole TestWsApi test class or all tests in console without debugger (it doesn’t repro under debugger).
  3. Check failed tests.

What was the expected behavior?

I expected “test_handle_chat_prompt_text__check_llm_engine_integration” test to pass - it expects error.

Screenshots

Test fails because LlmEngine produced valid output. Probably because of inner caching.

Need to

Notes

Add implementation notes, blockers, and context here

Add wikilinks to related people, meetings, or other tickets