#133 — Turn tool calls to parallel coroutines

Repo: Twill-AI/twill-llm-engine State: closed | Status: done Assignee: meliascosta

Created: 2024-09-13 · Updated: 2024-09-16

Description

In the current implementation tools are executed sequentially which causes delays in cases where multiple plots are triggered at the same time. We would like to use asyncio.gather to calculate function outputs concurrently.

AC:

• Tools are executed concurrently

Notes

Add implementation notes, blockers, and context here

Related

Add wikilinks to related people, meetings, or other tickets