Technology
Mistral Patent for "Code implemented tool calls"
Key Points
| CPC G06F 9/547 (2013.01) | 20 Claims | | 1. A method, comprising: receiving, at a server, a user request for execution of one or more tool calls; generating, by a large language model (LLM), a code block in a programming language, the code block configured to encapsulate the one or more tool calls; executing, by the server, the code block in a sandbox; in response to obtaining a pending tool call, pausing execution of the code block; transmitting the pending tool call to a client for...
| CPC G06F 9/547 (2013.01) | 20 Claims |
|
1. A method, comprising:
receiving, at a server, a user request for execution of one or more tool calls;
generating, by a large language model (LLM), a code block in a programming language, the code block configured to encapsulate the one or more tool calls;
executing, by the server, the code block in a sandbox;
in response to obtaining a pending tool call, pausing execution of the code block;
transmitting the pending tool call to a client for execution;
receiving, from the client, a first result of the pending tool call;
resuming execution of the code block and substituting the first result of the pending tool call for the pending tool call in the code block; and
returning a second result of the executed code block to the LLM.
|