Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Return the execution result for the provider execution tools #3439

Open
minpeter opened this issue Nov 1, 2024 · 3 comments
Open

Return the execution result for the provider execution tools #3439

minpeter opened this issue Nov 1, 2024 · 3 comments
Labels

Comments

@minpeter
Copy link
Contributor

minpeter commented Nov 1, 2024

Feature Description

Search Grounding in Google Vertex AI, codeExecution in Google Generative AI, and built-in tools in Friendli Provider provide tools like search, code execution.

These tools reduce the need to define and worry about repeated tool definitions and behaviors, and reduce the latency of tool execution.

If we call these kinds of tools provider-executed tools, the current AI sdk does not allow us to know the execution status and results of the tools executed in the provider.

I think it would be a great improvement to be able to know whether these provider-executed tools are executed and to be able to check the results.

As a developer of the Friendli community provider, I tried to implement this, but ai/core does not provide an appropriate way to do so.

There is an issue related to this.

What makes it hard to leave provider execution tool results...?

LanguageModelV1StreamPart structure does not have tool-result.
At least I expect that tool-result will be generated here and if it is properly parsed, it will be possible to implement it.

Use Case

Even if you use the above function, you can show the tool call status to the user's AI.

Additional context

I'm not sure if this is a legitimate restriction. I just hope it's reviewed positively.
In the case of claude's compute vision, which is a provider-defined tool, it is to define the schema of the tool, but the above Search Grounding
It will be a cool feature.. :)

@kjy3309
Copy link

kjy3309 commented Nov 1, 2024

I strongly support this feature request.
I'm currently facing the same issue while building a backend with LangGraph and using ai-sdk. The ability to access provider-executed tool results would be extremely valuable for our development workflow.

@lgrammel
Copy link
Collaborator

lgrammel commented Nov 1, 2024

This is a important request and something I've been thinking about. It'll have to come post 4.0, i.e. 2nd half of November or early December, since we have started a feature freeze.

@minpeter
Copy link
Contributor Author

minpeter commented Nov 1, 2024

I'm really looking forward to the release of AI SDK version 4.0. 🤩

@lgrammel lgrammel added enhancement New feature or request ai/core ai/provider labels Nov 1, 2024
@minpeter minpeter changed the title Return the execution result for the provider provider execution tools Return the execution result for the provider execution tools Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants