Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for rerank model through vercel ai sdk #3584

Open
patelvivekdev opened this issue Nov 9, 2024 · 0 comments
Open

Support for rerank model through vercel ai sdk #3584

patelvivekdev opened this issue Nov 9, 2024 · 0 comments
Labels
ai/provider enhancement New feature or request

Comments

@patelvivekdev
Copy link

Feature Description

Currently, we use embedding models from providers like Cohere and Mixedbread AI to build RAG. There are also re-rank models that can further enhance these systems.

However, to add a re-rank model while using the Vercel AI SDK, we have to manually set up API calls or use another SDK. To make this easier, support re-rank models directly in the Vercel AI SDK. This will allow developers to seamlessly integrate re-rank models and improve their language systems without extra hassle.

Use Case

https://www.mixedbread.ai/docs/reranking/overview

https://cohere.com/rerank

Additional context

As I did not find it in the docs, I am making a request. If an option is available and we can build it within this code base, I would appreciate it if someone could give me an example. So I can add it to the SDK.

@lgrammel lgrammel added enhancement New feature or request ai/provider labels Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ai/provider enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants