LLamaIndex.ts support

[jsm69]

Feature Description

Hey guys, When will Vercel AI SDK will support LLamaIndex.ts?

Use Case

RAG

Additional context

No response

[Iven2132]

@jaredpalmer @MaxLeiter @lgrammel Any updates? Will you add support for LLamaIndex.ts in Vercel SDK?

[llermaly]

FYI this library implements vercel ai + llamaindex.ts

https://www.npmjs.com/package/create-llama

[meera]

create-llama uses older ai package. Vercel now recommends to use 'ai/rsc'.

[kuldeepdaftary]

Bump. Any updates on this?

[JokeJason]

create-llama uses older ai package. Vercel now recommends to use 'ai/rsc'.

Hi, @meera , one interesting question, should we use ai/rsc or ai ui?

[namanyayg]

Did anyone manage to figure this out?

There seems to be some support with Next.js already https://github.com/run-llama/LlamaIndexTS/tree/main?tab=readme-ov-file#react-server-component-nextjs-waku-redwoodjs

But I haven't tried it out. Is it working with ai rsc?

[wakeupmh]

Did anyone manage to figure this out?

There seems to be some support with Next.js already https://github.com/run-llama/LlamaIndexTS/tree/main?tab=readme-ov-file#react-server-component-nextjs-waku-redwoodjs

But I haven't tried it out. Is it working with ai rsc?

have you tried it? @namanyayg

[namanyayg]

Did anyone manage to figure this out?
There seems to be some support with Next.js already https://github.com/run-llama/LlamaIndexTS/tree/main?tab=readme-ov-file#react-server-component-nextjs-waku-redwoodjs
But I haven't tried it out. Is it working with ai rsc?

have you tried it? @namanyayg

The TS version of LlamaIndex has basically no data loaders or similar community modules, so I found it quite useless (I wanted Slack and Jira loaders)

I abandoned it and moved to using the Python version

[wakeupmh]

Did anyone manage to figure this out?
There seems to be some support with Next.js already https://github.com/run-llama/LlamaIndexTS/tree/main?tab=readme-ov-file#react-server-component-nextjs-waku-redwoodjs
But I haven't tried it out. Is it working with ai rsc?

have you tried it? @namanyayg

The TS version of LlamaIndex has basically no data loaders or similar community modules, so I found it quite useless (I wanted Slack and Jira loaders)

I abandoned it and moved to using the Python version

I was reluctant to go to python as well

[himself65]

llamaindex-ts maintainer here.

First we have create-llama starter template with easy start, supporting both python and js/ts. by @marcusschiesser

For ts package we do lack some modules comparing with python but we are working on that. For now we do support react RSC as I'm also a maintainer of waku, but I'm still working on some code refacor (add py modules, reducing unsued imports, improving js bundler) to make sure it runs well. We don't have code example for that now but I think you can follow vercel rsc example and use the same way using llamaindex.

[nico-herrera]

bump

[marcusschiesser]

@nico-herrera, you can find the latest code for LlamaIndexTS streaming here: https://github.com/run-llama/create-llama/blob/main/templates/components/llamaindex/typescript/streaming/stream.ts - it supports the newest vercel/ai version 3.3.38.

@jaredpalmer @MaxLeiter @lgrammel Some time ago, I sent a PR for adding LlamaIndex streaming: #699 - happy to update it if you're interested.

[lgrammel]

@marcusschiesser having a llmamaindex integration would be great. we have moved to an llm interface protocol since then. Current possibilities for integration are:

• an full language model provider (if llamaindex acts like an llm)
• an adapter similar to the langchain adapter: https://sdk.vercel.ai/providers/adapters/langchain
• potentially a language model middleware focussed on RAG: https://sdk.vercel.ai/docs/ai-sdk-core/middleware

I don't know enough about llamaindex to understnd what would be best here.

[marcusschiesser]

Thanks @lgrammel, I'll have a look

[marcusschiesser]

@lgrammel I started a PR, please have a look: #3064

[lgrammel]

Thanks @marcusschiesser the llamaindex adapter will be part of [email protected]