Chat Generative UI

[Alwurts]

Hey team,

I've got the project up and running on my machine, and it's looking great! One thing that stood out to me is the potential for using the LLM to create a more interactive UI. For instance, when showing users follow-up topics, we could display a panel with quick selection options for the recommended topics.

I noticed that "Try out the generative UI stuff from Vercel" is on the roadmap, and I'm guessing this refers to the Vercel AI SDK, especially the AI SDK RSC.

Using this SDK might involve:

• Tweaking some chat functionality to use server components and server actions.
• Creating a TogetherAI llama model provider that works with the Vercel AI SDK, like they describe here.

Have you thought about how this might look? I’d love to help out with this part of the project.

Looking forward to hearing your thoughts!