How to bind localDocs when accessing a local server via API?

[zhouruicn]

I have successfully created embedded LocalDocs, and they function correctly when selected through the UI,How to bind localDocs when accessing a local server via API?

[cosmic-snow]

Do you mean the language bindings or the web server API?

In any case, the part of the code which handles LocalDocs is implemented in the chat application, the language bindings sit at a lower level and don't have access to that code. The web server API is currently limited, too.

Basically, you'd have to implement that yourself; The database (localdocs_v2.db) is an SQLite DB, so you can definitely access that in your own code.

(At least this is the state of things as of 2024-07-20.)

[zhouruicn]

I apologize for my confusing wording. I wanted to ask how to achieve the equivalent of "select a collection to make it available to the chat model" when accessing via http://127.0.0.1:4891/v1/chat/completions, just like through the UI. Your response suggests this functionality is not yet available through the API.

[cosmic-snow]

It isn't, no. Sorry.

[cosmic-snow]

@zhouruicn I think I should clarify. When using the built-in API server:

• There is no way to activate LocalDocs with some parameter from the client which is making requests to the API server. There is an open issue about that.

• You can activate LocalDocs from within the GUI. To do that:

  1. Enable the server (obviously).
  2. Open the Chats view and open both sidebars.
  3. Scroll down to the bottom in the left sidebar (chat history); the last entry will be for the server itself. Activate that chat; it has a different backgroud colour so you know you're picking the right one.
  4. Activate one or more LocalDocs collections in the right sidebar.
  5. Use a client and make server requests now.