Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is it possible for local ollama? #7

Open
avacx opened this issue Jul 25, 2024 · 1 comment
Open

is it possible for local ollama? #7

avacx opened this issue Jul 25, 2024 · 1 comment

Comments

@avacx
Copy link

avacx commented Jul 25, 2024

hi, very good project!
Is it possible to run the project with local ollama llama3.1 ?

@namanbnsl
Copy link

I think this might require a writeup of some part of the code because as far as I understand, the website is directly interacting with the Together API. The Together API is OpenAI compatible and so is Ollama. Maybe you can try to change API calls to the ollama openai endpoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants