You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have quite limited knowledge on TS or yarn. By poking around I came to the following minimal changes required to talk to a local LLM hosted with Ollama (in my case a Gemma 2B).
Please note that you need a an OpenAI key and Bing key in your environment. OpenAI Key is required as GPT-3 is used for the 'tool' selection process (e.g. if to use search or stocks or weather). Replacing that by Ollama will likely require a fine-tuned prompt.
Also note that I had to comment out the Firebase Authentication. Otherwise the web app would not correctly start.
Would be nice to support self hosted LLMs. It doesn't have to be ollama, but it seems to be fairly easy to interface with.
The text was updated successfully, but these errors were encountered: