For VPet-Simulator players, this guide will show you hhow to use your Local AI Model through ooba’s webui, let’s check it out.
1. Install oobabooga text-generation-webui
https://github.com/oobabooga/text-generation-webui/releases/tag/installers
“Just download the zip, extract it, and double click on “start_windows.bat”. The web UI and all its dependencies will be installed in the same folder.”
2. Enable openai extension
- At your oobabooga\oobabooga-windows installation directory, launch cmd_windows.bat (or micromamba-cmd.bat, if you used the older version of webui installer.)
- Go to the extension’s directory by
cd .\text-generation-webui\extensions\openai
- Install the requirements,
pip3 install -r requirements.txt
- Launch webui. At the Session tab, enable openai extension. “Apply and restart” afterwards.
If everything goes okay, you’ll see this line on your console:OpenAI compatible API ready at: OPENAI_API_BASE=http://0.0.0.0:5001/v1
3. Connect to your Local API
Now it’s time to let our Chibi know how to access our local API.
- Right click on your character, select System->Settings
- Under System->Chat Settings, select “Use API requested from ChatGPT”
- Open the ChatGPT API Settings. Inside the setting panel,
Set API URL to:*If you instead set it to http://0.0.0.0:5001/v1/chat/completions you will get SocketException error . I don’t know why, but using localhost in place of 0.0.0.0 makes .Net-kun very happy.
API Key: Can be whatever. Ooba’s webui side does not check this key.
Now you can load the local LLM of your favorite, and talk with your Chibi all the things!