TextGenWebUI

TextGenWebUI is a comprehensive, open-source language model UI and local server. You can set it up with an OpenAI-compatible server plugin, and then configure it in your config.json like this:

config.json

{
  "models": [
    {
      "title": "Text Generation WebUI",
      "provider": "text-gen-webui",
      "apiBase": "http://localhost:5000/v1",
      "model": "MODEL_NAME"
    }
  ]
}