Silly tavern not connected to api Under Chat Completion Source, select OpenAI. As Kobold Ai is connected, we can begin to set up TavernAI firstly with our Character which you can customize the name and the picture if you scroll down. I'll check it out once I get home from work today. " What do I do? Please keep in mind that I am VERY new to this kind of thing. And there don't seem to be any other proxy front ends out there for windows other than sillytavern. Choose mistral. 127. Open the Extensions panel (via the 'Stacked Blocks' icon at the top of the page) Paste the API URL into the input box. It fails to connect and in the Ooga window, I just get repeated messages saying. Is this normal? Also, sometimes, the extras won't work so I have to restart the ST and get the API again as mentioned above. ST Kobold Horde API Connection Panel Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. FetchError: request to 网页链接 failed, reason:at ClientRequest. , and we will not recover lost or hashed passwords. 1:8020 or does it need to change to 0. We would like to show you a description here but the site won’t allow us. Is it an API issue? I made sure I port forwarded everything correctly, and it worked before, but now it just doesn't seem to. Poe AI API is a popular API key used by SillyTavern users to run the program. 2. Every time I try and use SillyTavern, no API connects. You switched accounts on another tab or window. Then, start up start server. bat" file again. " I can think of two solutions: Use a reverse proxy to assign it to a domain. Not even when I refresh the page, nor wait for 3 days. Just want you to know that as of the most current release version of silly tavern, you do not need to change the local host URL in the config. This is where your Silly Tavern interface will live. I know it's not an issue with my API key as the billing information is correct and I did troubleshooting with a friends API key that is working for them yet it did not work for me. Select one or more Models ('AI brains' for the characters) from the Model Selector at the bottom of the panel. Jul 28, 2023 · SillyTavern Poe AI API. Create New DreamGen API key Copy DreamGen API key # Connect. Select API: Text Completion; Select API Type: DreamGen; Enter the API key (optional) Pick a model 为什么api连不上啊. You signed out in another tab or window. Create A New API Key. I'm not sure if I am doing something wrong or there is an issue with the API, however, I cannot successfully get --secure to work with --share, I'm forced to turn it off in order to access the api May 22, 2023 · Have you searched for similar bugs? Yes Describe the bug Similar bug described in TavernAI/TavernAI#189 But I cannot find logs in SillyTavern to confirm To Reproduce Steps to reproduce the behavior: Start up laptop with no network. I'm not sure why; I have the --api flag on, and I checked to make sure all my ports are forwarded and everything, but it just always says it can't connect. "Type: character" is there to tell the AI that this is describing a character (as opposed to a location, object, or other type of thing). Click connect. I've disabled the api tag, and made sure the --extension openai flag is applied. In order to enable viewing your keys: Set the value of allowKeysExposure to true in config. When I'm not connected to the extras API on Silly Tavern a lot more expressions pop up but when I connect it to the API so it actually works automatically all those extra expressions disappear and it just goes down to 6 expressions. And it used to work in sillytavern like that too, but doesn't now. Windows 7 is not supported. That's actually good to know. Mistral AI is a team developing both open and proprietary models with high scientific standards and a focus on openness. The API server settings have not been changed. 1/5000/api and thats what you put in ST to connect it. If changing the API platform does not fix the issue, creating a new API key can be the solution. Under Chat Completion Source. thanks! Hey all, since I last updated Ooba, I cannot seem to connect it to SillyTavern or Agnai anymore. If you have installed anything using conda, the process is the same. Any help would be appreciated. Jan 1, 2024 · Environment Self-Hosted (Bare Metal) System Win 11 Version 1. Run Github Desktop and click on Clone a respository from the internet. The channels I mentioned have instructions for downloading and running a model in ooba, and seting up ST to communicate with it. Apr 28, 2024 · Environment 🪟 Windows System Firefox, Win 10, ollama 0. It says it is processing, so it detects alltalk running, but then just gives back "error". Become a Patron 🔥 - htt Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. com) So how to how to connect ooba booga new openai API to sillytavern ? To connect to Runpod. 0" and/or "--listen". Yep, it looks like you're not connected to API. # Connect ST to the Extras server. May 16, 2023 · I can't connect to KoboldAI, the connect button just doesn't work. Click your account icon in the top right, then View API Keys; Click "Create new secret key". Im almost to the point of making a bounty to get this shit working. I just generated a persistent API key but I didn't go down the whole 'inspect element' 'generation stream' path to finding the API key like everyone else has done because I can't figure that out. Now we go back to TavernAi and paste the URL in the API ULR box and click on Connect. Ports are open on both ends. Credits to Cohee for quickly implementing the new API in ST. As long as you can send regular (not test) prompts, you're good. Mostly because, colab either wants to load the extras link or the koboldAI link. Jul 12, 2023 · Check your connection settings / API key and try again. 这些 LLM API 可在个人电脑上运行。 它们可以免费使用，没有内容过滤器。 安装过程可能比较复杂（SillyTavern 开发团队不提供相关支持）。 Copy the API URL. yaml file. Select a character and begin chatting. Jun 23, 2023 · I have oobabooga up and running, everything works. Apr 14, 2024 · 注意：2024年4月24日，開發者在Github宣佈，SillyTavern Extras專案停止維護，大部份擴充功能已經整合到SillyTavern主程式。所以你應該不用裝這個了。 Jul 11, 2023 · Using the API key provided with the correct API URL results in a 401 unauthorized api key error, both in the application and with external software. Then generate your api keys. It doesn't actually lose connection at all, from what I can tell, as simply opening up the API menu in ST and clicking Connect will fix it every time. How can I solve this problem ? Nov 16, 2023 · Before the ooba booga gave 2 url links to plug in silly tavern (Blocking API URL & Streaming API URL) but now it gives only one url, namely the openai API URL ex: (OpenAI compatible API URL: https://fox-dietary-collection-lyrics. ai; Custom API Key: They key you copied from step 2 above. Click the 'View hidden API keys' link at the bottom right of the API Connection Panel. Check your connection settings / API key and Feb 4, 2024 · That there is the trick. 1:11434 Works fine on Linux. Then I tried to type /sd apple command in chat, the comfyui generated an image normally. SillyTavern is able to connect with Horde out of the box with no additional setup required. Any ideas? Apr 21, 2023 · Hmm, not sure what to say, other than it's still having no dice. 但是这种调整方式必然会导致ai忘记最早的记忆，那也可以引入新的正则来控制上下文，去掉上下文中不需要的部分。 Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. 0:8020? (Similar to above, hosting on Windows pc and connecting via Android on local network) Working on the pc, but can't connect via Android. A black "Windows PowerShell" window will open, and Silly Tavern will promptly open up on your selected browser. From there, you should be able to connect to it in the extensions tab of Silly. I expected the same from the extras API. slaude和酒馆都正常部署了，但是最后一步连接不上头疼 api连接不上求助【sillytavern吧】_百度贴吧 网页 资讯 视频 图片 知道 文库 贴吧 地图 采购 SillyTavern will "lose connection" with the API every so often. Nov 19, 2024 · 再就是最近deepseek官网的api能用后我也试了试，接入api后是绿色提示框api connection success，输入内容后，ai会跳对话框回应我，但对话框里没任何内容，就好像他只回了我一个空格。不知道是api用的人多导致的，还是我没设定好对应的预设和正则之类的 We would like to show you a description here but the site won’t allow us. The URL given is the one ooba runs on, plus the /api appended. I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. I have seen a suggestion on Reddit to modify the . Jan 12, 2011 · How can i successfully connect to Targon API and how can i fix this issue? You don't actually have to successuflly pass the "Test connection" check to send prompts. Copy it somewhere immediately. Download a model and setup silly tavern to connect text-generation-webui. Dec 17, 2024 · Edit: To use it on SillyTavern, You'll have to paste https://api. Select 'AI Horde' from the API Dropdown Selector in the ST API Panel. Now the Main Problem is that even after connecting with the API I am not getting any Reply to any messages I send to the bots A place to discuss the SillyTavern fork of TavernAI. You need to select KoboldAI API in SillyTavern. Application of password security and research are on-topic here. Wrong API key: Make sure you copied yours in correctly! Bad model name/url: Make sure you copied it in correctly! # HELP! - I can't connect! (No connection) Make sure you copied in the URL correctly (it should start with https, not http!) Make sure you have internet. To connect our API select the power socket icon and match each setting. To Reproduce Steps to reproduce the behavior: Go to &#39;API Connections&#39; Enter API url: A place to discuss the SillyTavern fork of TavernAI. Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. In this tutorial, I show you how to use the Oobabooga WebUI with SillyTavern to run local models with SillyTavern. But Tavern AI continually fails to connect to the link provided by KoboldAI on startup, whether it be the local or remote play. To check which modules are currently provided by the connected Extras API, import the modules array from scripts/extensions. Click the Connect button. WHOEVER HAS IT CAN USE YOUR ACCOUNT TO USE GPT AT YOUR EXPENSE. 1. I have configured the local ComfyUI URL, workflow, and related parameters in SillyTavern, and I can successfully connect to ComfyUI. It was just weird that only Mancer was doing this and not any of the other models I've used in Silly Tavern, but if this helps alleviate that issue, then Mancer will quickly take the top spot for me as it's already had better responses in general, except for that one issue Exactly as the title says. This guide is intended as a complement to the SillyTavern Documentation, not a replacement. Then restart Ooba's server. Install python,pip and git, I'm not going to put that in this tutorial because there is already a lot of it on the internet. Run SillyTavern locally. js file in st so it no longer points to openai. 0 Describe the problem I'm currently unable to connect SillyTavern to the Oobabooga Text Generation Web UI. optional - extension could be installed and will always be loaded, but any of the missing Extras API modules will be highlighted in the "Manage extensions" menu. OpenRouter may have a few free models too. 一键启动器安装·cookie使用·api使用·一次性涵盖！ ，gemini模型api使用传来噩耗，新版·安卓手机一键部署酒馆教程，薅15个月Gemini会员，1000K上下文，可以联网，可以反代，可以酒馆使用，无需魔法即可反代，无需魔法免费用gemini等模型，可联网，可酒馆，实现ai Apr 28, 2023 · Different API platforms support Tavern AI. 01:5000 is koboldai api endpoint of oobabooga. DO NOT SHARE THIS KEY. May 21, 2024 · Describe the bug. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. txt的文本文件，该文件包含您选择的Extras '密码'。 使用--secure命令行参数启动了扩展。 这使得Extras API '密码锁定'，因此只有在其API Key框中拥有该密钥的用户才能访问它。 Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. # Network issues 3. JS is installed, you can download Silly Tavern! Install GitHub Desktop. Set xtts_api_server to listen when you run it with "-hs 0. The issue I've seen for some is literally just how comfortable you are with English. app/usage/faq/ Hey, just wondering, but are you using the Horde? Try clicking on the plug and select KoboldAI from the dropdown menu, and then you should see something saying "Use Horde. Essentially, you run one of those two backends, then they give you a API URL to enter in Tavern. Sorry if this is a noob question, I never used llama. PC can't connect to API over network. sillytavern保姆级教程！一键启动器安装·cookie使用·api使用·一次性涵盖！，SillyTavern（酒馆）升级方法，酒馆教程五合一！启动器安装+cookie导入+导入预设正则+酒馆常用键解说+角色卡常用键解说！看完你就是sillytavern高手！ Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Similarly, when trying to connect to the oobabooga API, the situation is the same. Jan 4, 2024 · Connecting Silly Tavern to Ollama Once the WebUI is up click the API Connections button which looks like the white highligted icon shown in the picture below: Set the API to Text Completion Hi, I created an extension to use Stable Diffusion Webui Api in Silly Tavern, I know it has its own, but I missed to be able to pass other parameters to the command to generate images, and to use the styles of the api, it is a test version even that is what I use now myself so I think it works well enough. cpp and oobabooga as the API Type, and it does not change the Self-hosted AIs are supported in Tavern via one of two tools created to host self-hosted models: KoboldAI and Oobabooga's text-generation-webui. Text generation error{"detail":{"max_context_length":["Must be greater than or equal to 512 and less than or equal to 2048. We do not hack accounts, we are not professional support for Google, Facebook, Twitter, etc. 6 or later as a built-in extension, and available in the API Connections menu. You're going to choose chat completion. If ST is listening for remote connections but the connection attempt does not appear in the console, it is a network issue. In SillyTavern, navigate to the settings and look for the API connections section. Configure SillyTavern to use your API. In SillyTavern's top bar, click API Connections. By default, they will not be exposed to a frontend after you enter them and reload the page. Edit the CMD_FLAGS. Problem is I don't understand how to enable the API server for this. api连接不上求助. 1 Desktop Information No response Describe the problem Could not get a reply from API. SillyTavern proxies the LLM Backend connection, but not the extras. # API This is a subreddit dedicated to discussing Claude, an AI assistant created by Anthropic to be helpful, harmless, and honest. However, it seems that this feature is breaking nonstop on sillytavern. r/Passwords is a community to discuss password security, authentication, password management, etc. 1 Desktop Information Node v21. So, for my model, I've got the Ooba Booga backend utilizing the container name. Installing extra extensions (Stable Diffusion, Memory, Emotions, TTS, ChromaDB) locally. getContext() 函数让您可以访问 SillyTavern 上下文： Self-hosted AIs are supported in Tavern via one of two tools created to host self-hosted models: KoboldAI and Oobabooga's text-generation-webui. Am I doing this right? I connected the API key I have to SillyTavern and I successfully connected it but, again, I have no idea what I'm doing. Since you're using text-generation-webui, you need to use the oobabooga source. Click Connect. SillyTavern is a fork of TavernAI 1. Start your SillyTavern server; Open the Extensions panel (via the 'Stacked Blocks' icon at the top of the page), paste the API URL into the input box, and click "Connect" to connect to the Extras extension server. The tutorials are available in Matthew Berman or Aitrepneur 's youtube channels. If you have access to Anthropic's Claude API: Select 'Claude' for 'Chat Completion Source'. Go to the SillyTavern connection settings. If ST is not listening for remote connections, it is a reading issue. Run language models locally via KoboldAI on your PC. 11. js. It's not pay-as-you-go, so you can't rack up a huge bill. Just open the installer, and click on Next, Next, etc Leave everything as default. The best you can do - is to nag the API provider to add a non-streaming requests support. ¶ Installation ¶ Windows. "]}} Copy the API URL. Then, start up Sillytavern, Open up api connections options and choose text generation web ui. Jun 23, 2023 · The API key is not required for ooba, it even says (optional). A FastAPI based application that allows for generating text using an LLM using the Exllamav2 backend, with support for Exl2, GPTQ, and FP16 models. Input your API key. Make sure the API Key is copied into your clipboard. Watch MustacheAI (link below) for latest news and visual guides. I had problems running ooga's updater so I just deleted and reinstalled to (I assume) get the latest. Ooga's console shows this: SERN酒馆妙妙屋 欢迎来到SERN妙妙屋！让我们开启科学冒险吧~ 🌟 SillyTavern 酒馆一键部署教程 - 零基础超友好版本，按一下就能安装！ I installed alltalk on my pc, everything on the installation went without error, started it and now it won't even connect to sillytavern. I launched ST and in the extensions section it still says “Extensions API: Silly Tavern-Extras Could not connect to API” like it did before I installed extras, but I’m not even sure if that’s relevant or not. Start Oobabooga webui server first - see here for installing it Oobabooga Web Ui Install. Click it. SillyTavern 可以连接多种大语言模型（LLM）API。 下面介绍它们各自的优缺点和使用案例。 # 本地 APIs. Now the Main Problem is that even after connecting with the API I am not getting any Reply to any messages I send to the bots Aug 19, 2024 · 具体来说，SillyTavern允许用户自定义外部API连接器，这意味着可以通过配置文件指定目标API地址及其请求参数。对于Claude而言，这通常涉及以下几个方面： - **API密钥管理**：用户需申请并获取自己的Anthropic账户 This video shows how to install SillyTavern locally on Windows and how to connect it to Ollama privately and locally for roleplay. The other Kobold AI connection in ST is for you to use as an interface between a LLM you run on your local computer at ST - so when you start the LLM you will get a local address popping up in the command screen that looks like 127. This feature is enabled by default starting from SillyTavern 1. TheBloke's huggingface site has several models. Configure Oobabooga’s Web UI API Connection. Like so: python -m xtts_api_server -hs 0. Install Node. Then paste your api code into the api key. It's uncensored, so no infantalizing slaps on the wrist. Hello everyone, I am new to ST extras, everytime I open ST I have to run the online colab to get the new link again for the API, otherwise I cannot use the extras with the message "could not connect to API". DO NOT CLOSE THE BLACK WINDOWS POWERSHELL WINDOW. txt file, and add the --api flag there. I'm trying to use a model not offered in the Colab, so running it locally is my best option. Sillytavern says (could not connect to the API) i want to try out all of the features but no dice. Read the Doc, refer to the Doc, make it your ST bible! Jul 31, 2023 · The issue lies on when SillyTavern tries to fetch the version and model from the API, these two requests sometimes fail, telling SillyTavern either: The API is down (causing issue 1) Streaming isn't supported because it can't get the version (causing issue 2) Isn't sending stop sequences to the API, because it can't get the version (causing Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. May 13, 2024 · When I try to connect to the koboldcpp API over the local network, nothing happens (no connection). A place to discuss the SillyTavern fork of TavernAI. To enable viewing your keys by clicking a button in the API block: # Get API Key. But it doesn't seem to want to connect. 0 --listen In silly tavern, should the provider endpoint then remain 127. totalgpt. 启动您的 SillyTavern 服务器，并在浏览器中查看 SillyTavern 界面。 打开扩展面板（通过页面顶部的“叠块”图标） 将 API URL 粘贴到输入框中。 点击 Connect。 要再次运行 Extras，只需激活环境并在命令提示符中运行以下命令。 Welcome to r/Sauna! This is a subreddit for all things Sauna - Pictures of You and your Sauna - Sharing your building progress and questions - Whatever else you can think of Sauna related - Saunas are used around the world and we want to hear from you! Apr 28, 2023 · Different API platforms support Tavern AI. This is a problem, as SillyTavern WILL NOT connect without an API key. I believe the default "localhost" address it loads with is the correct one. If you don't know what this means, you might want to read the faq: https://docs. To run again, simply activate the environment and run these commands. SillyTavern has very serviceable presets, so no problem there. " This also means I'm not getting a response from the chatbots. Go to the DreamGen API keys page and click the "New API Key" button. Refreshing the page also works. For beginners, the Horde API is now a good start (free, uncensored models). Jun 14, 2024 · Environment 🪟 Windows System win11，edge、chrome、firefox Version 12. . 5. When you say source, do you mean the API Type? I have tried setting both llama. If it worked it should now say under the ULR box, A green Circle and PygmalionAI/the version you chose. Copypaste the adress Oobabooga's console gives you to Api connections and connect. Make sure that line has "= true", and not "= false". 2. Sep 19, 2024 · I have a valid API key from NotDiamond AI platform and its compatible with OpenAI, but whenever i open Silly Tavern's Custom Connection menu in Chat Completion section and input the base URL and my API key and hit "Connect", i always get a "Not Found" Error, even though the same link works in the browser and gives "Welcome to Not Diamond API Be sure that you remove --chat and --cai chat from there. A community to discuss about large language models for roleplay and writing and the PygmalionAI project - an open-source conversational language model. Github - https://github. 0 Desktop Information No response Describe the problem When trying to connect to a ollama server on the same computer i get Mar 19, 2025 · hello i just installed koboldAI locally and sillytavern but i cant figure out how to connect them i set the api url to my local and it says connected but when i try to say anything it give me . Restart the SillyTavern server. If not, copy and past the IP address of the window that Kobold opened in your browser. Update text-generation-webui and launch with the --api flag, or alternatively launch it through this Google Colab Notebook with the api checkbox checked (make sure to check it before clicking on the play buttons!) From here "First, of course, is to run web ui with --api commandline argument So in your "webui-user. I tried all zeros, to no avail. Install Poe-API-Server manually (without docker) - Step 1: Python and git. By using in base Tavern it means you're using an api extension and putting an endpoint URL as for Kobold? Yes, exactly. You can encounter a Tavern AI no connection issue if one of those APIs does not support your device. Never both at the same time so, theoretically it works you just need a second means of hosting the other api url UPDATE!!: Use Horde as the AI model API URL. Under API, select Chat Completion (OpenAI). In SillyTavern's top bar, click API Connections; Under API, select OpenAI I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. # Mistral AI. 8 which is under more active development, and has added many major features. sillytavern. Configuring these tools is beyond the scope of this FAQ, you should refer to their documentation. Still unable to connect? If the connection attempt appears in the console, but is forbidden, it is a whitelist issue. x. Once Node. json file. Paste the API key you saved in the previous step. I run ooga, which defaults into chat mode without API, so I turn off everything, enable API, set chat to default and apply/restart. If you close this window, our Silly Tavern page will not function until you open the "Start. json file in the server directory. Describe the bug When trying to connect to koboldcpp using the KoboldAI API, SillyTavern crashes/exits. Now that I'm using the host's IP (which proxies the open port to the container), I'm reaching it from Silly Tavern. This is because you will need to set up an API to run SillyTavern, which is a popular program that allows users to roleplay with natural language AI chatbots as characters. If you wish to disable it, open the Extensions panel, click on "Manager extensions", locate Connection Profiles in the list, uncheck the "Enabled" checkbox, and then click "Close". Reload to refresh your session. com but when I try to connect to lm studio it still insists on getting a non existent api key! This is a real shame, because the potential of lm Aug 30, 2023 · 5. As far as clicking bypass authentication, still necessary. May 16, 2023 · You signed in with another tab or window. Loading this address gives: {"detail":"Not Found"} To Reproduce Steps to reproduce the behavior: Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Jun 22, 2023 · MORE INFO: I'm running this locally, so no API key is given. Connect ST to http://localhost:5000/ (by default) without checking the Apr 17, 2023 · When I try to connect to Pygmalion running on Oogabooba, it doesn't work. # Scripting # Using getContext So I am running ollama on my Linux machine and I want to access it from my PC running silly tavern. When I try to connect to the API Key, it just says "settings cannot be saved check the server connection and reload the page to prevent data loss. Make sure you're on the latest update of Oobabooga's TextGen (as of Nov 14th, 2023). Then hit ‘connect’ connect to our API. Running SwarmUI official docker with ComfyUI Backend Extension. --api is enabled I start SillyTavern, click on API, select the Text Gen WebUI ooba and click connect, but it doesn't connect. 9 Desktop Information Running SillyTavern official docker. But until I do one of those things, ST will refuse to send anything to KoboldCPP. Add the Horde API key and then, you should be able to add the Extras API URL. and You can paste the API key in API key field. Jan 23, 2025 · I can't connect to the API key because it says that there is an invalid csrf token. Claude does not actually run this community - it is a place for people to talk about Claude's capabilities, limitations, emerging personality and potential impacts on society as an artificial intelligence. 12. optional - 扩展可以安装并且将始终加载，但缺少的任何 Extras API 模块将在“管理扩展”菜单中突出显示。 要检查当前由连接的 Extras API 提供哪些模块，请从 scripts/extensions. 现在就是这个样子，连不上去，一直显示No connection 为什么api连不上啊【sillytavern吧】_百度贴吧 网页 资讯 视频 图片 知道 文库 贴吧 地图 采购 8. Then in silly tavern you are going to go to api selection. Sep 12, 2024 · When selecting "Available Voices" I get "could not load voices list. Therefore, changing the API platform can fix the issue. SillyTavern saves your API keys to a secrets. I've tried all 3 options, none work. ai/v1 in the server URL section. bat": set COMMANDLINE_ARGS=--api" That way when you run it, near where it says running on local URL it will have an API link - thats what you put in your SillyTavern, then press the connect button. I know there's probably a simple solution, but still, any help would be appreciated. Ai 'the bloke llm' running oogabooga, I can get the model loaded running interfacing nicely through its standard web interface But I cant get a remote terminal / Silly tavern to connect properly even with the API & OpenAI flag enabled in ooogabooga Jan 18, 2024 · While text-generation-webui does use llama-cpp-python, you still need to select the appropriate API source in SillyTavern. " Correct Way to Connect SillyTavern to Ooba's new OpenAI API. cpp directly before but I saw some people saying it's much faster when used directly compared to when used inside Oobabooga Text Gen. alpindale. The screenshot is outdated due to the API being rewritten and transformed into Text Completion type, with Default being the ooba option. Using default address/port 127. dev/local-installation-(gpu)/koboldai4bit/If link doesn't work - ht By default, API keys will not be visible from the interface after you have saved them and refreshed the page. This renders this extras utility a paperweight. 32 Version 1. Apr 24, 2024 · Make sure that line has "= true", and not "= false". Finally got it working 100%! 复制 API URL。 # 将 ST 连接到 Extras 服务器. Dec 20, 2024 · Environment 🐧 Linux System Fedora 40 Version 1. At this Using third-party extensions can have unintended side effects and may pose security risks. Copy it and make sure to save it somewhere secure as you will not be able to see the full thing again. js LTS. I've checked, and the api is correct. Described on the page you linked: create an environment, activate it, download python to it, clone the repository, install the requirements, then Run the Extensions API server. You can run their models locally or through their API service, La Plateforme. API: Text Completion; API: Infermatic; Custom Endpoint (If selected vLLM or Aphrodite): https://api. Text version - https://docs. This is not a "local" service, you need to be able to connect to us. com/SillyTavern/SillyTavern-extras#option-2-- Dec 17, 2024 · Edit: To use it on SillyTavern, You'll have to paste https://api. Nov 11, 2024 · Generation API: localhost comfyui; Branch: staging; Model: sdxl; Describe the problem. trycloudflare. The API by default uses grok-2-1212 model for now. After that, you should be able to go back to Tavern and hit the "connect" button to turn the red light green. 0. <anonymous> (D:\ST\SillyTavern\nod very time I try and use SillyTavern, no API connects. # Configure SillyTavern to use your API. # API 连接. I'm using sillytavern on mobile. Check your API key. Getting the API key is simple. I can't seem to be able to connect SillyTavern or Agnai to Ooba anymore. SillyTavern的扩展面板中的API Key框仅在您： 在您的Extras安装文件夹中创建了一个名为api_key. js 导入 modules 数组。 # 使用 getContext. The rest of the attributes are optional, and some are redundant (for example, Personality, Mind, and Mental all mean basically the same thing), but these have been tested and work well with NovelAI's models. Edit: I got it to finally work. Please help, how do I fix this? Edit: It can connect when I use Horde, but not when I don't, for some weird reason. 酒馆部署以后连接不上. Start your SillyTavern server, and view the SillyTavern interface in your browser. Always make sure you trust the source before importing an extension via Install extension. Install oobaboga. Or server. rra rnb tnqc wjccw ejkz zlgm kqxrp tchd vcfby ugzp