A second blog post about AI Chatbots. I did not expect this, but anyway, you probably encountered a complex problem that your favorite AI chat can’t solve. Whether it be Gemini, ChatGPT or anything else, you probably thought about entering the same query into another chat, to see if its response is somewhat better. Not to mention, some of the AI models require monthly subscriptions, making this somewhat expensive.

In this blog post, I am going to provide my current setup for querying multiple models, with a minimal but satisfactory UI at a very good price.

OpenRouter Somewhat hidden from Google search, openrouter.ai is a “unified interface for LLMs” offering multiple models and the ability to compare them instantly. Below, we have the main page, as you can already see, we have trending models across different categories, rankings, example prompts etc.

After I tried to chat for the first time, and used some models that require you to have credits, however I was able to use the chat without spending any money. I am not sure if this is intended, or if you get some “free” credits, but to be sure, I paid for $5 worth of credits (comes to 4.38 for some reason, probably stripe tax).

Now we are ready to dive into the chat. For this example, I selected 5 different models (WizardLM-2 7B, StarCoder2 15B Instruct, Qwen 2 72B Instruct, Gemini Pro 1.5 (preview) and GPT-4o). As we can see here, you get a fast response from each of these models concurrently, so you can examine each of their responses.

You can expand each of the chats, export these answers, remove models, as well as fine tune them as much as you want with settings such as Top K, Repetition Penalty, Max tokens etc. The only thing that is lacking here is different chat history, you only have a single chat which is not really convenient. This is where Chatbot UI comes into play.

Here, you have access to all the models, just like on OpenRouter. All you need to do is set up an account and paste your OpenRouter API key into Chatbot UI. The interface is very similar to ChatGPT, and there is a paid plan also, which I personally do not need, as it offers multiple workspaces and some other things.

There we have it, a simple guide on how to use multiple models and a good price, having them centralized with a chat history. Speaking of a good price, here is how much is one query for a couple of models I used in the previous example.

Cheap knowledge at your fingertips! What a time to be alive.