mintii

An AI-powered platform that optimizes large language model selection, reducing costs while maintaining high performance.

Mintii

Hello everyone. This is Martin from Mintii. 

And today I'm going to show you a quick demo of how our platform works. This is the dashboard. Here you can see the usage that you have had so far. 

And then you can go to chat and actually try out the router. So let's say hello. How are you?

Let's try that out. There we go. You can see the model, the response time, the tokens, and the difficulty of the question. If you want to build your own custom router, you can go to custom router and start a customization. For this, you have to select models for every difficulty of the.

Prompt so let's start with easy. You can select this this and this model for example to try out. And we can say hello let's test the selected walls. There we go you can see the responses of from all of them. You can see the price and also the time it took to response. So let's say we.

Want this one for the easy prompts for medium. Let's select another model. Let's say this one and for o. Let's ask something else. Tell me a story about uh fish. Let's try that one. 

Let's test the selected models. All right, there we go. We can expand on both of them since it's going.

To be a little bit longer. Okay, let's see. We have we can and read them through and we say okay. So 40, it's taking 18 minutes a lot of time. Let's go with this one better than hard prompt. You already got what it is. So let's just say something like hello. Let's just select this model.

And there we go. Once we have the configuration set, we finalized the configuration and we can try it out. Let's say now, now hello, how are you? And we can try out the model. There we go. This is the small model we selected because the difficulty is very easy. What else can you do you?

Can go to evaluations and see all the evaluations that we have had so far. There we go. So how is our router performing from what we've done so far against a benchmark which is another model? You can see that also at one prompt level. And you can also see the detail of the

Evaluation as well. What else can you see? You can then go to integration. And yeah, that it is. That is the main functionalities. Thank you very much.

Note, that there may be slight differences in text and video. Watch video for the original content.

Mintii Video