Aivaa

Bring Your Local LLM Online
Chat & Share with Aivaa

Once you've made your local LLM globally accessible using tools like ngrok, Aivaa becomes helpful. Our user-friendly chat interface lets you interact with your LLM from anywhere, while our innovative share feature enables you to create time-limited access links for friends and colleagues. Experience the freedom of chatting with your AI on-the-go and the excitement of sharing your model's capabilities with others all through Aivaa's intuitive platform.

Features

Intuitive Chat UI

Save your conversations automatically. Easily review past dialogues and insights, making your AI interactions more productive.

Share Feature

Generate time-limited links to let friends experience your AI. Foster collaboration and explore your model's capabilities.

Shared Chat Archives

Receive and review chat logs from friends who used your shared AI. Analyze how others interacted with your model, gaining valuable insights for improvements.

Recommended for the following users

This service is free to use.

For those who want to remotely access and AI chat with their local AI

For those who want to share and let others experience the LLM running on their own PC

For those who want to share and verify system prompt settings with friends

Enjoy the Convenience of Using Your Local LLM Anywhere

Aivaa provides a simple and user-friendly chat interface. Conversation histories are automatically saved for each chat, allowing past dialogues to be reviewed at any time. Additionally, users can adjust system prompts and Temperature settings to customize their AI interactions.

Want to let your friends try out your local LLM too?

With our share feature, it's easy to make it happen! Simply generate a time-limited link and share it with your friends. They'll be able to access AI chat from their PC or mobile device.

On the shared chat archive page, users can upload and send the chat history back to the user who shared it. This allows you to check the results of your friends' interactions with the AI. This feature is particularly useful when testing the AI's responses with friends, as it also reflects the system prompt settings. By reviewing these shared conversations, you can see how the AI behaves under specific system instructions, making it easier to evaluate and compare different prompt configurations.

How to use Aivaa

This service is currently in a trial phase.

Open detailed article

Preparations (for MAC OS)

First, sign up for an ngrok account and follow the guide to set up the free plan. ( https://ngrok.com )

Ollama ( https://ollama.com )

Set up Ollama.
Launch it and download your preferred Model to make it ready for use.
Use ngrok to generate a public URL.

Example

$ ngrok http 11434

Launch Ollama. Specify the public URL obtained earlier for ORIGIN.

Example

$ OLLAMA_NUM_PARALLEL=3 OLLAMA_HOST=0.0.0.0:11434 OLLAMA_ORIGINS='https://XXXXX.ngrok-free.app' ollama serve

For OLLAMA_NUM_PARALLEL, specify the number of requests to be processed simultaneously for a single model.

Test whether the Model you intend to use operates smoothly with public URL from curl or other tools.
https://XXXXX.ngrok-free.app/v1/chat/completions

Using Aivaa

Log in to Aivaa and select LLM from the menu.
In the dialog box, register the public URL from earlier and an available model name.

Append "/v1" to the end of the issued public URL.

Example

https://XXXXX.ngrok-free.app/v1

You can now start using Aivaa.

It is recommended to stop ngrok after you finish using Aivaa.

Share LLM

With the Share LLM feature, you can create a chat page for your friends to try out.
You can set a time limit for usage ranging from 1 hour to 4 hours when creating the page.
When having a friend test it, you can also ask them to send you the chat log.

Privacy Considerations

Before sharing with friends, it's recommended to inform them as follows:
"This AI chat runs on my computer. I can see the conversations, please keep private information to a minimum."