aitouch

A deeper dive to AI models in Open WebUI environment


von hannu

What is this article about?

This article will be about showing how you can customize your AI models in Open WebUI interface and exploring how different hardware impacts different models and how different models work in comparison to other models. The comparison will be about speed, quality and use cases of the models. We will also dive deeper into how different model parameter sizes compare to smaller ones. If you are interested in trying this out but you don’t have the Open WebUI environment installed yet, you can learn how to setup and install Open WebUI in our install guide.

[siteorigin_widget class=“SiteOrigin_Widget_Tabs_Widget”][/siteorigin_widget]

[siteorigin_widget class=“WP_Widget_Custom_HTML”][/siteorigin_widget]

[siteorigin_widget class=“SiteOrigin_Widget_Tabs_Widget”][/siteorigin_widget]

[siteorigin_widget class=“WP_Widget_Custom_HTML”][/siteorigin_widget]

What you’ll learn

  • How to operate the Open WebUI web interface
  • How to customize AI models in Open WebUI web interface
  • Differences between different AI models
  • What is required from your system to run different models

Tools that we’re using

  • Ollama: Is used to download and run your AI models in different environments.
  • Open WebUI: Is for using the AI models in a web interface like a browser. There you can chat with the AI models directly and use multiple models at the same time.
  • Computer: Processor is intel i7-6700, graphics card is NVIDIA gtx 1080 8GB and the system has 64GB of RAM.

Why should you try this?

  • Models: Different models give you different results. Some are better for certain tasks like calculation or reasoning.
  • Customization: You get to try different AI models for different tasks and you can compare them side by side.
  • Future of AI: AI will be a part of our future without a doubt. So having information about how different models work might be useful.

Notes before you start

  • Operating platform: You’ll need an updated Open WebUI web interface environment with at least 2 AI models downloaded.
  • Results: Performance may be different from my tests based on your hardware.
  • Graphics card: Not mandatory, but recommended for faster processing speed.
  • Updates: AI models and platforms update at a rapid pace so this guide might not be 100% up to date.

[siteorigin_widget class=“FT_Tabs”][/siteorigin_widget]

[siteorigin_widget class=“WP_Widget_Custom_HTML”][/siteorigin_widget]

Summary about what you’ve done

You have learned how to use and compare different AI models. You know a little bit about the system requirements of different models. You also learned a little bit on how to customize the models for different situations. Now you can use what you’ve learned to utilize different AI models for various situations.