Downloading Docker (Do this after installing Ollama)

If you have not downloaded Ollama, do it first.

What you see below is the OpenWEB UI (user interface) that we will use to interface with the LLMs that we will pull from Ollama (which you have just downloaded).

But to use OpenWEB UI, we will first download and install Docker container. Then second, using a line of code in your terminal, we will be able to install OpenWEB UI and integrate it Ollama.

Why do I need Docker ! ?

What is Ollama? To use Ollama in OpenWEB UI (a user interface), it needs to be set up properly on your computer or server.

Why is setup a challenge?

  • Compatibility Issues: Different computers run different operating systems (Windows, macOS, Linux), and software like Ollama may need specific settings or dependencies (other software pieces) to work properly.

  • Consistency: If everyone sets up Ollama manually, they might encounter different problems based on their system.

What is Docker? Docker is like a portable, standardized box (a container). Imagine you want to run a recipe. Instead of worrying about whether you have the right tools, ingredients, or stove, Docker gives you everything pre-packaged in a ready-to-use kit. Inside this box:

  • It has all the extra software Ollama needs.
  • It’s pre-configured to work the same way on any computer.

Why use Docker for Ollama in Openweb UI?

  • Simplifies Setup: Docker ensures you don’t have to install or configure Ollama and its dependencies manually. You just “open the box,” and it works.
  • Avoids Conflicts: If you already have other software on your computer, Docker keeps Ollama separate so there are no clashes.

Steps to set up OpenWEB UI

You can follow my steps next or you can also watch this Youtube video at Video 1

Step 1 Download & Install Docker

Docker is free and easy to download. The steps below will show you how to download Docker Still have problems? I am only an email away.

Step 1a. Download Docker Desktop here

For Windows, is it AMD or ARM?

Type echo %PROCESSOR_ARCHITECTURE% in your Terminal app (Search for Terminal app and open it) The output will tell you if it is AMD or ARM

For Windows, how to check if AMD or ARM?

For MAC, is it silicon or Intel chip?

Check here

Step 1b.Installing Docket Desktop

Installation screenshots below are for Windows but probably similar to Mac





Once installed, you can see it in your taskbar.

By default, Docker (also Ollama) should only run when you fire up the app. But do check that the app does not auto-launch when you start up your laptop so that it does not take up your device memory if you are not using the app.

That’s all the steps for downloading Docker You should now set-up Docker to integrate OpenWEB ui and Ollama.

Step 1c. Setting up in Terminal

Open up Terminal
  • Search Terminal app in your computer. Open it up. Basically a black screen thingy.
Get line of code to input into Terminal
  • Then, go to this link and copy the line of code from section “If Ollama is on your computer, use this command” and press “Enter”.




Let the code run for a while

It will take a while to download OpenWEB UI and set things up. This below is what it could be saying in yours.

Processing

Completed
Open up Docker
  • If your Docker was already open, restart it
  • Open up ollama
  • Check it is square symbol and you can click on the numbers to open up OpenWEB UI in a local host 3000

You should see one of two screenshots below
  • If you see an error screen. Restart the laptop.

Intro screen

The first person who registers will be the Admin. So make sure YOU are the admin person i.e. this is your laptop.

If you want to start playing with an LLM using this set-up, go here next: Start Playing

Video 1