alpine/ollama Docker Image
Minimal CPU-only Ollama Docker Image
Minimal CPU-only Ollama Docker Image
This repository provides a minimal CPU-only Ollama Docker image, specifically designed to run on systems without GPU support. At just 70MB, this image is significantly smaller than the official Ollama image, which is around 4GB.
ollama latest b99944c07117 3 hours ago 69.3MB
Notes
- This image is not based on alpine, but wolfi.dev, I will work it out with alpine later
- Got big help from @kth8 ( https://github.com/ollama/ollama/issues/7184#issuecomment-2414823298 )
Multi-Arch support
- linux/amd64
- linux/arm64
Repo:
https://github.com/alpine-docker/ollama
Automation build logs:
https://github.com/alpine-docker/ollama/actions
Docker iamge tags:
https://hub.docker.com/r/alpine/ollama/tags/
Why Use This Image?
-
Lightweight: The official Ollama image is over 4GB in size, which can be overkill for systems that only need CPU-based processing. This image is only 70MB, making it much faster to download and deploy.
-
CPU-only Support: This image is tailored for systems without GPUs. It ensures you can run Ollama efficiently, even on basic or resource-constrained environments, without needing specialized hardware.
-
Run Anywhere: Whether you're working on local servers, edge devices, or cloud environments that don’t offer GPU resources, this image allows you to run Ollama anywhere, focusing purely on CPU-based operations.
How to Use
- Pull the image
bashdocker pull alpine/ollama
- Run the service with API supported
docker rm -f ollama docker run -d -p 11434:11434 -v ~/.ollama/root/.ollama --name ollama alpine/ollama
- Download the models, for example,
llama3.2, only run once. It will save the model locally, you can re-use it later.
docker exec -ti ollama ollama pull llama3.2
If you don't want to download, you can choice to use alpine/llama3.2 image directly. I create this with model "llama3.2" integrated already
docker run -d -p 11434:11434 --name llama3.2 alpine/llama3.2
- Test its API service with curl
$ curl http://localhost:11434/api/generate -d '{ "model": "llama3.2", "prompt":"Why is the sky blue?" }' {"model":"llama3.2","created_at":"2024-10-16T00:25:58.59931201Z","response":"The","done":false} {"model":"llama3.2","created_at":"2024-10-16T00:25:58.695826838Z","response":" sky","done":false} {"model":"llama3.2","created_at":"2024-10-16T00:25:58.780917761Z","response":" appears","done":false} {"model":"llama3.2","created_at":"2024-10-16T00:25:58.992556209Z","response":" blue","done":false} {"model":"llama3.2","created_at":"2024-10-16T00:25:59.085970606Z","response":" because","done":false} {"model":"llama3.2","created_at":"2024-10-16T00:25:59.30869749Z","response":" of","done":false} ...
If you monitor the CPU usage, for example, with htop, you would see the high CPU usage
You can deploy the Ollama web UI to chat with it directly. There are many tools available, but I won't recommend any specific one.
Use case
this image could be deployed to any enviornment, for example, in kubernetes cluster, you can use it to analyze logs, streamlining logs with local LLMs, etc.
Quick start
Announce — Minimal CPU-only Ollama Docker Image - [***]
更多相关 Docker 镜像与资源
以下是 alpine/ollama 相关的常用 Docker 镜像,适用于 不同场景 等不同场景:
镜像拉取方式
您可以使用以下命令拉取该镜像。请将 <标签> 替换为具体的标签版本。如需查看所有可用标签版本,请访问 标签列表页面。
DockerHub 原生拉取命令
用户好评
来自真实用户的反馈,见证轩辕镜像的优质服务