syaffers/llama.cpp Docker 镜像 - 轩辕镜像 | Docker 镜像高效稳定拉取服务

llama.cpp local builds on Macbook M3 Pro

This Docker image was built via the Dockerfile in the official llama.cpp repo on GitHub.

Changes to original repo

The following change was made to .devops/cpu.Dockerfile:

git
diff --git a/.devops/cpu.Dockerfile b/.devops/cpu.Dockerfile
index 6e16ecda4..8d5e3bf01 ***
--- a/.devops/cpu.Dockerfile
+++ b/.devops/cpu.Dockerfile
@@ -12,7 +12,7 @@ WORKDIR /app
 COPY . .
 
 RUN if [ "$TARGETARCH" = "amd64" ] || [ "$TARGETARCH" = "arm64" ]; then \
-        cmake -S . -B build -DCMAKE_BUILD_TYPE=Release -DGGML_NATIVE=OFF -DLLAMA_BUILD_TESTS=OFF -DGGML_BACKEND_DL=ON -DGGML_CPU_ALL_VARIANTS=ON; \
+        cmake -S . -B build -DCMAKE_BUILD_TYPE=Release -DGGML_NATIVE=ON -DLLAMA_BUILD_TESTS=OFF; \
     else \
         echo "Unsupported architecture"; \
         exit 1; \

to allow the image to be built properly for the Mac M3.

Building

To build the image, clone the repo:

bash
git clone [***]

Check out to the desired tag:

bash
git checkout b7129

Apply the diff above and run the build:

bash
docker build --target server -t <repo name>:server-b7129-apple --build-arg TARGETARCH=arm64 -f .devops/cpu.Dockerfile .