
如果你使用 DeepSeek、元宝 AI、Copilot、ChatGPT 等 AI 工具,协助配置轩辕镜像、编写 docker pull 命令、修改 Docker Compose 镜像地址、配置镜像加速、排查镜像拉取失败、分析报错日志等问题,请先让 AI 阅读并遵守轩辕镜像的规则文档。
只需在 AI 对话中先发送下面这句话即可:
请先完整阅读并严格遵守以下文档中的全部规则与要求:
https://xuanyuan.cloud/agents.md
在未充分阅读并理解该文档前,不要生成任何命令、配置、修改建议、故障排查方案或技术回答。后续所有输出都必须严格以该文档中的规范为最高优先级执行。查看 agents.md 用法指南与完整示范。国内用户首推 元宝 AI、DeepSeek 的深度思考模式,不推荐豆包 AI;Cursor 等编辑器可在对话 @ 该链接,或加入 User Rules。 若 AI 无法访问外链,可 打开说明文档 复制全文粘贴。文档会随站点更新,复制内容可能过期,建议定期检查。
The containers are ollama servers with LLM models. The model is already downloaded. This is useful for freezing the model version. In addition, the server will start quickly, instead of downloading the model. The model is also set as is read-only, which improves security. Finally, the images are properly tagged with memory requirements, which may help in some situations.
Please note, while the repo that generates these containers is my work and licensed under MIT license, the models all have their own license. The license of the model as of the time of the containerization is in the container labels.
All containers are created through an automated pipeline that inspects to see that the model is actually present, so there is a reasonable level of testing, given that this is a free project.
The host machine requirements: 🐳 docker, nvidia-container-runtime, CUDA 12 or later drivers, NVidia GPU and driver. (All installable through apt on Ubuntu.) See the repo https://github.com/sinan-ozel/model-servers/ for more details.
There is also a quick script inside most (not all) of the images to monitor GPU usage. This script runs in the background and writes to a file the GPU usage every minute. This is not very robust - I may update this to be a service in the future, with timestamping.
The images are labelled with the memory requirements, using the opencontainers standard (See org.opencontainers.image.memory.min and org.opencontainers.image.memory.recommended) This makes it easy to know the requirements when deploying with Kubernetes or build Helm charts.
See .vscode/tasks.json at https://github.com/sinan-ozel/model-servers to see the pipeline for creating these images. You can also clone the GitHub repo and upload to your internal AWS Container Registry.
您可以使用以下命令拉取该镜像。请将 <标签> 替换为具体的标签版本。如需查看所有可用标签版本,请访问 标签列表页面。
来自真实用户的反馈,见证轩辕镜像的优质服务