renehonig/vllm-openai Docker 镜像 - 轩辕镜像 | Docker 镜像高效稳定拉取服务

Custom vllm images based on CUDA 13.0, e.g.:

builds script from [***] v0.13.0 branch:

DOCKER_BUILDKIT=1 \
    docker buildx build . \
        --target vllm-openai \
        --tag vllm/vllm-openai:custom-vllm-0.13.0-cuda-13.0-py-3.12 \
        --file docker/Dockerfile \
        --platform linux/amd64 \
        --build-arg max_jobs=112 \
        --build-arg nvcc_threads=56 \
        --build-arg CUDA_VERSION=13.0.0 \
        --build-arg PYTHON_VERSION=3.12 \
        --build-arg VLLM_USE_PRECOMPILED=false \
        --build-arg VLLM_MAIN_CUDA_VERSION=13 \
        --build-arg BUILD_BASE_IMAGE=nvidia/cuda:13.0.0-devel-ubuntu22.04 \
        --build-arg RUN_WHEEL_CHECK=false \
;