ai/granite-4.0-h-nano Docker 镜像 - 轩辕镜像

Granite 4.0 H Nano

!logo

Description

Granite-4.0-H-1B and granite-4.0-h-350M are lightweight instruct model finetuned from Granite-4.0-H-1B-Base and Granite-4.0-H-350M-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. This model is developed using a diverse set of techniques including supervised finetuning, reinforcement learning, and model merging.

Characteristics

Intended use

Intended use: Granite 4.0 Nano instruct models feature strong instruction following capabilities bringing advanced AI capabilities within reach for on-device deployments and research use cases. Additionally, their compact size makes them well-suited for fine-tuning on specialized domains without requiring massive compute resources.

Available model variants

¹: VRAM estimated based on model characteristics.

latest → 1B

Use this AI model with Docker Model Runner

bash
docker model run ai/granite-4.0-h-nano

***ations

• Optimized for instruction following, tool/function calling, and long-context (up to 128K tokens) scenarios.
• Strong generalist capabilities: summarization, classification, extraction, QA/RAG, coding, function-calling, and multilingual dialogue.
• Multilingual: best performance in English; a few-shot approach or light finetuning can help close gaps for other languages.
• Safety & reliability: despite alignment, the model can still produce inaccurate or biased outputs—apply domain-specific evaluation and guardrails.
• Infrastructure note: trained on NVIDIA GB200 NVL72 at CoreWeave; use acceleration libraries (e.g., accelerate, optimized attention/KV cache settings) for efficient inference.

Benchmark performance

Links

• [***]
• [***]
• [***]