inclusionAI/ZoomGain-4B-GGUF 发布：支持图像输入的多模态模型

inclusionAI/ZoomGain-4B-GGUF

要点速览

inclusionAI/ZoomGain-4B-GGUF 是一个 175B 参数的多模态模型，支持图像输入，使用 FP16、Q8_0 和 Q4_K_M 精度量化。模型包含语言模型和 mmproj 视觉编码器/投影器，通过 llama.cpp 转换为 GGUF 格式。提供 llama-mtmd-cli 命令行推理和 llama-server 网络聊天功能。

正文

GGUF-format weights for ZoomGain-4B, converted with llama.cpp.

Language model: FP16, Q8_0, Q4_K_M.
Vision encoder and projector (mmproj): FP16, Q8_0, Q4_K_M.

For image input, provide both the language model and the corresponding mmproj file.

CLI Inference (`llama-mtmd-cli`)

llama-mtmd-cli \
  -m ZoomGain-4B-Q8_0.gguf \
  --mmproj mmproj-ZoomGain-4B-Q8_0.gguf \
  --image /path/to/image.jpg \
  -p "Describe this image." \
  --temp 0 -n 2048

Web Chat (`llama-server`)

llama-server \
  -m ZoomGain-4B-Q8_0.gguf \
  --mmproj mmproj-ZoomGain-4B-Q8_0.gguf \
  --host 127.0.0.1 --port 8080

Replace Q8_0 with F16 or Q4_K_M to use another precision. Use a llama.cpp build with Qwen3.5 multimodal support. Quantization can affect accuracy.

inclusionAI/ZoomGain-4B-GGUF 发布：支持图像输入的多模态模型

CLI Inference (llama-mtmd-cli)

Web Chat (llama-server)

CLI Inference (`llama-mtmd-cli`)

Web Chat (`llama-server`)