inclusionAI/SingVL_S1_4B 发布：基于 Qwen3.5 的多模态决策模型

Sing VL S1

Sing VL S1 is a multimodal decision model built on Qwen3.5. It answers named questions over text or JSON and up to four images. Each question uses a single Transformers forward pass to score the supplied options.

• Choice selects an option and returns a probability for each candidate.
• Noul returns the probability that a yes/no proposition is true.
• Score rates the input against 2–10 levels ordered from low to high. It returns the probability of each level and the expected level, computed as the sum of each zero-based level index times its probability.

Public Decision Index 0.3

Per-dataset results

Show the Vision and Text breakdown

Public Vision (11 datasets)

Public Text (43 datasets)

† Decision Index reports these datasets separately and excludes them from the Text Index.

Usage

Use Python 3.12 and hardware-compatible PyTorch and torchvision builds. From the model repository root, enter inference/ before running the examples. If you have a standalone copy of the inference code, run the examples from that directory and replace .. with the checkpoint path.

cd inference
python -m pip install -r requirements.txt

Python

from PIL import Image

from model import SingVLS1

model = SingVLS1("..", device="cuda:0")

# Text
text, _ = model.predict(
    state="The color is red. ",
    questions={
        "color": {
            "type": "choice",
            "instructions": "Which color is named?",
            "criteria": {"red": "Red", "blue": "Blue"},
        },
        "yesno": {"type": "noul", "instructions": "Is the named color red?"},
        "redness": {
            "type": "score",
            "instructions": "How clearly does the text identify the color as red?",
            "criteria": ["Not red", "Possibly red", "Clearly red"],
        },
    },
)
print(text["answers"])

# Images in blue-then-red order. Both state values work.
questions = {
    "which": {
        "type": "choice",
        "instructions": "Which image is red?",
        "criteria": {"first": "The first image", "second": "The second image"},
    }
}
with Image.open("examples/blue.png") as blue, Image.open("examples/red.png") as red:
    for state in ({}, "<image>\n<image>\n"):
        vision, _ = model.predict(state=state, questions=questions, images=[blue, red])
        print(vision["answers"])

With no <image> markers, the model inserts them before the state text. With explicit markers, use one per image. The markers match the images in list order.

Use the same score question format with images. The answer includes probabilities and a legend, both keyed by the zero-based level number as a string. For example, probabilities of 0.1, 0.3, and 0.6 on three levels give 0 × 0.1 + 1 × 0.3 + 2 × 0.6 = 1.5.

HTTP API

Start the FastAPI server. Send requests to POST http://127.0.0.1:8173/v1/systemone from another terminal on the same machine. Interactive API docs are at http://127.0.0.1:8173/docs.

python serve.py --model .. --port 8173 --image-root ./examples

Send a text request with an inline JSON body.

curl -fsS http://127.0.0.1:8173/v1/systemone \
  -H 'Content-Type: application/json' -d '{
  "model": "sing-vl-s1",
  "state": "The color is red. ",
  "questions": {
    "color": {
      "type": "choice",
      "instructions": "Which color is named?",
      "criteria": {"red": "Red", "blue": "Blue"}
    },
    "yesno": {"type": "noul", "instructions": "Is the named color red?"},
    "redness": {
      "type": "score",
      "instructions": "How clearly does the text identify the color as red?",
      "criteria": ["Not red", "Possibly red", "Clearly red"]
    }
  }
}'

For a Vision request, add an ordered images array. Its entries can be Base64 data URLs (data_url), raw Base64 strings (base64), or server-side file paths (path). Paths are relative to --image-root or absolute paths inside that directory. With the server command above, send the example filenames directly.

curl -fsS http://127.0.0.1:8173/v1/systemone \
  -H 'Content-Type: application/json' -d '{
  "model": "sing-vl-s1",
  "state": {},
  "images": ["blue.png", "red.png"],
  "questions": {
    "which": {
      "type": "choice",
      "instructions": "Which image is red?",
      "criteria": {"first": "The first image", "second": "The second image"}
    }
  }
}'

For the same request with explicit image markers, use "state": "<image>\n<image>\n".

The response puts results under answers using the supplied question IDs. The text example selects red and returns answers.redness.score on a 0–2 scale. The Vision example selects second.

Decision Index compatibility and submission

Start the HTTP service above and prepare both Public 0.3 suites using the Decision Index kit and the Vision build instructions. Run the ni qcommands below from the evaluation workspace on the same machine. Text uses http, which calls /v1/systemone. Vision uses decide with the decisions payload and an explicit path to the same endpoint. The runner sends images as data URLs and resizes images above 1,638,400 pixels before sending them.

python -m decision_index pipeline --edition 0.3 --suite-dir suite-0.3 \
  --engine http --option base_url=http://127.0.0.1:8173 \
  --option model=sing-vl-s1 --out runs/sing-vl-s1-text

python -m decision_index vision pipeline --dir work/vision \
  --engine decide --workers 1 --option base_url=http://127.0.0.1:8173 \
  --option model=sing-vl-s1 --option protocol=decisions \
  --option path=/v1/systemone --option image_encoding=data_url \
  --option max_pixels=1638400 --out runs/sing-vl-s1-vision

1. Put the exact checkpoint revision, processor, and inference code in a Hugging Face model repository that the maintainers can access.
2. Upload the untouched run directories to a Hugging Face dataset. Include the per-request results.jsonl and run metadata. Check that Text scores.json and Vision vision-scores.json both report "complete": true. The Vision environment.json records the effective image budget.
3. Open a pull request to apolinario/decision-index and add the Text and Vision entries to submissions/README.md, marking the Vision entry vision. Include the model revision, results links, evaluation kit commit, hardware, engine options, and capacity limits. Sing VL S1 accepts up to four images per request, with a per-question input limit of 65,536 tokens for text or 10,000 with images.