跳到正文
实时
蚂蚁 inclusionAI · Hugging Face 新模型·· 2 天前

inclusionAI/Duo-1.0-causal-base 发布:一个用于全双工交互的多模态世界模型

inclusionAI/Duo-1.0-causal-base

要点速览

inclusionAI 发布 Duo 1.0 causal-base 模型,这是一个用于实时音视频交互的全双工多模态世界模型,包含实现权重和主干、意图模型和适配器、音视频编解码器、语音识别器和强制对齐器。该模型权重基于 MiniMax H3 初始化,并已开源。

正文

Duo

Duo-1.0-causal-base

A Reciprocal World Model for Full-Duplex Interaction

arXiv Homepage Models Code

Model Overview

Duo is a full-duplex multimodal world model for real-time audio-visual interaction. This repository contains the Duo 1.0 causal-base model weights.

Field Value
Version Duo 1.0
Variant Causal base
Package Complete model bundle
Realization format PyTorch Distributed Checkpoint (DCP)
Default sampler Euler, 50 steps, flow shift 1.0

Package Contents

The bundle contains the Realization weights and backbone, Intent model and adapter, video and audio codecs, speech recognizer, and forced aligner. Runtime integrations can use realization/complete.json to identify the packaged model family and weight format.

Download

hf download inclusionAI/Duo-1.0-causal-base --local-dir weights

For code, configuration, and runtime-specific integration instructions, see inclusionAI/Duo.

License

These weights were initialized from MiniMax H3 and subsequently trained by the Duo team. See LICENSE and NOTICE for the applicable terms.

来源: 蚂蚁 inclusionAI · Hugging Face 新模型 · huggingface.co