Flide：通过精确状态分叉加速决策推理

Flide: Accelerating Decision Inference with Exact State Forking

要点速览

Flide 是一个开源推理引擎，通过精确状态分叉技术让多个问题共享计算，在 Decision Index 0.4.1 上支持 30+ 开源决策模型，推理速度比 vLLM 和 SGLang 快 9.5 倍。

正文

Hi everyone! I'm one of the authors of Flide.

We built Flide from scratch, an open-source inference engine for Jev-like decision models.

The key idea is exact state forking, which allows multiple questions to share computation while preserving exact decision semantics.

In our testing, Flide achieves up to 9.5× faster inference than vLLM and SGLang.
We support 30+ open-source decision models on Decision Index 0.4.1, with support for more models on the way.

Get started with one line:
pip install flide

Code: https://github.com/OmniJev/Flide
Docs: https://docs.flide.org/
Arxiv: https://arxiv.org/abs/2610.42148

We'd love to hear your feedback, questions, and ideas!