Flide: Accelerating Decision Inference with Exact State Forking

Brief overview

Flide is an open-source reasoning engine that enables multiple problems to share computation through precise state branching technology, supporting over 30 open-source decision models on Decision Index 0.4.1, with inference speed 9.5 times faster than vLLM and SGLang.

Article

Hi everyone! I'm one of the authors of Flide.

We built Flide from scratch, an open-source inference engine for Jev-like decision models.

The key idea is exact state forking, which allows multiple questions to share computation while preserving exact decision semantics.

In our testing, Flide achieves up to 9.5× faster inference than vLLM and SGLang.
We support 30+ open-source decision models on Decision Index 0.4.1, with support for more models on the way.

Get started with one line:
pip install flide

Code: https://github.com/OmniJev/Flide
Docs: https://docs.flide.org/
Arxiv: https://arxiv.org/abs/2610.42148

We'd love to hear your feedback, questions, and ideas!