Show HN: Flide: Make Jev-like decision models up to 9.5x faster

  • Posted 11 hours ago by unikcc
  • 86 points
https://github.com/OmniJev/Flide
Decision models need their own inference engine.

So we developed Flide, a high-performance and exact inference engine for Jev-like decision models.

Flide achieves up to a 9.5x speedup over vLLM and SGLang.

It now supports 30+ popular local Jev-like decision models.

Start to make your decision immediately:

pip install flide

8 comments

    Loading..
    Loading..
    Loading..
    Loading..
    Loading..
    Loading..
    Loading..
    Loading..