OmniJev

Githubhttps://omnijev.github.io/OneJev/Followers 10

代码库

OmniJev/Flide

171

🔥🔥 The extremely fast inference engine for decision model

Python

ai-agentscudadecision-makingdeterministic-inferencegemmainference-enginejevkv-cachelarge-language-modelslinear-attentionllmllm-agentsllm-as-a-judgellm-inferencellm-servingmultimodalprefix-cachingpytorchqwentriton