flashinfer-ai

Githubhttps://flashinfer.ai/Followers 284

代码库

flashinfer-ai/flashinfer

6.9k

FlashInfer: Kernel Library for LLM Serving

Cuda

attentioncudadistributed-inferencegpujitlarge-large-modelsllm-inferencemoenvidiapytorch