代码库
High Performance Serving Runtime For Interactive Super Intelligence System
Python
asraudio-generationcudadistributed-inferenceinferenceinteractivemodel-servingmultimodalmusic-generationopenai-apipytorchsglangspeech-recognitionstreamingtext-to-speechtts
Materials for learning SGLang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Python
attentionblackwellcudadeepseekdiffusionglmgpt-ossinferencellamallmminimaxmoeqwenqwen-imagereinforcement-learningtransformervlmwan