代码库
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
Python
asraudio-generationcudadistributed-inferenceinferencemodel-servingmultimodalmusic-generationopenai-apipytorchsglangspeech-recognitionstreamingtext-to-speechtts
Materials for learning SGLang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
Python
SGLang is a high-performance serving framework for large language models and multimodal models.
Python
attentionblackwellcudadeepseekdiffusionglmgpt-ossinferencellamallmminimaxmoeqwenqwen-imagereinforcement-learningtransformervlmwan