代码库
AgentENV (AENV) is a distributed platform for running agent environments at scale.
Rust
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Python
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
C++
disaggregationinferencekvcachellmrdmareinforcement-learningsglangtokenspeedtrt-llmvllm