rednote-machine-learning
Github

代码库

rednote-machine-learning/RedKnot
2.8k
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
Python