jundot
Githubhttps://omlx.ai

代码库

jundot/omlx
20.2k
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Python
apple-siliconinference-serverllmmacosmlxopenai-api