Github

代码库

Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
Python
agentic-aifastapiinference-engineopenvino-genaiopenvino-toolkitoptimum-inteltransformers