代码库
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
C++
aiandroidarmedgeedge-aiframeworkiosllamacppllmllm-inferencellmsmobilemobile-inferenceon-device-aiquantizragsmartphonespeechtransformerwhisper
14MB foundation model for tiny devices; phones, wearables, smart home, and robots.
Python
cactusgeminigemmallmon-device-ai