Star 历史趋势
数据来源: GitHub API · 生成自 Stargazers.cn
README.md

MiniCPM-V 4.7 — A new chapter in on-device multimodal AI. 35B-A3B and 1B models for images, video and documents.

MiniCPM-V & MiniCPM-o · See, hear, and interact on your local devices.

MiniCPM-V 4.7 🤗 35B-A3B 🤗 1B 🤖   MiniCPM-o 4.5 🤗 🤖

Overview  ·  Get started  ·  Resources  |  中文 · English

News

  • [2026.10.28] 🔥🔥🔥 We open-source the MiniCPM-OCR suite, pairing two models for fast, accurate parsing and result verification: MiniCPM-OCR 1.0 (based on MiniCPM-V 4.6, SOTA on Real5-OmniDocBench and OCRBench v2) and MiniCPM-OCR Jev for result correctness checks.
  • 2026-10-15 · We release DSpark speculative decoding heads in BF16 and GGUF for both MiniCPM-V 4.7 variants: 1B (DSpark-BF16, DSpark-GGUF) and 35B-A3B (DSpark-BF16, DSpark-GGUF).
  • 2026-10-12 · MiniCPM-V 4.7 released — the first open-source MoE model to run smoothly on-device without compromising performance, setting a new multimodal performance–efficiency Pareto frontier. See what's new.

MiniCPM-V 4.7

MiniCPM-V 4.7 is the latest model in the MiniCPM-V series, available in 35B-A3B and 1B variants. The 35B-A3B variant is the series' first MoE model. Its main features include:

  • 🚀 A new performance–efficiency Pareto frontier. The 35B-A3B and 1B variants each advance the performance–efficiency Pareto frontier for multimodal large language models. In Instruct mode, 35B-A3B achieves a higher overall score in less inference time than Qwen3.6 35B-A3B; the 1B variant further improves on MiniCPM-V 4.6's core capabilities and substantially outperforms Qwen3.5 0.8B in both overall score and inference efficiency.
  • 📱 The first open-source MoE to run smoothly on-device without compromising performance. Powered by the latest Lookahead Expert Scheduling (LES) inference acceleration technique, MiniCPM-V 4.7 35B-A3B becomes the first open-source MoE model to run smoothly on-device without compromising performance, achieving a decoding speed of 13+ tokens/s with just 3 GB of memory on iPhone 17 Pro Max. We also support DSpark speculative decoding, with dedicated heads available for 1B (DSpark-BF16, DSpark-GGUF) and 35B-A3B (DSpark-BF16, DSpark-GGUF).
  • 🛠️ Broad platform support and easy customization. MiniCPM-V 4.7 supports iOS, Android, and HarmonyOS, and supports chip platforms from Intel, AMD, Arm, Rockchip, and Houmo, covering a diverse range of mobile devices and local computing scenarios. We also open-source Self-Replay Fine-Tuning (SRFT), helping developers extend model capabilities at low cost while reducing forgetting of existing capabilities.

Significantly Advancing the Performance–Efficiency Pareto Frontier

MiniCPM-V 4.7 35B-A3B and 1B: average evaluation score versus inference time. Stars and circles denote non-reasoning mode; diamonds denote reasoning mode.

Overall Performance (35B-A3B, Instruct)

Vision-Language

Vision-Language performance comparison for MiniCPM-V 4.7 35B-A3B in Instruct mode

Language

Language performance comparison for MiniCPM-V 4.7 35B-A3B in Instruct mode

Overall Performance (1B, Instruct)

Full performance comparison for MiniCPM-V 4.7 1B in Instruct mode

Smooth On-Device MoE Inference without Compromising Performance

Running an MoE model on a device is only the starting point. The real challenge is to preserve model capability while delivering smooth generation. Storing expert weights on SSD can overcome memory capacity limits, but frequent loading stalls slow generation unless loading and computation overlap effectively. Restricting the number of experts or fixing an expert subset can speed up inference at the cost of model capability.

To address this trade-off, MiniCPM-V 4.7 introduces Lookahead Expert Scheduling, delivering a 5× speedup on real devices without sacrificing model capability. Cross-layer routing prediction preloads experts likely to be needed by the next layer and prioritizes computation for experts selected by the actual router that are already loaded, substantially reducing loading stalls. Weight quantization and an optimized storage layout also reduce the storage footprint and make scattered reads more efficient, further accelerating loading. The recording below compares generation speed before and after inference optimization:

MiniCPM-V 4.7 35B-A3B on-device inference efficiency: after optimization on the left, before optimization on the right.

Model Weights

MiniCPM-V 4.7 is available in 35B-A3B and 1B variants. Each row lists the model weights alongside its corresponding DSpark speculative decoding heads, available in BF16 and GGUF.

ModelDescriptionModel weightsDSpark heads
MiniCPM‑V 4.7
35B-A3B
The first open-source MoE model to run smoothly on-device without compromising performance, raising the bar for on-device performance.🤗   BF16
🤗   FP8
🤗   int4
🤗   AWQ
🤗   GPTQ
🤗   GGUF
🤗   BF16
🤗   GGUF
MiniCPM‑V 4.7
1B
Combines stronger capabilities with extremely high efficiency, advancing the performance–efficiency Pareto frontier for multimodal large language models.🤗   BF16
🤗   int4
🤗   AWQ
🤗   GPTQ
🤗   GGUF
🤗   BF16
🤗   GGUF

The 1B int4 variant uses bitsandbytes; AWQ and GPTQ use W4A16 quantization. Quantized variants reduce memory usage; GGUF weights support CPU inference.

Also available on Ollama.

MiniCPM-o 4.5

MiniCPM-o 4.5 is the latest model in the MiniCPM-o series, a 9B end-to-end omnimodal model. It can continuously receive video and audio while generating speech and text, enabling real-time interactions that see, hear, and speak simultaneously.

Model highlights:

  • 🔥 Vision capability approaching Gemini 2.5 Flash. It scores 77.6 on average across 8 popular OpenCompass benchmarks. With only 9B parameters, its visual understanding surpasses GPT-4o and Gemini 2.0 Pro, and a single model supports both instruct and thinking modes.
  • 🎙 Strong speech capability. It supports bilingual real-time speech conversation with configurable voices in English and Chinese, making conversations more natural, expressive, and stable. A simple reference audio clip is enough for voice cloning and role play, and its voice cloning performance surpasses strong TTS tools such as CosyVoice2.
  • 🎬 Full-duplex, proactive live interaction. It process real-time, continuous video and audio input streams simultaneously while generating concurrent text and speech output streams in an end-to-end fashion, without mutual blocking. This allows MiniCPM-o 4.5 to see, hear, and speak simultaneously, enabling smooth, real-time omnimodal conversations. Beyond responding to requests, the model can also interact proactively, for example by initiating reminders or comments based on its continuous understanding of the scene.

News

  • 2026-05-17 · Released API access for MiniCPM-o 4.5.

Watch the MiniCPM-o 4.5 full-duplex multimodal interaction demo on YouTube.

Model overview

MiniCPM-V 4.7MiniCPM-o 4.5
Models35B-A3B MoE · 1B9B end-to-end omnimodal model
Core capabilitiesImage, multi-image, document and video understandingVisual understanding, speech understanding and generation
Technical featuresMixed 4×/16× visual token compression; smooth on-device inference without compromising performanceFull-duplex multimodal live streaming, receiving audio and video while generating speech and text
Model guidesMiniCPM-V 4.7 model guideMiniCPM-o 4.5 model guide
ExamplesExamplesExamples
EvaluationEvaluationEvaluation

Get started

MiniCPM-V 4.7MiniCPM-o 4.5
Model weightsModel weights
HF · vLLM · SGLang · Ollama · llama.cppHF · vLLM · SGLang · Ollama · llama.cpp
Fine-tuningFine-tuning
Live demoLive demo
Local deploymentLocal deployment
API
Cookbook

Earlier updates

Community milestones

  • 2025-01-19 · MiniCPM-o reached No. 1 on GitHub Trending and No. 2 on Hugging Face Trending.
  • 2024-05-23 · MiniCPM-V reached No. 1 on both GitHub Trending and Hugging Face Trending.

Built with MiniCPM

ProjectWhat you can explore
OpenAvatarChatInteractive digital-human conversations on a single PC
Ollama-OCRExtract text from images and PDFs with local vision-language models
comfyui_LLM_partyConnect language and vision models to ComfyUI workflows

Community projects may support different model generations. Check each project's model list. More community projects

Project resources

CategoryLinks
Model documentationMiniCPM-V 4.7 · MiniCPM-o 4.5
Deployment & developmentDeployment & training · Cookbook · Documentation site
PapersTechnical reports & related papers
Versions & updatesEarlier models · Full release history
CommunityDiscord · WeChat · Feishu / Lark · MiniCPM Wiki
License & usageApache-2.0 · Model license · Usage statement

Developed by THUNLP and ModelBest. Code and model weights are released under Apache-2.0.

Citation

If you find our model/code/paper helpful, please consider citing our papers 📝 and staring us ⭐️!

@misc{cui2026minicpmo45realtimefullduplex,
      title={MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction},
      author={Junbo Cui and Bokai Xu and Chongyi Wang and Tianyu Yu and Weiyue Sun and Yingjing Xu and Tianran Wang and Zhihui He and Wenshuo Ma and Tianchi Cai and others},
      year={2026},
      url={https://arxiv.org/abs/2604.27393},
}

@proceedings{yu2025minicpmv45cookingefficient,
      title={MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe},
      author={Tianyu Yu and Zefan Wang and Chongyi Wang and Fuwei Huang and Wenshuo Ma and Zhihui He and Tianchi Cai and Weize Chen and Yuxiang Huang and Yuanqian Zhao and others},
      year={2025},
      url={https://arxiv.org/abs/2509.18154},
}

@article{yao2024minicpm,
  title={MiniCPM-V: A GPT-4V Level MLLM on Your Phone},
  author={Yao, Yuan and Yu, Tianyu and Zhang, Ao and Wang, Chongyi and Cui, Junbo and Zhu, Hongji and Cai, Tianchi and Li, Haoyu and Zhao, Weilin and He, Zhihui and others},
  journal={arXiv preprint arXiv:2408.01800},
  year={2024}
}

关于 About

See, hear, and interact on your local devices.
minicpmminicpm-ominicpm-vmulti-modal

语言 Languages

Python83.3%
Vue14.1%
JavaScript1.7%
Shell0.5%
Less0.3%
CSS0.1%
Dockerfile0.1%
HTML0.0%

提交活跃度 Commit Activity

代码提交热力图
过去 52 周的开发活跃度
138
Total Commits
峰值: 33次/周
Less
More

核心贡献者 Contributors