代码库
Official repository for MOSS-Image, a 5B-parameter base DiT model with high-quality text rendering, layout generation, and efficient fine-tuning.
Python
controllable-generationfoundation-modelsimage-generationtext-renderingtext-to-image
An open-source model for music captioning, lyrics transcription, structural analysis, and musical question answering
Python
audio-question-answeringlyrics-transcriptionmultimodalmusic-captioningmusic-understanding
A unified framework for training, fine-tuning, and evaluating World Action Models
Python
benchmarkcodebaseembodied-aifoundation-modelsloraroboticsvision-language-actionworld-action-modelworld-models
An open-weight 11B model series for long-form and real-time video understanding
Python
llmslong-video-understandingmultimodalmultimodal-aireal-time-aistreaming-videovideo-question-answeringvideo-understandingvideo-understanding-vlmvisionvision-languagevision-language-modelvision-language-modelsvision-llmvlm
An 11B model for real-time video understanding with gated cross-attention and streaming inference
Python
multimodalstreaming-videovideo-understandingvision-language-model
A curated collection of papers, explainers, and resources on World Action Models for embodied AI
HTML
awesome-listembodied-aipaper-listroboticssurveyvision-language-actionworld-action-modelworld-models
An open-source model for understanding speech, environmental sounds, and music through captioning, question answering, and reasoning
Python
audio-captioningaudio-question-answeringaudio-understandingmultimodalmusicspeech
A 100M-parameter multilingual TTS model for real-time CPU inference, voice cloning, and 48 kHz stereo generation
Python
audio-tokenizerchinesecpu-inferenceenglishmulti-modalitymultilingualonnxrealtimespeech-synthesisstreaming-audiotext-to-speechttsvoice-clonevoice-cloning
A foundation model that generates synchronized video and audio in a single model
Python
audio-generationdiffusion-modelsloramultimodalsglangtext-to-videovideo-audio-generationvideo-generation
An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
Python
audioaudio-tokenizerllmmultilingualmultimodalspeech-synthesisstreamingtext-to-audiotext-to-speechttsvoice-cloning