Zhejiang University Alumni Collaborate with Microsoft to Launch Multimodal Model LLaVA, Challenging GPT-4V


On September 22, the Yunchi Conference in Hangzhou opened, and Alibaba announced the progress of large models: Qwen4 has entered training, and the subsequent parameter scale is planned to expand to 5 trillion to 10 trillion; recursive self-improvement enters training, reasoning, and chip coordination; multimodal matrix upgrade, a new video generation model will be released in November. Liu Dayi Heng said that scaling is an important path toward ASI.
The Alibaba Qwen team has launched the native multimodal model Qwen3.8-Omni-Flash, which supports four types of input: text, image, audio, and video, with a context window of up to 1 million Tokens. It achieves an average improvement of over 25% across 29 benchmarks compared to its predecessor. The most significant change lies in its processing approach: instead of simply concatenating speech and image recognition, it natively integrates multimodal understanding and AI agent capabilities at the model level.
DeepSeek open-sourced V4-Flash-Vision-Exp, the first experimental multimodal model in the V4 series. Based on the V4-Flash architecture with a vision module, it adds deep image understanding and analysis, with 305B parameters, enabling precise image interpretation and multimodal fusion.....
SenseNova U1.5-Lite-Preview, an open-source lightweight multimodal model with 8B MoT parameters and NEO-unify architecture, supports native 4K image generation, fine textures, accurate Chinese/English text rendering, and stable image editing. It enhances long-form natural language and structured visual instruction understanding for precise multimodal generation under complex demands.....
Google releases a new multimodal model Gemma 4 12B, revolutionizing the traditional architecture by eliminating the separate encoder component, achieving efficient local deployment and inference on consumer-level hardware. This breakthrough significantly reduces the computational complexity of multimodal models, improves processing speed, and marks a new stage in the open source large model ecosystem.