SALMONN Framework: Expanding General Auditory Capabilities of Large Language Models


On Oct 9, Cloudflare released Clef-omni, an open-weight decision model. It adds audio and full-video support to text and images, handling multimodal content in one API call. Unlike Clef, it natively supports WAV/MP3 and reflects multimodal and architecture upgrades.....
WeChat AI open-sourced WeMM-Embedding, a multimodal embedding model in 2B, 4B, and 9B versions. It supports text, images, video, visual documents, and arbitrary mixed multimodal inputs. Its multimodal isomorphic core enables deep understanding of text and visual information, improving cross-modal retrieval.....
Google launched Gemini Omni1.1 Flash, an AI video model with up to 4K output, upgrading scene expansion, camera control, and efficiency for developers and creators. It supports direct scene extension, pushing multimodal video generation toward higher resolution and longer duration.....
Tencent Cloud supported live streaming of the US-Canada-Mexico World Cup across 17 countries, covering most authorized platforms in Asia-Pacific and China. AI was adopted at scale for the first time in live production, automating image enhancement, intelligent directing, auto-editing, and horizontal-to-vertical conversion, marking a milestone for AIGC mass application.....
After a six-month ban, ChatGPT returns to WhatsApp in the European Economic Area on July 13, 2026, following EU Commission intervention. Users can access multimodal conversations without registration by calling 1-800-CHATGPT.....