RWKV: Small Team Aims to Be Android of AI Era with Big Model

Source:

Source:
The robotics research team at Google DeepMind recently released a robotics project called RT-2. This project took 7 months to develop and uses a large model for training. RT-2 has capabilities such as symbol understanding, reasoning, and human recognition, and can think and complete tasks based on human instructions. By combining the large model with the robot's operational capabilities, RT-2 can accomplish tasks that involve logical leaps, such as from 'extinct animals' to 'plastic dinosaurs'. The results of this project performed well in various sub - category tests, with performance up to three times that of the previous generation of robot models. This research result demonstrates the potential of large models in robotics research and is expected to drive the development of robots in the future.
Meta has recently announced that it will hold the first LlamaCon developer conference on April 29, focusing on the latest advancements in its Llama series of generative AI models. The event aims to provide developers with a platform to share the latest achievements in open-source AI, helping them to better build applications and products. As generative AI technology rapidly evolves, Meta hopes to further promote the development of its ecosystem through this conference. At the upcoming event, Meta plans to showcase several.
The autopsy report of OpenAI whistleblower Suchir Balaji has recently been handed over to his family. However, Balaji's relatives express skepticism regarding the conclusion of suicide and have stated that they submitted a strange hair sample found in his apartment to the laboratory for testing. Note: The image is generated by AI, and the image is licensed by Midjourney. According to the reports released jointly by the city coroner and police, investigators found no evidence or information at the scene that could definitively determine the cause and manner of Balaji's death.
Recently, Baidu founder Li Yanhong elaborated on the reasons behind the company's decision to open source the Wenxin large model 4.5 series during Baidu's Q4 2024 and full-year earnings call. Li emphasized that Baidu gained valuable insights from the DeepSeek project, namely that open sourcing the best models can significantly promote user adoption and recognition. He explained that when a model is open sourced, people's curiosity drives them to experiment, and this natural exploratory behavior helps the model be more widely applied in real-world scenarios.
In the field of artificial intelligence, the DeepSeek team recently released their latest research成果, introducing an innovative sparse attention mechanism named NSA (Native Sparse Attention). The core objective of this technology is to enhance the speed of long context training and inference, particularly optimized for modern hardware, significantly improving the efficiency of training and inference. The launch of NSA technology brings significant changes to the training of artificial intelligence models. Firstly, it utilizes a series of advancements tailored for modern computational hardware.