AI2 Releases Open Source Dataset for Large Language Model Dolma Containing 3 Trillion Tokens

The Allen Institute for Artificial Intelligence in the United States recently released an open-source dataset called Dolma, which contains 3 trillion tokens. This dataset will serve as the foundation for the Open Language Model (OLMo) being developed by AI2, with a planned release in early 2024. The data in Dolma is sourced from a wide range of materials, including web content, academic publications, code, and books. This dataset is currently the largest of its kind available publicly.

Carnegie Mellon University Develops New AI System: Real-Time Repair of 3D Printing Defects Like a Conductor

A team from Carnegie Mellon University has developed a real-time error correction system for 3D printing based on a large language model. The system mimics an orchestra, with an 'conductor' agent coordinating four specialized agents to automatically detect and correct errors caused by small parameter fluctuations during the printing process, solving the problem of traditional open-loop systems that are prone to failure.

Neusoft Group Collaborates with Cerence AI to Create a New Experience for the Future Intelligent Cockpit

Neusoft Group has reached a strategic cooperation with Cerence AI to jointly develop a new generation of intelligent cockpit platform, focusing on intelligent voice and large language model technologies, providing efficient and pre-integrated intelligent interaction solutions for automotive manufacturers around the world. Neusoft will leverage its NAGIC intelligent cockpit platform, combined with Cerence AI's cutting-edge technology, to meet the growing demand for intelligent cockpits in the market.

Japanese Scientists Launch Sui Programming Language, Claiming It Can Write Code with 100% Accuracy Using LLM

Japanese data scientist Takahito Honda launched the open-source programming language Sui, aimed at solving the accuracy issues of code generated by large language models, claiming it can achieve 100% accuracy. Its design concept is inspired by Japanese aesthetics "Wabi-Sabi", emphasizing refinement and elimination of redundancy, with core principles including ensuring zero syntax error rate and using numbers as variables.

Ant Group Open Sources LLaDA2.0, the Industry's First 100B-Parameter Diffusion Language Model

Ant Technology Research Institute launched the LLaDA2.0 series, including 16B and 100B versions, among which the 100B version is the industry's first billion-parameter discrete diffusion large language model. The model breaks through the scalability bottleneck of diffusion models, significantly improves generation quality and inference speed, and provides a new direction for the development of the field.

AI2 Releases Open Source Dataset for Large Language Model Dolma Containing 3 Trillion Tokens

Related Recommendations

Carnegie Mellon University Develops New AI System: Real-Time Repair of 3D Printing Defects Like a Conductor

Neusoft Group Collaborates with Cerence AI to Create a New Experience for the Future Intelligent Cockpit

1 Dollar to Run 200 Browser Tasks! The Open-Source Browser Control Magic BU-30B-A3B-Preview Makes Its Debut

Japanese Scientists Launch Sui Programming Language, Claiming It Can Write Code with 100% Accuracy Using LLM

Ant Group Open Sources LLaDA2.0, the Industry's First 100B-Parameter Diffusion Language Model