ELYZA Releases Japanese LLM Based on Llama 2, with 7 Billion Parameters, Competing with GPT-3.5


Google has launched a new series of open-source models called 'Gemma'. A comparison between Gemma, Llama 2, and Mistral. The design principles and features of Gemma. Characteristics of the GeGLU activation function used in Gemma.
Meta has introduced the next-generation large language model Llama 2, which surpasses GPT-3.5 Turbo and Claude 2 on certain tasks. Released in July 2022, Llama 2 offers three different model sizes: 7 billion, 13 billion, and 70 billion parameters. Meta is collaborating with Dell to assist enterprise customers in deploying Llama 2 models locally instead of solely relying on cloud services. The Llama 2 model is open-source and available for research and some commercial use. Meta has partnered with Microsoft and Amazon.
Microsoft recently announced a series of upgrades to its AI suite. They announced support for the Llama 2 large model and the launch of the GPT-4 version of Office. Llama 2 is a new AI model with powerful natural language processing capabilities. The GPT-4 version of Office is a premium office suite offered by Microsoft, available for users through a $30/month rental model. This upgrade signifies that Microsoft's AI technology will become more advanced and comprehensive.
Recently, during the Tokyo Game Show, Falcom's president, Koji Kondo, mentioned in an interview with 4Gamer that the company might consider using artificial intelligence in the future to shorten game localization times. He specifically talked about his views on AI translation, believing that such technology could help quickly translate Japanese games into multiple languages. Image source note: The image is generated by AI, provided by the image licensing service Midjourney. His remarks came after demonstrating a software called ELLA, which aims to assist in game localization.
Recently, Google announced the open-sourcing of its text watermark tool SynthID, aimed at helping developers better identify AI-generated text. This tool is now publicly available through Google's 'Responsible AI Toolkit'. Pushmeet Kohli, Vice President of Research at Google DeepMind, stated that this technology will enable other generative AI developers to detect whether text outputs originate from their own Large Language Models (LLMs), which will help them be more responsible.