According to Arabian Business, it has become the fourth, ahead of Google’s Gemini and GPT-3.5. How much can you trust this evaluation?
The Russian-language language model from Sber GigaChat, launched in the spring of last year, entered the top five in the world. According to the Arabian Business publication, it became the fourth, ahead of Gemini from Google and GPT-3.5. In addition, the neural network turned out to be the only Russian development that entered the international benchmark, and it surpassed all models in working with Russian-language queries. Which is logical since it is its native language of training.
The model evaluation used a blind testing method, where analysts, without knowing the model’s name, compared the success of performing tasks set before the neural network. Parameters such as language translation, creative writing, code generation, and other characteristics were evaluated.
Commenting is the chief architect of AI systems at the AI Research Center in the “Transport and Logistics” direction of MEPhI, Roman Dushkin:
Roman Dushkin, Chief architect of artificial intelligence systems at the AI Research Center in the “Transport and Logistics” direction at MEPhI
Despite doubts about the methodology of this study and the inaccuracies in the positions of leading AI, GigaChat from Sberbank can indeed be considered the best Russian development, according to the CEO of Dbrain and the author of the AI Happens Telegram channel, Alexey Khakhunov:
Any multimodal model, i.e., a model capable of perceiving information both in text and image form, must justify the research data and be applicable to a wide user base, says the SEO of the artificial intelligence studio and lecturer at HSE, Daria Fokina:
Daria FokinaSEO of the artificial intelligence studio and lecturer at HSE
Just recently, the combined audience of GigaChat and Kandinsky reached 18 million people. The release of neural networks from Sberbank took place in the spring of 2023, and in September the service opened access to everyone interested. The most popular feature of the neural network in the last month turned out to be the ability to create personalized greeting cards for holidays.