HSE University Opens Joint Laboratory with Samsung Research

© Signature/ iStock

Samsung-HSE Laboratory will develop mechanisms of Bayesian inference in modern neural networks, which will solve a number of problems in deep learning. The laboratory team will be made up of the members of the Bayesian Methods Research Group — one of the strongest scientific groups in Russia in the field of machine learning and Bayesian inference. It will be headed by a professor of the Higher School of Economics Dmitry Vetrov.

Neural networks and Bayesian models are two popular paradigms in the field of machine learning. The first made a real revolution in the field of processing of big data, giving rise to a new direction, dubbed deep learning. The latter have traditionally been used to process small data. A new mathematical tool, developed in 2010, allows you to design scalable Bayesian models. This makes it possible to apply the mechanisms of Bayesian inference in modern neural networks. Even the first attempts to construct hybrid neuro-Bayesian models lead to unexpected and interesting results. For example, by using Bayesian inference in neural networks, it is possible to compress the network by approximately 100 times without losing the accuracy of its operation. On the other hand, in the very procedure of the approximate Bayesian inference one can also use a neural network to approach the exact a posteriori distribution. Thus, mutual penetration of the two technologies is obtained.

Neuro-Bayesian approach can potentially solve a number of open problems in deep learning: the possibility of a catastrophic over fitting for noised data, the self-confidence of a neural network even in erroneous predictions, uninterpretable decision-making, and vulnerability to adversarial attacks. All these problems are recognized by the scientific community, many teams around the world work on their solution, but there are no ready answers yet.

‘Samsung Electronics is one of the world's technological leaders. In our development we use many models of deep learning. But in order to keep up with competitors, it is not enough just to use ready-made models. We need to create new technologies of machine learning. This is all the more important because the field of deep learning has not yet "settled" and every year there are new models, and existing ones quickly become obsolete,’ explains (Geunbae Lee, the Head of the AI Center, Samsung Research). ‘All this means that humanity has not yet found the optimal solution for processing big data. Therefore, cooperation with leading scientific groups in the field of machine learning and artificial intelligence in universities around the world allows us to "keep our finger on the pulse" and keep track of the latest achievements in the field, as well as get exclusive access to technologies created in partner laboratories.’

‘Samsung's decision to choose our group as a key partner in Russia, giving us the opportunity to focus exclusively on basic research, is a sign of recognition of our scientific achievements and at the same time a credit of confidence that we will try to fully justify,’ says the head of the joint laboratory and the head of the Bayesian methods research group, Dmitry Vetrov. ‘Usually large companies try to use scientists to solve specific applied problems. I am glad that our Korean partner understands the importance of research on the development of new technologies, rather than solving specific problems. Our laboratory will deal with the creation of new technologies, that is, the most interesting from the point of view of the scientist. Our goals completely coincide with the wishes of our partners, which serves as a guarantee of successful and long-term cooperation.’

In addition to scientific projects, the HSE-Samsung joint laboratory will actively participate in educational activities. Students and post-graduate students of the Faculty of Computer Science will be attracted to work in it. In August 2018, with the support of Samsung, the second summer school on neuro-Bayesian methods will be held. This time it will be conducted in English and several leading scientists will take part in it. The registration is still open for the summer school.