HSE Scientists Propose AI-Driven Solutions for Medical Applications
Artificial intelligence will not replace medical professionals but can serve as an excellent assistant to them. Healthcare requires advanced technologies capable of rapidly analysing and monitoring patients' conditions. HSE scientists have integrated AI in preoperative planning and postoperative outcome evaluation for spinal surgery and developed an automated intelligent system to assess the biomechanics of the arms and legs.
At a joint scientific seminar held as part of the Human-Centred AI Strategic Project (in the framework of the Priority 2030 programme), HSE scientists presented two AI-driven solutions for use in medical practice. This field is not new for HSE University, noted Vice Rector Elena Odoevskaya in her opening address. Although the university does not offer educational programmes in medicine, it is involved in developing medical products and intends to enter this market.
'In terms of goals and objectives, we need to recognize that this is a product, not just a study. This means we must have partners, both external and industrial, and we need to understand how this product will continue to evolve with or without us. It’s all about the way we implement it,' she stressed.
Application for Spinal Marking
The first presentation focused on using AI for preoperative planning and postoperative outcome evaluation in spinal surgery. Vladimir Klinshov, Chief Research Fellow at the International Laboratory of Dynamical Systems and Applications of HSE Campus in Nizhny Novgorod, discussed how computer vision technologies can enhance the speed and quality of spine X-ray analysis, optimising the routine work of neurosurgeons. The working name of the product is VerteScan (derived from the word 'vertebra'). It is a service for viewing and analysing X-ray images of the human spine, featuring an automated marking system powered by artificial intelligence. 'We are developing a tool for automatic marking and analysis of spine X-ray images. We aim to relieve doctors of the routine aspects of their work, allowing them to focus on making the most important decisions. This product is designed by surgeons for surgeons. This means it will be intuitive for doctors, comfortable to use, and something they will want,' he said.
Spinal pathology accounts for 76% of patient referrals to the neurological service, and 72% of these referrals result in temporary disability. VerteScan will help identify the patient's anatomical features and disease progression, select the minimum appropriate level of surgical intervention, and provide personalised recommendations for implants and surgical techniques.
Medical institutions, manufacturers of medical implants, and professional associations of orthopaedic and spinal surgeons can be key partners in the project. To attract initial users and gather feedback, the developers plan to offer a free trial version of the software, with premium features available through subscription or a one-time payment.
If spinal surgery is performed suboptimally, it can accelerate the wear of intact vertebral motor segments, leading to treatment outcomes that are worse than the original condition, according to Andrey Bokov, Head of the Neurosurgery Department at Privolzhsky Research Medical University of the Russian Ministry of Health.
'Unless all relevant parameters are taken into account, the patient may feel better after surgery for a few years at most but is likely to experience decompensation afterwards. This person will spend an extended period on sick leave and be excluded from social life. If we can reduce the percentage of such cases, the social impact will be significant,' Bokov emphasised.
AI-Guided Physical Therapy
The second report featured an automated intelligent system designed to assess the biomechanics of the arms and legs. This system employs machine learning algorithms to analyse biomechanical data, which helps improve diagnosis and rehabilitation of patients significantly. The solution was presented by Andrey Kovalchuk, Project Head and Research Fellow at the Laboratory of Theory and Practice of Decision-Making Support Systems of the Faculty of Informatics, Mathematics and Computer Science, HSE Campus in Nizhny Novgorod. He emphasised that diseases of the musculoskeletal system are often described as the non-infectious epidemic of the 21st century. A promising area of rehabilitation for patients affected by these conditions is remote rehabilitation through digital technologies. Its implementation requires software-hardware complexes (SHCs) for video capture of movements.
The SHCs developed to date for remote motor rehabilitation share several common disadvantages: high cost, operational complexity, and the need for a doctor's constant presence. This makes them inaccessible for widespread use.
Remote rehabilitation helps increase the number of patients per doctor by reducing face-to-face interaction time while enhancing the quality of service by transferring some of the doctor’s functions to AI.
The patient no longer needs to visit the hospital, while still benefiting from a personalised approach and a flexible rehabilitation plan based on objectively measured parameters.
'As part of this project, we plan to develop a prototype of a mobile application using computer vision technology, designed for remote-controlled rehabilitation of patients. With this application, the doctor will be able to create an individualised training program for the patient and monitor key indicators, including the ratio of correctly to incorrectly performed repetitions per session and the angles of joint flexion,’ according to Kovalchuk.
The competitiveness of the system will depend on its autonomy, efficiency, and accessibility to a wide range of users, regardless of their location or financial circumstances.
The application will not only collect and analyse video data of movement scenarios and transmit it to the doctor for monitoring and correction, but also interact with the user in real time through voice commands, providing feedback on mistakes and events.
'The foundation of recovery is not medicine or even surgery; it is physical therapy. However, the movements must be performed regularly and correctly. Therefore, feedback on independently performed exercises is essential,' explains Anna Belova, Head of the Medical Rehabilitation Department at Privolzhsky Research Medical University and Chief Neurologist at the Ministry of Health of Nizhny Novgorod region.
See also:
HSE University and Sber Researchers to Make AI More Empathetic
Researchers at the HSE AI Research Centre and Sber AI Lab have developed a special system that, using large language models, will make artificial intelligence (AI) more emotional when communicating with a person. Multi-agent models, which are gaining popularity, will be engaged in the synthesis of AI emotions. The article on this conducted research was published as part of the International Joint Conference on Artificial Intelligence (IJCAI) 2024.
Neural Network for Assessing English Language Proficiency Developed at HSE University
The AI Lingua Neural Network has been collaboratively developed by the HSE University’s AI Research Centre, School of Foreign Languages, and online campus. The model has been trained on thousands of expert assessments of both oral and written texts. The system evaluates an individual's ability to communicate in English verbally and in writing.
HSE University and Yandex to Host International AI Olympiad for Students
The HSE Faculty of Computer Science and Yandex Education are launching their first joint AI competition, Artificial Intelligence and Data Analysis Olympiad (AIDAO), for students from around the world. Participants will tackle challenging tasks in science and industry and interact with experts from HSE and Yandex. The winners will receive cash prizes.
Winners of the International Olympiad in Artificial Intelligence Admitted to HSE University
In mid-August, Bulgaria hosted the finals of the first International Olympiad in Artificial Intelligence (IOAI) among high school students. The Russian team demonstrated excellent results, winning gold medals in the scientific round, silver medals in the practical round, and coming first in both rounds overall. This year two members of the Russian team were accepted into the programmes of the HSE Faculty of Computer Science.
Artificial and Augmented Intelligence: Connecting Business, Education and Science
The history of AI research in Nizhny Novgorod dates back to the 1960s and 1970s. Today, AI technologies, from voice assistants and smart home systems to digital twin creation and genome sequencing, are revolutionising our life. Natalia Aseeva, Dean of the Faculty of Informatics, Mathematics and Computer Science at HSE Campus in Nizhny Novgorod, discusses how the advancement of AI connects science, business, and education.
HSE University Leads the AI Alliance Ranking
The AI Alliance Russia has released a new ranking of Russian universities based on the quality of education in the field of AI. Similar to last year, HSE University has joined the leaders in A+ group alongside MIPT and ITMO. A total of 207 universities from 69 Russian regions participated in the ranking. In 2024, over 35,000 students were enrolled in AI-related programmes at these universities.
Reinforcement Learning Enhances Performance of Generative Flow Networks
Scientists at the AI Research Centre and the AI and Digital Science Institute of the HSE Faculty of Computer Science applied classical reinforcement learning algorithms to train generative flow networks (GFlowNets). This enabled significant performance improvements in GFlowNets, which have been employed for three years in tackling the most complex scientific challenges at modelling, hypothesis generation, and experimental design stages. The results of their work achieved a top 5% ranking among publications at the International Conference on Artificial Intelligence and Statistics AISTATS, held on May 2-4, 2024, in Valencia, Spain.
‘I Came Up with the Idea to Create an Application Useful for Practicing Physicians’
Dmitry Ryabtsev, a 2024 graduate of the master's programme at the HSE Faculty of Computer Science, created an AI-powered software service for ophthalmology during his two years of study. This product is now entering the market, and its developer plans to participate in establishing a working group on software engineering for medical applications at the HSE Faculty of Computer Science, with the goal of promoting more genuinely useful domestic projects. In an interview with HSE News Service, Dr Ryabtsev shared his story of how a professional doctor turned into a programmer.
HSE University and Sber Conduct Foresight in Artificial Intelligence
HSE University, in collaboration with Sber, have conducted a foresight study on artificial intelligence (AI). Its early results were discussed by the participants of a strategic foresight session on exploratory research in AI, held at the Coordination Centre of the Russian Government, headed by Deputy Prime Minister Dmitry Chernyshenko. The results from the foresight study will inform the Unified Research and Development Programme in the Field of AI.
White Papers of AI Conformity Assessment Published on HSE University Website
The Russian Technical Committee for the Standardization of ‘Artificial intelligence’ (TC164), together with the Chamber for Indo Russo Technology Collaboration and the RUSSOFT Non-profit Partnership of Software Developers, has published new White Papers related to Artificial Intelligence Conformity Assessment. It reflects the approaches to the standardization and ethical regulation of AI technologies in two pilot industries — healthcare and agriculture.