In this very complete review, authors explain how AR and VR are now mandatory in surgery training and why visual rendering and haptic feedback are the key points of success. The key components for incorporating VR into surgical simulators are visual and haptic rendering. These components ensure that the user is completely immersed in the virtual environment and can interact in the same way as in the physical world. The key components for the application…"A Review on the Applications of Virtual Reality, Augmented Reality and Mixed Reality in Surgical Simulation: An Extension to Different Kinds of Surgery"
VR has a number of advantages over traditional rehabilitation approaches. First, VR has a high level of ecological validity because of the sensorimotor interaction between the user and the virtual environment, allowing to transfer skills from virtual to real word. Second, the compliance and the satisfaction of the patient when interacting with the enriched computer-generated environment are higher than those with conventional rehabilitation (49). Third, VR has the great advantage of providing an immediate a…"Telemedicine and Virtual Reality for Cognitive Rehabilitation: A Roadmap for the COVID-19 Pandemic"
AR-3D guided surgery is useful for improving the real-time identification of the index lesion and allows changing of the NS approach in approximately one out of three cases, with overall appropriateness of 94.4%. In this article, authors measure the improvement of accuracy in a prostatectomy du to AR guided tool. Source: Real-time Augmented Reality Three-dimensional Guided Robotic Radical Prostatectomy: Preliminary Experience and Evaluation of the Impact on Surgical Planning – ScienceDirect"Real-time Augmented Reality Three-dimensional Guided Robotic Radical Prostatectomy: Preliminary Experience and Evaluation of the Impact on Surgical Planning"
From March 2018 to February 2019, 40 subjects were enrolled, randomized, and completed the study; 19 were randomized to control and 21 to the VR arm. Most baseline characteristics were similar between groups. For the primary outcome, those assigned to the control arm had a statistically significant increase in pain of +0.58, while the VR arm had a significant reduction in pain of -0.52 (p = 0.03). There was also a difference in the proportion…"Virtual Reality Reduces Pain in Laboring Women: A Randomized Controlled Trial"
The Baylor Scott & White Research Institute (Dallas, USA) will work on a VR simulator to improve hiatal hernia surgery training. This work is supported by the US National Institutes of Health and should go up to the complete validation of the process. It is lead by Dr Ganesh Sankaranarayanan who has worked on many immersive tools for surgery. The study, titled Development and Validation of a Virtual Laparoscopic Hiatal Hernia Simulator (VLaHHS), will be led by…"NIH awards Baylor Scott & White Research Institute R01 grant for surgical simulator study"
In this review authors show today results of VR uses in Parkinson disease rehabilitation and emphasize the lack of large studies on this topic. They also give advices for future studies and clinical trials. This Review examines the rationale and evidence for using VR in the assessment and rehabilitation of people with PD, makes recommendations for future research and discusses the use of VR in the clinic. In the assessment of people with PD, VR has…"Virtual reality in research and rehabilitation of gait and balance in Parkinson disease"
Jefferson Health (Philadelphia, USA) made a short video to explain as clearly as possible what is VR (and why to use it) to patients, before they enter in a VR research study. It is useful to inform the patient (of course) but also help them to understand better the survey form, and it improve quality results. If you are interested you can contact the Jefferson Health to adapt this video. However, we have often found…"Introduction Video for Patient Participation in VR Research Studies"
In this article authors follow several goals around VR uses in pain treatment. They want in particular to test the possibility for patient to be autonomous in using these technologies and check their engagement. Even if the sample patient is small, results are very encouraging and demonstrate efficiency and real engagement. The VR and audio groups launched a total of 1067 and 1048 sessions, respectively. The majority of VR participants (n=19/25, 76%) reported no nausea…"Self-Administered Skills-Based Virtual Reality Intervention for Chronic Pain: Randomized Controlled Pilot Study"
Les personnages virtuels sont-ils en capacité de générer des réactions émotionnelles et empathiques chez l’utilisateur ? Quels sont les facteurs qui peuvent induire l’empathie et comment ?Toutes ces questions, qui ne trouvent pas de réponse immédiate, elle les a mis au service de la Recherche, dans le cadre d’une thèse CIFRE, partageant son temps entre le LAMPA (équipe Présence & Innovation) et SimforHealth, le pôle de simulation numérique du groupe Interaction Healthcare. Source: Anne-Sophie Milcent : une…"Anne-Sophie Milcent : une thèse aux petits soins de l’interaction Humain-Machine"
In this article, authors present new vascular simulations with VR visualisation. We thus developed Harvis, a software platform with a flexible GUI for performing vascular simulations and a VR-capable interface for geometry modification and flow visualization. The aim of Harvis is to streamline and integrate this process for research use and future clinical applications. Source: Harvis: an interactive virtual reality tool for hemodynamic modification and simulation – ScienceDirect"Harvis: an interactive virtual reality tool for hemodynamic modification and simulation"
In this article, authors compare several Ki‐67 scoring methods to those which use a augmented reality microscope. Conclusions discuss balance between rapidity and accuracy. The Ki‐67 index is important for grading neuroendocrine tumors (NETs) in cytology. However, different counting methods exist. Recently, augmented reality microscopy (ARM) has enabled real‐time image analysis using glass slides. The objective of the current study was to compare different traditional Ki‐67 scoring methods in cell block material with newer methods…"Ki‐67 proliferation index in neuroendocrine tumors: Can augmented reality microscopy with image analysis improve scoring"
In this article, authors present a method of 3D measure in order to diagnosis BCRL. Breast cancer related lymphedema (BCRL) is a detrimental condition characterized by fluid accumulation in the upper limb in breast cancer patients subjected to axillary surgery and/or radiations. Its etiology is multifactorial and include also tumor-specific pathological features, such as lymphovascular invasion (LVI) and extranodal extension (ENE). To date, no widely employed guidelines for the early diagnosis of BCRL are available.…"Integrating augmented reality tools in breast cancer related lymphedema prognostication and diagnosis"
The findings show statistically significant higher QoE ratings for AR feedback. Also, the number of knee misalignments was reduced after users experienced AR feedback (35% improvement with AR feedback relative to baseline when compared to haptic). Gender analysis showed significant differences in performance for number of misalignments and time to correct valgus misalignment (for males when they experienced AR feedback). The female group self-reported higher utility and QoE ratings for AR when compared to m…"A Quality of Experience assessment of haptic and augmented reality feedback modalities in a gait analysis system"
In this article, authors explain a system to improve precision for the localisation of frontal sinus before surgery. This method use holographic reconstruction from CT scans images and Magic Leap AR goggles for visualization. Our team developed an AR system to create a 3‐dimensional (3D) hologram of key anatomical structures, based on CT scans images. Using Magic Leap AR goggles for visualization, the frontal sinus hologram was aligned to the surface anatomy in 6 fresh…"Application of holographic augmented reality for external approaches to the frontal sinus"
Le laboratoire de recherche et d’étude sur le mouvement de Nevers lance avec le foyer de Saint-Andelain une étude sur l’impact de l’utilisation de la réalité augmentée sur la plasticité cérébrale. Plusieurs personnes ayant des déficiences mentales vont s’entrainer pendant plusieurs mois avec une paire de lunettes Hololens de Microsoft et leur capacités sera mesurée. L’objectif est de définir le meilleur protocole d’utilisation pour réduire les prises de médicaments. Car désormais, chaque mercredi matin, ces…"Expérimentation inédite dans la Nièvre : la réalité augmentée pour améliorer la vie des déficients mentaux"
A team of the University of Georgia shown that VR has a real impact on the feeling of pain in a intense exercise. It could be very useful for professional sportspeople and several cases of re-education. “This is one of the first studies to demonstrate the ability of VR to reduce pain when engaging in highly intensive exercising that is known to induce significant pain,” said study co-author Sun Joo (Grace) Ahn, associate professor of…"Virtual reality reduces leg muscle pain during high intensity cycling"
In this article from “The Journal of Spine Surgery”, a review of many studies is presented about the use of immersive technologies to train surgeons. Conclusions are very simple : these technologies improve skills BUT in many cases relance is low. The need of big scale study is clear. The current scope of VR, AR, and MR surgical simulators in MISS and spinal endoscopic surgery was described. Studies demonstrate improvement in technical skill and patient…"Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons"
In this article, a team from McMaster University explains results of its latest study about efficiency of VR and AR in teaching anatomy. Immersive technologies in this case don’t help students and, in the contrary, decrease their results! It’s a good reminder that the technology alone can’t solve all problems. Solutions have to be imagined more globally. Groups of 20 undergraduate students at McMaster with no prior anatomic training learned pelvic anatomy under seven conditions:…"Virtual and mixed reality inferior to traditional learning in anatomy education"
In this article, author explains how pediatric oncologist Beth Apsel Winger and her colleagues from UCSF School of Pharmacy have used VR to design a new drugs for a particular patient. They have developed a special version of the well known visualisation software Chimera called “ChimeraX”. This application allows people to see mutated protein’s shape and to choice best adapted drugs. Meetings in the Jacobson Lab are different now. Instead of preparing lengthy PowerPoint presentations…"VR drug discovery makes precision therapy a reality | School of Pharmacy"
In this article authors perform a meta-analyse over more than a thousand statistical tests related to uses of VR in psychology. The study is mainly focused on statistical consistency and explore main errors seen in scientific papers. They also talk about “usual” bias in selected samples. The conclusions may seem harsh to you but it give good ways for future research 🙂 Virtual reality (VR) is a popular subject of scientific study across a variety…"Virtual Reality Check: Statistical Power, Reported Results, and the Validity of Research on the Psychology of Virtual Reality and Immersive Environments"
Is it efficient to design drugs and to manipulate molecules “with hands”? A team from company Sygnature have done many tests and they have found this method useful for collaborative work. They used Hololens and 3D rendering software to help biochemists to see shapes and structures interactions. Company now works to integrates all functionalities in a easy-to-use software. “It’s good for immersing yourself in a completely different world, but you’re there by yourself,’ says Dr…"Augmented reality prototype software for drug molecules developed"
As virtual reality technologies becomes more and more accessible, R&D team in biotech try different approaches to use it in they every-day work. In this article, authors explain how it can be used to see (and even to feel!) complex molecular 3D geometry. The exemple of the exploration of this field by Novartis with the start-up Nanome illustrates what could be drug discovery tomorrow. Using the collaborative VR platform developed by four-year-old Nanome, scientists can…"Virtual Reality for drug discovery is for real!"
U.K. National Institute of Health Research has launched a really big project (£4 million funded) to test the efficiency of VR in mental health therapy. This project is called “gameChange” and it evolves many partners (both private and public). In particular, it will test VR products of Oxford VR start-up. The first large-scale trial on psychosis patients will bring robust results on VR efficiency next year according to Oxford VR CEO and allows clinicians to…"First Major Trial Of VR Therapy For Serious Mental Health Conditions Launches"
En recherche et en particulier en biologie, les appareils modernes permettent de récupérer de grandes quantités de données sur les expériences. Même si les progrès de l’ intelligence artificielle permettent de trier et de comprendre de mieux en mieux ces paramètres, les chercheurs doivent pouvoir facilement se les représenter. Pour cela la réalité virtuelle offre une ergonomie intéressante et nous voyons apparaitre des croisements de domaine intéressant. Dans cet article, une équipe de chimiste de…"La réalité virtuelle pour découvrir des médicaments ?"
In this article you will find a presentation of Holo4Labs tools and a description of potential uses of augmented reality in a science laboratory. This product is in fact a HMI (human-machine interface) to the software solution4labs. In HCS Pharma we have presented a very similar view of the future of laboratories at Forum Labo 2017 The laboratory of the future will be very different. Emerging technology is radically reshaping the way we tackle daily…"Mixed Reality Will Soon Be in the Service of Science Labs"
La réalité virtuelle est de plus en plus utilisée pour “voir” les structures complexes des molécules et pour comprendre les interactions entre composés. L’imagerie 3D est aussi une potentielle utilisatrice de ces technologies. C’est d’ailleurs un des axes de recherche porté par HCS Pharma dans le but de mieux interpréter les résultats des analyses 3D. “Il est difficile de résoudre les structures protéiques” écrit Steve McCloskey, fondateur et PDG de Nanome. “Un seul résidu égaré…"Recherche : ils jouent avec des molécules en réalité virtuelle"
In this article, authors explain the creation of a high quality 3D model of human cranial vault. They also show the benefice of this medication for surgery training, education, and research. The skull models that were presented have the potential to serve as a novel method of understanding cranial anatomy with an emphasis on accuracy, completeness, and visual appeal. It has utility in educational, illustrative, and surgical training purposes. The models provide critical insight into the…"Operative Anatomy of the Human Skull: A Virtual Reality Expedition"
In this article authors present a new calibration method to increase the precision of the position for a Hololens. Using external system combined with embedded SLAM and a “hand‐eye” based approach, it could be possible to lowered uncertainty on Virtual/Real position close to 3 mm. Augmented reality (AR) allows the surgeon to represent holographic patient‐specific anatomical information and surgical instruments on the physical world. To correctly superimpose virtual and physical objects, a hand‐eye calibration method…"A Hand‐Eye Calibration Method for Augmented Reality Applied to Computer‐Assisted Orthopedic Surgery"
In this article, Martijn Roelandse introduces a “mixed-reality Hackathon” hosted by Springer Nature and dedicated to exploration of new uses of AR and VR in sciences. It’s very interesting to see that today, many 3D observations (made with confocal devices for example) are still seen on 2D screens! Immersive technologies could revolutionize it, maybe more fastly then we think. With the arrival of the fifth wave of computing, amazing techniques like artificial intelligence, blockchain and…"How Augmented Reality and Virtual Reality Can Revolutionize Science?"
Google present a great combination between Machine Learning and augmented reality to help pathologists to identify cancers. The presented device is “only” a lightly modified light microscope with real-time analyzing computer. The result is directly displayed in the pathologist field of view. Applications of deep learning to medical disciplines including ophthalmology, dermatology, radiology, and pathology have recently shown great promise to increase both the accuracy and availability of high-quality healthcare to patients around the world.…"An Augmented Reality Microscope for Cancer Detection"
At Novartis, virtual reality is used to understand complex interactions between molecules. It’s a way to facilitate communication between chemist and biologist about drug design and protein’s interactions. Viktor Hornak, an investigator in the Global Discovery Chemistry department at the Novartis Institutes for BioMedical Research (NIBR), is driving an effort to adapt VR tools for use in the drug design process. He and his colleagues recognize a potential for VR to help drug hunters more quickly…"Bringing virtual reality to the lab at Novartis"
With this very impressive installation, Pfizer R&D team explores the complexity of molecular actions in brain (and in 3D!) At Pfizer’s Research & Development hub in Cambridge, Mass., chemists, neuroscientists and other researchers use 3D VisBox technology to visualize and virtually explore the human body at the molecular level. Source: How Virtual Reality Takes Scientists Inside New Molecules (video) | Get Science"How Virtual Reality Takes Scientists Inside New Molecules"