In this very complete review, authors explain how AR and VR are now mandatory in surgery training and why visual rendering and haptic feedback are the key points of success. The key components for incorporating VR into surgical simulators are visual and haptic rendering. These components ensure that the user is completely immersed in the virtual environment and can interact in the same way as in the physical world. The key components for the application…"A Review on the Applications of Virtual Reality, Augmented Reality and Mixed Reality in Surgical Simulation: An Extension to Different Kinds of Surgery"
VR has a number of advantages over traditional rehabilitation approaches. First, VR has a high level of ecological validity because of the sensorimotor interaction between the user and the virtual environment, allowing to transfer skills from virtual to real word. Second, the compliance and the satisfaction of the patient when interacting with the enriched computer-generated environment are higher than those with conventional rehabilitation (49). Third, VR has the great advantage of providing an immediate a…"Telemedicine and Virtual Reality for Cognitive Rehabilitation: A Roadmap for the COVID-19 Pandemic"
#DIMENSIONSXR2020 : XR for medicine and healthcare 1. Introduction to XR in healthcare (partial)2. XR in Healthcare: Unrivaled Program Implementation & Rollout Strategy3. How Virtual Therapeutics Will Revolutionize Medicine4. Virtual Reality Technology, Machine Learning, Biosensing – Converging to Transform Healthcare Other sessions are available on https://dimensionsxr.com/"XR for medicine and healthcare sessions of #DIMENSIONSXR2020"
AR-3D guided surgery is useful for improving the real-time identification of the index lesion and allows changing of the NS approach in approximately one out of three cases, with overall appropriateness of 94.4%. In this article, authors measure the improvement of accuracy in a prostatectomy du to AR guided tool. Source: Real-time Augmented Reality Three-dimensional Guided Robotic Radical Prostatectomy: Preliminary Experience and Evaluation of the Impact on Surgical Planning – ScienceDirect"Real-time Augmented Reality Three-dimensional Guided Robotic Radical Prostatectomy: Preliminary Experience and Evaluation of the Impact on Surgical Planning"
From March 2018 to February 2019, 40 subjects were enrolled, randomized, and completed the study; 19 were randomized to control and 21 to the VR arm. Most baseline characteristics were similar between groups. For the primary outcome, those assigned to the control arm had a statistically significant increase in pain of +0.58, while the VR arm had a significant reduction in pain of -0.52 (p = 0.03). There was also a difference in the proportion…"Virtual Reality Reduces Pain in Laboring Women: A Randomized Controlled Trial"
The future of technology captivates audiences. So does spatial computing. This is a unique approach to answering the question about the future of VR and AR in healthcare. We have three experts, working in the field of VR and AR in healthcare today, a neurologist, an expert from the FDA, and a technologist with 15 years of experience in virtual worlds, currently, a Ph.D. candidate working at the intersection of extended reality and healthcare. Source:…"The Future of Spatial Computing in Healthcare Wednesday, August 26th"
The Baylor Scott & White Research Institute (Dallas, USA) will work on a VR simulator to improve hiatal hernia surgery training. This work is supported by the US National Institutes of Health and should go up to the complete validation of the process. It is lead by Dr Ganesh Sankaranarayanan who has worked on many immersive tools for surgery. The study, titled Development and Validation of a Virtual Laparoscopic Hiatal Hernia Simulator (VLaHHS), will be led by…"NIH awards Baylor Scott & White Research Institute R01 grant for surgical simulator study"
In this review authors show today results of VR uses in Parkinson disease rehabilitation and emphasize the lack of large studies on this topic. They also give advices for future studies and clinical trials. This Review examines the rationale and evidence for using VR in the assessment and rehabilitation of people with PD, makes recommendations for future research and discusses the use of VR in the clinic. In the assessment of people with PD, VR has…"Virtual reality in research and rehabilitation of gait and balance in Parkinson disease"
Jefferson Health (Philadelphia, USA) made a short video to explain as clearly as possible what is VR (and why to use it) to patients, before they enter in a VR research study. It is useful to inform the patient (of course) but also help them to understand better the survey form, and it improve quality results. If you are interested you can contact the Jefferson Health to adapt this video. However, we have often found…"Introduction Video for Patient Participation in VR Research Studies"
In this article authors follow several goals around VR uses in pain treatment. They want in particular to test the possibility for patient to be autonomous in using these technologies and check their engagement. Even if the sample patient is small, results are very encouraging and demonstrate efficiency and real engagement. The VR and audio groups launched a total of 1067 and 1048 sessions, respectively. The majority of VR participants (n=19/25, 76%) reported no nausea…"Self-Administered Skills-Based Virtual Reality Intervention for Chronic Pain: Randomized Controlled Pilot Study"
Les personnages virtuels sont-ils en capacité de générer des réactions émotionnelles et empathiques chez l’utilisateur ? Quels sont les facteurs qui peuvent induire l’empathie et comment ?Toutes ces questions, qui ne trouvent pas de réponse immédiate, elle les a mis au service de la Recherche, dans le cadre d’une thèse CIFRE, partageant son temps entre le LAMPA (équipe Présence & Innovation) et SimforHealth, le pôle de simulation numérique du groupe Interaction Healthcare. Source: Anne-Sophie Milcent : une…"Anne-Sophie Milcent : une thèse aux petits soins de l’interaction Humain-Machine"
Dr. Walter Greenleaf will discuss his work and vision relative to the state-of-the-art virtual reality (VR) in the field of medicine and wellbeing. His talk will also highlight his insights on how scientific rigger and research is critical to the establishment of viable new knowledge and products for medical use in this time of popular press grabs for attention in applied VR. Source: Translating VR Research into Medical Impact with Walther Greenleaf Ph.D. – Crowdcast"Translating VR Research into Medical Impact with Walther Greenleaf Ph.D., webinar July 1st | 12:00 PM EDT"
In this article, authors present new vascular simulations with VR visualisation. We thus developed Harvis, a software platform with a flexible GUI for performing vascular simulations and a VR-capable interface for geometry modification and flow visualization. The aim of Harvis is to streamline and integrate this process for research use and future clinical applications. Source: Harvis: an interactive virtual reality tool for hemodynamic modification and simulation – ScienceDirect"Harvis: an interactive virtual reality tool for hemodynamic modification and simulation"
In this article, authors compare several Ki‐67 scoring methods to those which use a augmented reality microscope. Conclusions discuss balance between rapidity and accuracy. The Ki‐67 index is important for grading neuroendocrine tumors (NETs) in cytology. However, different counting methods exist. Recently, augmented reality microscopy (ARM) has enabled real‐time image analysis using glass slides. The objective of the current study was to compare different traditional Ki‐67 scoring methods in cell block material with newer methods…"Ki‐67 proliferation index in neuroendocrine tumors: Can augmented reality microscopy with image analysis improve scoring"
In this article, authors present a method of 3D measure in order to diagnosis BCRL. Breast cancer related lymphedema (BCRL) is a detrimental condition characterized by fluid accumulation in the upper limb in breast cancer patients subjected to axillary surgery and/or radiations. Its etiology is multifactorial and include also tumor-specific pathological features, such as lymphovascular invasion (LVI) and extranodal extension (ENE). To date, no widely employed guidelines for the early diagnosis of BCRL are available.…"Integrating augmented reality tools in breast cancer related lymphedema prognostication and diagnosis"
The findings show statistically significant higher QoE ratings for AR feedback. Also, the number of knee misalignments was reduced after users experienced AR feedback (35% improvement with AR feedback relative to baseline when compared to haptic). Gender analysis showed significant differences in performance for number of misalignments and time to correct valgus misalignment (for males when they experienced AR feedback). The female group self-reported higher utility and QoE ratings for AR when compared to m…"A Quality of Experience assessment of haptic and augmented reality feedback modalities in a gait analysis system"
In this article, authors explain a system to improve precision for the localisation of frontal sinus before surgery. This method use holographic reconstruction from CT scans images and Magic Leap AR goggles for visualization. Our team developed an AR system to create a 3‐dimensional (3D) hologram of key anatomical structures, based on CT scans images. Using Magic Leap AR goggles for visualization, the frontal sinus hologram was aligned to the surface anatomy in 6 fresh…"Application of holographic augmented reality for external approaches to the frontal sinus"
Le laboratoire de recherche et d’étude sur le mouvement de Nevers lance avec le foyer de Saint-Andelain une étude sur l’impact de l’utilisation de la réalité augmentée sur la plasticité cérébrale. Plusieurs personnes ayant des déficiences mentales vont s’entrainer pendant plusieurs mois avec une paire de lunettes Hololens de Microsoft et leur capacités sera mesurée. L’objectif est de définir le meilleur protocole d’utilisation pour réduire les prises de médicaments. Car désormais, chaque mercredi matin, ces…"Expérimentation inédite dans la Nièvre : la réalité augmentée pour améliorer la vie des déficients mentaux"
A team of the University of Georgia shown that VR has a real impact on the feeling of pain in a intense exercise. It could be very useful for professional sportspeople and several cases of re-education. “This is one of the first studies to demonstrate the ability of VR to reduce pain when engaging in highly intensive exercising that is known to induce significant pain,” said study co-author Sun Joo (Grace) Ahn, associate professor of…"Virtual reality reduces leg muscle pain during high intensity cycling"
In this article from “The Journal of Spine Surgery”, a review of many studies is presented about the use of immersive technologies to train surgeons. Conclusions are very simple : these technologies improve skills BUT in many cases relance is low. The need of big scale study is clear. The current scope of VR, AR, and MR surgical simulators in MISS and spinal endoscopic surgery was described. Studies demonstrate improvement in technical skill and patient…"Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons"
It could be the first steps to a functional retinal implant to help people with vision degeneration. We also can imagine more futuristic devices like true augmented reality implants we will use instead of AR glasses. Retinal dystrophies and age-related macular degeneration related to photoreceptor degeneration can cause blindness. In blind patients, although the electrical activation of the residual retinal circuit can provide useful artificial visual perception, the resolutions of current retinal prostheses have been…"Behavioural responses to a photovoltaic subretinal prosthesis implanted in non-human primates"
In an article published in the JAMA Cardiology, authors study training in CPR from “Lifesaver VR” application. Even if skills of face-to-face trained people are better than those of VR trained, the use of VR training is a perfect solution to widen the access to CPR training, because of its low cost and short time duration. “This study confirms the potential of brief face-to-face training to achieve adequate CPR skills and provides valuable input for…"Could virtual reality be the future of CPR training?"
This study on the effect of a VR headset on young people (under 10 years old) is based on a 50 children. The result shows that one hour use of VR induce not effect (directly or after a period of time). Young children tolerate fully immersive 3D virtual reality game play without noteworthy effects on visuomotor functions. VR play did not induce significant post-VR postural instability or maladaption of the vestibulo-ocular reflex. The prevalence of…"Effects of Immersive Virtual Reality Headset Viewing on Young Children: Visuomotor Function, Postural Stability, and Motion Sickness."
In this article, a team from McMaster University explains results of its latest study about efficiency of VR and AR in teaching anatomy. Immersive technologies in this case don’t help students and, in the contrary, decrease their results! It’s a good reminder that the technology alone can’t solve all problems. Solutions have to be imagined more globally. Groups of 20 undergraduate students at McMaster with no prior anatomic training learned pelvic anatomy under seven conditions:…"Virtual and mixed reality inferior to traditional learning in anatomy education"
In this article, author explains how pediatric oncologist Beth Apsel Winger and her colleagues from UCSF School of Pharmacy have used VR to design a new drugs for a particular patient. They have developed a special version of the well known visualisation software Chimera called “ChimeraX”. This application allows people to see mutated protein’s shape and to choice best adapted drugs. Meetings in the Jacobson Lab are different now. Instead of preparing lengthy PowerPoint presentations…"VR drug discovery makes precision therapy a reality | School of Pharmacy"
In this article authors perform a meta-analyse over more than a thousand statistical tests related to uses of VR in psychology. The study is mainly focused on statistical consistency and explore main errors seen in scientific papers. They also talk about “usual” bias in selected samples. The conclusions may seem harsh to you but it give good ways for future research 🙂 Virtual reality (VR) is a popular subject of scientific study across a variety…"Virtual Reality Check: Statistical Power, Reported Results, and the Validity of Research on the Psychology of Virtual Reality and Immersive Environments"
Is it efficient to design drugs and to manipulate molecules “with hands”? A team from company Sygnature have done many tests and they have found this method useful for collaborative work. They used Hololens and 3D rendering software to help biochemists to see shapes and structures interactions. Company now works to integrates all functionalities in a easy-to-use software. “It’s good for immersing yourself in a completely different world, but you’re there by yourself,’ says Dr…"Augmented reality prototype software for drug molecules developed"
As virtual reality technologies becomes more and more accessible, R&D team in biotech try different approaches to use it in they every-day work. In this article, authors explain how it can be used to see (and even to feel!) complex molecular 3D geometry. The exemple of the exploration of this field by Novartis with the start-up Nanome illustrates what could be drug discovery tomorrow. Using the collaborative VR platform developed by four-year-old Nanome, scientists can…"Virtual Reality for drug discovery is for real!"
U.K. National Institute of Health Research has launched a really big project (£4 million funded) to test the efficiency of VR in mental health therapy. This project is called “gameChange” and it evolves many partners (both private and public). In particular, it will test VR products of Oxford VR start-up. The first large-scale trial on psychosis patients will bring robust results on VR efficiency next year according to Oxford VR CEO and allows clinicians to…"First Major Trial Of VR Therapy For Serious Mental Health Conditions Launches"
En recherche et en particulier en biologie, les appareils modernes permettent de récupérer de grandes quantités de données sur les expériences. Même si les progrès de l’ intelligence artificielle permettent de trier et de comprendre de mieux en mieux ces paramètres, les chercheurs doivent pouvoir facilement se les représenter. Pour cela la réalité virtuelle offre une ergonomie intéressante et nous voyons apparaitre des croisements de domaine intéressant. Dans cet article, une équipe de chimiste de…"La réalité virtuelle pour découvrir des médicaments ?"
In this article you will find a presentation of Holo4Labs tools and a description of potential uses of augmented reality in a science laboratory. This product is in fact a HMI (human-machine interface) to the software solution4labs. In HCS Pharma we have presented a very similar view of the future of laboratories at Forum Labo 2017 The laboratory of the future will be very different. Emerging technology is radically reshaping the way we tackle daily…"Mixed Reality Will Soon Be in the Service of Science Labs"
La réalité virtuelle est de plus en plus utilisée pour “voir” les structures complexes des molécules et pour comprendre les interactions entre composés. L’imagerie 3D est aussi une potentielle utilisatrice de ces technologies. C’est d’ailleurs un des axes de recherche porté par HCS Pharma dans le but de mieux interpréter les résultats des analyses 3D. “Il est difficile de résoudre les structures protéiques” écrit Steve McCloskey, fondateur et PDG de Nanome. “Un seul résidu égaré…"Recherche : ils jouent avec des molécules en réalité virtuelle"
In this article, authors explain the creation of a high quality 3D model of human cranial vault. They also show the benefice of this medication for surgery training, education, and research. The skull models that were presented have the potential to serve as a novel method of understanding cranial anatomy with an emphasis on accuracy, completeness, and visual appeal. It has utility in educational, illustrative, and surgical training purposes. The models provide critical insight into the…"Operative Anatomy of the Human Skull: A Virtual Reality Expedition"
In this article authors present a new calibration method to increase the precision of the position for a Hololens. Using external system combined with embedded SLAM and a “hand‐eye” based approach, it could be possible to lowered uncertainty on Virtual/Real position close to 3 mm. Augmented reality (AR) allows the surgeon to represent holographic patient‐specific anatomical information and surgical instruments on the physical world. To correctly superimpose virtual and physical objects, a hand‐eye calibration method…"A Hand‐Eye Calibration Method for Augmented Reality Applied to Computer‐Assisted Orthopedic Surgery"
In this article, Martijn Roelandse introduces a “mixed-reality Hackathon” hosted by Springer Nature and dedicated to exploration of new uses of AR and VR in sciences. It’s very interesting to see that today, many 3D observations (made with confocal devices for example) are still seen on 2D screens! Immersive technologies could revolutionize it, maybe more fastly then we think. With the arrival of the fifth wave of computing, amazing techniques like artificial intelligence, blockchain and…"How Augmented Reality and Virtual Reality Can Revolutionize Science?"
Google present a great combination between Machine Learning and augmented reality to help pathologists to identify cancers. The presented device is “only” a lightly modified light microscope with real-time analyzing computer. The result is directly displayed in the pathologist field of view. Applications of deep learning to medical disciplines including ophthalmology, dermatology, radiology, and pathology have recently shown great promise to increase both the accuracy and availability of high-quality healthcare to patients around the world.…"An Augmented Reality Microscope for Cancer Detection"
At Novartis, virtual reality is used to understand complex interactions between molecules. It’s a way to facilitate communication between chemist and biologist about drug design and protein’s interactions. Viktor Hornak, an investigator in the Global Discovery Chemistry department at the Novartis Institutes for BioMedical Research (NIBR), is driving an effort to adapt VR tools for use in the drug design process. He and his colleagues recognize a potential for VR to help drug hunters more quickly…"Bringing virtual reality to the lab at Novartis"
With this very impressive installation, Pfizer R&D team explores the complexity of molecular actions in brain (and in 3D!) At Pfizer’s Research & Development hub in Cambridge, Mass., chemists, neuroscientists and other researchers use 3D VisBox technology to visualize and virtually explore the human body at the molecular level. Source: How Virtual Reality Takes Scientists Inside New Molecules (video) | Get Science"How Virtual Reality Takes Scientists Inside New Molecules"
Molecular biology produces huge amounts of data in the post-genomic era. This includes data describing metabolic mechanisms and pathways, structural genomic organization, patterns of regulatory regions; proteomics, transcriptomics, and metabolomics. On the one hand, analysis of this data uses essentially the methods and concepts of computer science; on the other hand, the range of biological tasks solved by researchers determines the range and scope of the data. Integrative Bioinformatics is a new area of research…"From Virtual Reality to Immersive Analytics in Bioinformatics Burlingame, California, 30 Jan 2018"