In this article authors present a new calibration method to increase the precision of the position for a Hololens. Using external system combined with embedded SLAM and a “hand‐eye” based approach, it could be possible to lowered uncertainty on Virtual/Real position close to 3 mm. Augmented reality (AR) allows the surgeon to represent holographic patient‐specific anatomical information and surgical instruments on the physical world. To correctly superimpose virtual and physical objects, a hand‐eye calibration method…"A Hand‐Eye Calibration Method for Augmented Reality Applied to Computer‐Assisted Orthopedic Surgery"
In this TEDx video Nadine Hachach-Haram (CEO of Proximie) explains how surgeons can use immersive technologies to be “teleported” everywhere in the world to perform a surgical intervention. By using augmented reality, robotic, IA and high-speed network it will be possible to give patients access to the surgeon they need. Surgeon and entrepreneur Nadine Hachach-Haram is developing a new system that helps surgeons operate together and train one another on new techniques — from remote…"Nadine Hachach-Haram: How augmented reality could change the future of surgery"
In a poster presentation at the Computer Assisted Radiology and Surgery (CARS) 2018, Nicole Wake (doctoral candidate ) explains how augmented reality can help surgeons to better understand patient anatomy. In the particular case of prostate cancer, the preoperative planning is closely related to relationships between the tumor and nearby structures. The use of a Hololens AR helmet to “see it” is “considerably more useful ” according to surgeons who test the solution. Reesearchers from New York University School of…"Augmented reality optimizes prostate cancer surgery"
The Britain’s National Health Service is testing the use of virtual reality to help people with dementia. With immersive movies, patients are encouraged to recall their own personal history throught pictures and emotions. Results are very encouraging as Arfa Rehman said (co-founder of Virtue, partner of BNHS) and this partnership may be spread to others areas in Britain. “If people remember more of their past, remember more of themselves, it just helps with overall mental wellbeing,” Arfa Rehman,…"Britain Trials Virtual Reality Time Travel to Combat Dementia"
In this article professor Olivier Oullier explains how augmented reality will change the world of healthcare, when solutions will be more easy to use ans less expensive. In healthcare as in any other sector, having to speak, press buttons or make movements in the air prevent smart glasses from reaching mass adoption. Silent and motionless communication between the brain and augmented reality devices and content thanks to mental commands is the key feature that will…"Augmented reality can save lives and we’re veering towards mass adoption"
We are probably going to see more and more AR and VR parts in future medical devices and it’s interesting to see that a innovative country like Korea works on adapted guidelines. The main goal is to help companies to develop such a tools. The Ministry of Food and Drug Safety (MFDS) published a guideline Monday, which includes the definition and classification standards for approving products that apply virtual reality (VR) or augmented reality (AR)…"Seoul sets standards for VR and AR medical devices – Korea Biomedical Review"
This new initiative from United Nations is very interesting because IA is a fundamental part of the uses of immersives technologies in healthcare. Indeed, extracting useful information from pictures to make a diagnostic means that you have to completely understand the process of extraction. Or when you use IA, links between algorithms and results are often obscur. The “ITU Focus Group on AI for Health” wants to establish standard framework to create and validate IA algorithms.…"ITU and WHO launch new initiative to leverage power of Artificial Intelligence for health"
We know thah geolocalization games like Pokemon Go could help people in doing physical exercises but a new study from the from McMaster University shows that it could also be benefic for those with mental illness. When the game first came out, I noticed patients who had severe social anxiety disorder and a lot of depression starting to go out of their homes—and leave their computer screens and get off their couches—to play the game…"Could Pokemon GO, Augmented Reality Apps be Used for Mental Health Therapy?"
In this article you can discover a AR system use to assist surgeons in laparoscopic partial nephrectomy A projector-based augmented reality intracorporeal system (PARIS) is presented that includes a miniature tracked projector, tracked marker, and laparoscopic ultrasound (LUS) transducer. PARIS was developed to improve the efficacy and safety of laparoscopic partial nephrectomy (LPN). In particular, it has been demonstrated to effectively assist in the identification of tumor boundaries during surgery and to improve the surgeon’s…"Follow the light: projector-based augmented reality intracorporeal system for laparoscopic surgery"
A group from Johns Hopkins University uses augmented reality visualization to help implantation of surgical nails in patients with femoral fractures. Results from first experience show that accuracy is similar to conventional method but procedure time is reduced by nearly 10% and x-ray acquisitions are reduced by 90%. The group from Johns Hopkins University used x-ray images acquired with a C-arm to create virtual lines visible with an AR headset for guiding the implantation of…"Augmented reality guides orthopedic surgery"
In this article Tim Jennings (president of Custom Case Group) presents interesting cases where AR and VR are used to improve autonomy and self-monitoring for patients. AR apps, wearables and mobile devices have shown tremendous potential in patient self-monitoring, diagnosis and patient care. AR technology layers over the real world, providing digital visuals, sounds or other stimuli that give insights from gathered data or add enhanced detail to reality. From contact lenses that give visual cues to…"How augmented reality and virtual reality devices are boosting medicine"
A very simple way to use smartphone AR to help doctors in information visualization ! At the University of Twente in the Netherlands, a research team is developing an economical smartphone technology based on the Simultaneous Localization and Mapping (SLAM) technology, along with augmented reality (AR). The device allows doctors to reconstruct 3D body sections by directing the smartphone to the areas of interest. The smartphone will display AR layers of the 3D skin surface…"How AR and Computer Mapping are Leading to Safer Medical Procedures"
In this article, you will discover how Dr. Joshua Bederson and his team in Mount Sinai Hospital (NYC) use immersive technologies to prepare ans operate complex brain surgeries. The use of “Surgical Theater” software gives surgeons a 360° vision of the patient and is linked to a Occulus VR helmet to see “inside” the brain. It’s a way to limit the workload for the surgeon. The new technology includes a program called Surgical Theater, which…"How augmented reality gives one doctor surgical ‘superpowers’"
In this study about spine surgery at Johns Hopkins Hospital, the use of augmented reality system “xvision” allows a good increase of accuracy (from 94.6% to 96.7% of succeed). The main benefice is that surgeon can work without looking away from the patient. XVS essentially provides the surgeon with ‘X-ray vision’ &mash; enabling them to navigation through a patient’s skin and tissue. It’s intended for use in minimally-invasive or open spine surgeries, but has potential…"Augmedics’ augmented-reality surgical system shows promise"
Google present a great combination between Machine Learning and augmented reality to help pathologists to identify cancers. The presented device is “only” a lightly modified light microscope with real-time analyzing computer. The result is directly displayed in the pathologist field of view. Applications of deep learning to medical disciplines including ophthalmology, dermatology, radiology, and pathology have recently shown great promise to increase both the accuracy and availability of high-quality healthcare to patients around the world.…"An Augmented Reality Microscope for Cancer Detection"
What is crystal clear in this infographic is that healthcare is one of the most promising domain for the development of immersive technologies, and specially augmented reality. There are dozens of amazing applications for augmented reality right now, and the technology is really only starting to take off. Learn more about the latest augmented reality applications from this infographic. Source: Augmented Reality Is Changing Industries From Real Estate To Medicine [Infographic] | Technology Startups News…"Augmented Reality Is Changing Industries From Real Estate To Medicine [Infographic]"
With this very impressive installation, Pfizer R&D team explores the complexity of molecular actions in brain (and in 3D!) At Pfizer’s Research & Development hub in Cambridge, Mass., chemists, neuroscientists and other researchers use 3D VisBox technology to visualize and virtually explore the human body at the molecular level. Source: How Virtual Reality Takes Scientists Inside New Molecules (video) | Get Science"How Virtual Reality Takes Scientists Inside New Molecules"
Why to use VR and 360° videos in Pharma industries, especially for communication ? Because like in any other domains, it’s immersive and engaging ! In the realm of marketing, the draw of VR stems from its immersive quality. VR headsets provide 360-degree sights and surround sound, while more advanced versions incorporate touch and smells. The technology allows users to take a ride through the body’s blood stream, see a drug’s mechanism of action (MOA)…"Pharma wades into the world of virtual reality marketing"
At St. Mary’s Hospital a team from Imperial College London use a Hololens to see “inside” the body and to prepare surgical interventions. All of the patients first underwent CT scans, to obtain 3D images of the bones and blood vessels in the injured limb. When the HoloLens-wearing doctors were subsequently performing the surgery, those images were superimposed on their view of the leg – to them, it was as if they could actually see through…"Surgeons use HoloLens to peer into patients’ legs"
Today augmented reality could be use for many thing in healthcare : to educate professionals, to share with customers or to help them to visualize new concepts. As Arno Sosna (Veeva Systems) say in this article, it’s only the beginning ! “We see augmented reality as another content format,” Sosna said. “There’s an opportunity to go one step beyond current interactivity in some cases. One area where AR helps is creating empathy. When dealing with conditions around the eyes,…"Expect augmented reality to come up big for pharma marketers"
SimforHealth, a leading french company in immersive technologies, has developed a virtual reality simulator in multi-user mode. Communication and discussion between health professionals, in the same place or at a distance is now possible thanks to the multi-user version of virtual reality clinical cases designed bySimforHealth. It will be presented in HTC VIVE’s exhibition area (The Wynn, Alsace Ballroom – first floor), and will, furthermore, be the only player from the health care sector to…"Virtual reality simulator from SimforHealth"
What if medical students could project bear-sized holographic brains in their dorm rooms when studying for an anatomy exam? What if surgeons could use those holograms to prepare for complex surgeries or even support the operations themselves? HoloLens appears to be the platform for the medical application of mixed reality, so I was curious how […] Source: Mixed Reality in Healthcare – The HoloLens Review – The Medical Futurist"Mixed Reality in Healthcare by The Medical Futurist"
Virtual reality systems are perfect tools to help people in visualization of complex pictures, especially from high-performance microscopes (like light-sheet microscope). This new visualization ability has huge impacts on neural research. Dr. Gilles Reymond, Staff Engineer at the Wyss Center outlines the possibilities: “In the future, this could prove a very useful tool to gain a new 3D perspective on the complex mechanical and biological interactions between the human brain and new types of MRI…"New Virtual Reality Technology Allows Scientists to ‘Walk Through’ Brains"
BuildVR has made Solis solution to help elderly to travel with augmented reality. Five kinds of videos are available, linked to particular therapies. People in the experiment is not alone, but be accompanied by medical staff. Already implemented by many aged care facilities across the country, Solis is an easy-to-use virtual reality application created for the aged care industry. Utilising visual navigation, dual screen accessibility and delivering 5 video categories relevant to aged care residents, Solis…"Virtual reality for the elderly"
Sometimes, simplest uses are the best … Renderer is an extraordinary idea to bring “spaces” to people with a difficulty to move. Virtual Reality, and in this case 360° videos, is the best tool to do it. Rendever gives older adults a window to the parts of the world that they’re missing. Source: Virtual Reality for Seniors | Welcome to Rendever"Virtual Reality for Seniors with Rendever"
Floreo is a typical use of virtual reality to help autistic children to communicate. Floreo, a venture and NIH backed startup, leverages the power of virtual reality to provide safe, immersive, repeatable, and affordable social and communication therapy that is fun and engaging for the user, while allowing a supervising adult to monitor and track the user’s progress. We are currently piloting Floreo at a special education school for children on the autism spectrum,…"Floreo for social and communication therapy that is immersive and realistic"
Molecular biology produces huge amounts of data in the post-genomic era. This includes data describing metabolic mechanisms and pathways, structural genomic organization, patterns of regulatory regions; proteomics, transcriptomics, and metabolomics. On the one hand, analysis of this data uses essentially the methods and concepts of computer science; on the other hand, the range of biological tasks solved by researchers determines the range and scope of the data. Integrative Bioinformatics is a new area of research…"From Virtual Reality to Immersive Analytics in Bioinformatics Burlingame, California, 30 Jan 2018"
This operation has been done with Microsoft Hololense. The AR glasses facilitates access to data like X-rays, scanners and MRIs thanks to uses of 3D reconstructed models directly projected on the patient. It is also possible to prepare the operation with these technologies and, during the surgical intervention, the surgeon could be “assisted” by colleagues. In french : Replay : une opération chirurgicale en réalité augmentée Doctors at the Avicenne de Bobigny hospital (Ile-de-France) have…"France performs world’s first virtual reality surgery"
Apprentice uses for the moment 4 types of glasses : Microsoft HoloLens, Epson Moverio BT 200, Vuzix M100 and Vuzix M300. The software suite allows to record video, to see documents and to make a video call. It is very close to other solutions existing in industry. Apprentice has raised money to build out its biopharma-focused augmented reality business. The startup provides smart glasses applications that enable hands-free data capture, remote problem solving and other tasks at…"Augmented reality startup Apprentice bags $2.5M to build on uptick in biopharma interest"