In this article you will find a presentation of Holo4Labs tools and a description of potential uses of augmented reality in a science laboratory. This product is in fact a HMI (human-machine interface) to the software solution4labs. In HCS Pharma we have presented a very similar view of the future of laboratories at Forum Labo 2017 The laboratory of the future will be very different. Emerging technology is radically reshaping the way we tackle daily…"Mixed Reality Will Soon Be in the Service of Science Labs"
In this article of the New York Times, you can find a presentation of a study on lung cancer CT scans and how AI could help to detect specific nodules. With 6716 cases for the training set, the model shows more than 90% of success with “reductions of 11% in false positives and 5% in false negatives”. You note that Google team are deeply involved in this study. “The whole experimentation process is like a…"A.I. Took a Test to Detect Lung Cancer. It Got an A"
In this very interesting article, The Medical Futurist allows us ti better understand what is AI, which technologies are behind and, more important, what we can do now with it! AI technologies are close companions to visualisation technologies like VR ou AR. It’s very useful to study both of them to create most useful experiments. Navigating in the sea of information about artificial intelligence is tough. As everyone realized that the technologies leading to A.I.…"Understanding Machine Learning And Deep Learning In Medicine"
In this article a surgery team from Karolinska University Hospital explains the use of augmented reality in collaboration with Philips. Surgeons use real time images with digital overlay during operation to place spinal implants. This “navigation tool” allows a fantastic accuracy and a “3D position check” for implants directly in operation room. In spine surgery, one of the biggest challenges is to place implants in the vertebrae for the treatment of patients with spinal malformations,…"Augmented-reality navigation technology for precision surgery"
Cette application utilise des algorithmes d’analyse d’images pour déterminer instantanément le taux de stéatose d’un foie. Elle permet donc à un chirurgien d’estimer rapidement si l’organe est adapté à la transplantation. L’application est aujourd’hui utilisable sur un smartphone mais on peut facilement l’imaginer installée dans des lunettes de réalité augmentée utilisées par le chirurgien durant une intervention. L’idée de six associés comprenant chirurgiens, ingénieurs et commerciaux ? Faire appel au traitement d’image et à l’intelligence…"Stella Surgical, l’intelligence artificielle au service des greffes de foies"
Osso VR is a young Boston company which offer a VR solution to train orthopedic surgeons. In this article, Dr. Justin Barad, (CEO) explains how VR could also be use beyond initial training, to measure quantitatily skills for exemple. Training tests has been done and results are really impressive. Dr. Justin Barad hopes to extend perimeter of Osso VR simulations in the next few months to heart surgery. With Osso VR, those who are learning…"How Osso VR is Reshaping the Surgical Training Process"
This study was made on a sample of adult patients with painful wounds from deep or partial burns. Authors used an VR world called SnowWorld (developed at the University of Washington HITLab) to reduce pain perception. They showed that 39% less opioids were administered when IVR therapy used compared with wound procedures when IVR was not used. IVR during painful wound care procedures significantly reduced the amount of opioid medication administered during the procedure compared…"Randomized, Crossover Study of Immersive Virtual Reality to Decrease Opioid Use During Painful Wound Care Procedures in Adults"
The SUSAN Project is a learning experience using VR to help future nurse to develop their soft skills in a very particular situation : taking care of a patient with suicidal thoughts. The project is done in partnership with Somewhere Else VR company and a team of UCL MedTech Society. Working with Subject Matter Experts and Higher Education experts, SAGE identified a challenge in psychiatric nursing education : students needed a new way of practicing their…"A body-swapping VR experience for healthcare training for SAGE Publishing."
The first “cyberdelic incubator” is now open in Merbourne with the support of Australian Psychedelic Society. In this place, artists and scientists use VR to explore new states of consciousness. VR exposure therapy is even starting to be used to treat trauma, such as in the case of those who have experienced car accidents and who will be intentionally triggered – in a controlled environment – by a scene such as driving down a similar-looking…"Acid test: how psychedelic virtual reality can help end society’s mass bad trip"
Stayhealthy, a Californian company, has chosen to use AR to help children to better know their own body and health. With the application “Color Quest: an Art Adventure” they allow allow children to understand many things by gaming! The company has spent the last twenty years aggressively pursuing science-based research to define the best way to use advanced technologies to give people a better understanding of their own personal healthcare. With a new generation of…"Augmented Reality Positioned to Disrupt Children’s Health"
In this very interesting study about the use of AR as a way to encourage physical exercices, authors demonstrate that results are clear and mesured. AR helps the gamification of exercices and increase the implication of users. The immersion helps also to make exercices for a longer time. This study successfully showed that inexpensive easy-to-use AR systems can effectively contribute to exercise programs. Future game design recommendations, including feedback, mixed reality, and stress tracking, are…"Physiological Monitoring During Augmented Reality Exercise Confirms Advantages to Health and Well-Being"
With this application, researchers provide an easy way to train memory for people with Alzheimer’s disease. The tool could be also used to monitor patient illness evolution and to discover early element of spatial disorders for childs Researchers of the Polytechnic University of Valencia (UPV) and the University of Zaragoza have developed an augmented reality app to assess spatial memory. Among its uses, it could be utilised for people with Alzheimer’s disease, as a tool…"Researchers develop new augmented reality app to assess spatial memory"
Christopher Morley, co-founder of Medivis, wants that surgeons see directly in 3D during operation and don’t be distracted by converting 2D medical picture to the “real world”. To do that, Medivis is developing a complete set of software and the company is working with Microsoft Hololens. With this fund raising, they will spread the Medivis platforme to more testing teams. Using the HoloLens, the SurgicalAR software precisely maps medical imaging onto a surgeon’s view of…"Medical Software Maker Medivis Closes $2.3 Million in Funding to Bring HoloLens to Surgical Platform"
The World Health Organization just announce his plan to create a “Department of Digital Health” with the goal to help countries to understand the power of digital health, potential dangers and ways to implement it. It’s a new and strong signal of the importance of the digital in healthcare. You may also note that WHO develop a special action on data collecting. The Department of Digital Health will, according to WHO, harness “the power of…"WHO unveils plans to create a Department of Digital Health"
Presented at last Bio Asia 2019, the “Virtual Raasta” is a VR production house based in Hyderabad (India). Since the event, this company has produced healthcare dedicated content in VR, AR and 360° videos. This is a great example of the development of this market in India, maybe one of the biggest market in asia. It has created a virtual view of the complete human anatomy, which can be used for education purposes where students…"Hyderabad’s “Virtual Raasta” Showcases VR-Based Solutions For Healthcare Domain Services"
Just after the presentation of the new version of Hololens by Microsoft at MWC, Philips shown an use case in healthcare, precisely in surgery. Connected with Philipes Azurion platform, Hololens allows people to easily see 2D and 3D pictures from various instruments. This tool gives also a more natural way to interact with digital data, throught voice and gestures At the MWC (25–26 February, Barcelona, Spain), formerly the Mobile World Congress, Philips unveiled a unique mixed…"Augmented reality surgical technology unveiled by Philips and Microsoft"
In this article, authors explain the creation of a high quality 3D model of human cranial vault. They also show the benefice of this medication for surgery training, education, and research. The skull models that were presented have the potential to serve as a novel method of understanding cranial anatomy with an emphasis on accuracy, completeness, and visual appeal. It has utility in educational, illustrative, and surgical training purposes. The models provide critical insight into the…"Operative Anatomy of the Human Skull: A Virtual Reality Expedition"
In this article, you will find many examples where “in silico” methods and computing can change biology. In drug discovery, it’s really interesting to see that it allows us to make multiple virtual assays and only synthesize and test only promising compounds. It’s a new era of modeling and simulation, which is accelerating discovery for drugs, vaccines, medical devices, materials, and many other products. For years, simulations have been used for physical systems, to cheaply…"Virtual Medicine for Real Patients"
We see more and more pharmaceuticals industries developing digital “add-on” to classical drugs. In this article Otsuka America explain why it’s important to think “beyond medication” to help patient in everyday life. CT-152 is a software application that will use cognitive therapy principles to treat patients either independently or in conjunction with prescribed pharmacotherapies. It is aimed the product will fall under the Food and Drug Administration’s regulatory framework and be classed as Software as…"Digital therapy for depression to be developed through pharma collaboration"
In this short article, you can discover the use of VR for pain control at Cedars-Sinai Medical Center in Los Angeles. This experiment shows that VR help to reduce pain and anxiety for children, and reduce the need of opioids. It’s interesting to see that hardware for this action are relatively cheap. Cedars-Sinai Medical Center in New York, for instance, has recently run a pilot that equips patients with Samsung Gear Oculus VR headsets that feature…"VR Offers Patients a Virtual Distraction from Pain"
Riverside Regional Medical Center teams want to improve the cleaning of reusable endoscopes. To do this, they work with a AR application which explains step-by-step the process and, by the way, decrease mistakes or omissions Augmented reality apps contain software and sensors, and they can integrate digital visual content into a real-world environment. This content enables workers to follow step-by-step instructions displayed in 3D imagery along with safety warnings, 3D animations and written instructions also built…"Riverside Regional partners to create AR app for scope cleaning"
In this article authors present a new calibration method to increase the precision of the position for a Hololens. Using external system combined with embedded SLAM and a “hand‐eye” based approach, it could be possible to lowered uncertainty on Virtual/Real position close to 3 mm. Augmented reality (AR) allows the surgeon to represent holographic patient‐specific anatomical information and surgical instruments on the physical world. To correctly superimpose virtual and physical objects, a hand‐eye calibration method…"A Hand‐Eye Calibration Method for Augmented Reality Applied to Computer‐Assisted Orthopedic Surgery"
The “DigiPhobie” project, is developed by the Fraunhofer Institute for Biomedical Engineering IBMT. It aims to help people with Arachnophobia because many of them has no treatment. The project use AR glasses to view the fearing object but also an IA software to adapt in real time the fear feeling to emotional state of the patient. We transfer real exposure therapy to the digital game system that runs on the data glasses. All therapy tasks…"Treating the fear of spiders with augmented reality at MEDICA – World Forum for Medicine"
Are immersive technologies (and of course VR) THE right tools to share and to develop empathy? According to Erick Ramirez (assistant professor in philosophy at Santa Clara University) it is not so clear because it’s really difficult to put a frontier between empathy and sympathy. Results such as these have led Bailenson and others to hail VR as a modern-day empathy machine. VR researchers tell us that simulations can let us see what it’s like…"It’s dangerous to think virtual reality is an empathy machine"
In this article you will discover “Look Back”, a therapy program from the healthcare startup Virtue. Thanks to Virtual Reality, the program help elder people with dementia syndromes to remember their past. Their memories are a a excellent way to remember who they are and where they come from. Some works also show that reminiscent old memories help to improve cognitive functions. Rehman and Gorman are co-founders of the UK-based healthcare startup Virtue, which is focused…"How Virtual Reality Can Help Fight Dementia"
In this article, Martijn Roelandse introduces a “mixed-reality Hackathon” hosted by Springer Nature and dedicated to exploration of new uses of AR and VR in sciences. It’s very interesting to see that today, many 3D observations (made with confocal devices for example) are still seen on 2D screens! Immersive technologies could revolutionize it, maybe more fastly then we think. With the arrival of the fifth wave of computing, amazing techniques like artificial intelligence, blockchain and…"How Augmented Reality and Virtual Reality Can Revolutionize Science?"
A team for Purdue University recently presents a system to help health care workers “in the field”. With this teleoperation tool presented at the 2018 Military Health System Research Symposium, experienced surgeons could be virtually anywhere to give advice to local operator. “In this sense, people wearing our AR telementoring device would be able to receive extra information as they operate, in addition to maintaining all the visual and motor capabilities they would normally have,” Edward Rojas…"Augmented Reality Allows Specialists to Provide Care in Remote Locations"
In this article, a team from Hadassah Hebrew University Medical Centre (Jerusalem) presents a AR tool to increase the precision of guidance in interventional oncology. With “Endosight” (system name) the team reports a accuracy of less than 5 mm to guide needle thought patient. Even if many things have to be improved (like the compensation of breath) it seems really encouraging. Augmented reality can assist with needle guidance with great target accuracy for interventional procedures…"Augmented reality for interventional oncology: proof-of-concept study of a novel high-end guidance system platform"
“Nano Simbox” is a application to discover molecular and atomic scale of matter. It’s design to be immersive, fully interactive and collaborative. As Dr. David Glowacki said, this application show the motion of each particles and allow you to “feel” hidden electrical interactions, or more precisely to explore many different configurations of atoms with your hands. It’s very efficient for education but also for researchers to find new components. Having a sense of the invisible…"How virtual reality can change the way we see our molecular world"
In this TEDx video Nadine Hachach-Haram (CEO of Proximie) explains how surgeons can use immersive technologies to be “teleported” everywhere in the world to perform a surgical intervention. By using augmented reality, robotic, IA and high-speed network it will be possible to give patients access to the surgeon they need. Surgeon and entrepreneur Nadine Hachach-Haram is developing a new system that helps surgeons operate together and train one another on new techniques — from remote…"Nadine Hachach-Haram: How augmented reality could change the future of surgery"
In a poster presentation at the Computer Assisted Radiology and Surgery (CARS) 2018, Nicole Wake (doctoral candidate ) explains how augmented reality can help surgeons to better understand patient anatomy. In the particular case of prostate cancer, the preoperative planning is closely related to relationships between the tumor and nearby structures. The use of a Hololens AR helmet to “see it” is “considerably more useful ” according to surgeons who test the solution. Reesearchers from New York University School of…"Augmented reality optimizes prostate cancer surgery"
We have now many examples of how augmented reality can help patient to control or even forget stress before treatment. In this article the CHARIOT team of Packard Children’s Hospital Stanford uses AR and an animated 3D character to distract child and explains the purpose of the care. In one example, an AR experience developed by Miney Moe and the CHARIOT team, patients see a pair of animated 3D characters in their room as a…"This Children’s Hospital Uses HoloLens & Augmented Reality to Calm Young Patients During Medical Procedures"
The Britain’s National Health Service is testing the use of virtual reality to help people with dementia. With immersive movies, patients are encouraged to recall their own personal history throught pictures and emotions. Results are very encouraging as Arfa Rehman said (co-founder of Virtue, partner of BNHS) and this partnership may be spread to others areas in Britain. “If people remember more of their past, remember more of themselves, it just helps with overall mental wellbeing,” Arfa Rehman,…"Britain Trials Virtual Reality Time Travel to Combat Dementia"
In this article professor Olivier Oullier explains how augmented reality will change the world of healthcare, when solutions will be more easy to use ans less expensive. In healthcare as in any other sector, having to speak, press buttons or make movements in the air prevent smart glasses from reaching mass adoption. Silent and motionless communication between the brain and augmented reality devices and content thanks to mental commands is the key feature that will…"Augmented reality can save lives and we’re veering towards mass adoption"
What if there was a cost effective, scalable and structured solution to help understand those with acquired brain injuries? What if clinicians, occupational therapists and speech therapists could eliminate basic flash cards and guess work, and use augmented reality to help their patients communicate? In his presentation from the 2018 eHealth Queensland Expo in Brisbane, David Paré explains the possibilities of augmented reality to transform brain trauma care. Watch as David tells the story of…"Andrew’s Brain: An augmented reality solution to brain trauma communication"
Strokes are not always fatal but victims have to endure hard rehabilitation to recover forgotten abilities. Regan David Petrie, Victoria University masters of design and innovation student, created a AR game (NZ Fauna AR) to help patients for stroke rehabilitation. The classical game elements like rewards and progressive increasing of difficulty are completed by augmented reality to engage even more users. As mentioned in article, preliminary results of a little cohort of stroke victims are…"Augmented reality game helps stroke victims recover faster"
The new Gartner Hype Cycle (2018) is about to be published and this year biology takes a central position in it. To be precise, Gartner talks about to possibility of biology to change our life or even “redefining life” entirely ! And it’s not the future, it’s tomorrow ! The possibilities are amazing, of course, and we will probably extend vastly our lifetime. But a question remains : who will control it? anyone or everyone?…"It’s Official, The Transhuman Era Has Begun (for Gartner)"
Even if IA is not the Holy Graal of diagnostic in healthcare, it can help medical staff in many way. This article list 10 promising domains where IA will generate revenues in next 5 years. It’s interesting to see that administrative tasks take 51% of nurse’s time and (16%) of physician time. AI should drastically reduce it. AI should also be used as a 24/24 and 7/7 health assistant, responding to patients questions about their health and treatments. Another area…"10 Promising AI Applications in Health Care"
We are probably going to see more and more AR and VR parts in future medical devices and it’s interesting to see that a innovative country like Korea works on adapted guidelines. The main goal is to help companies to develop such a tools. The Ministry of Food and Drug Safety (MFDS) published a guideline Monday, which includes the definition and classification standards for approving products that apply virtual reality (VR) or augmented reality (AR)…"Seoul sets standards for VR and AR medical devices – Korea Biomedical Review"
As you may known, 3D cell environments are very relevant to test drugs as its mimic human body much more precisely than 2D experiments (It’s why we develop BIOMIMESYS® in HCS Pharma). But to understand drugs action and efficacy you also need 3D visualization tools. In this article, you will discover how a team from UNSW Medicine and Children’s Cancer Institute use immersive devices to explore data. They can literally “walk” inside tumors to see…"Virtual reality allows multiple scientists to ‘walk’ through cancer cells"
This new initiative from United Nations is very interesting because IA is a fundamental part of the uses of immersives technologies in healthcare. Indeed, extracting useful information from pictures to make a diagnostic means that you have to completely understand the process of extraction. Or when you use IA, links between algorithms and results are often obscur. The “ITU Focus Group on AI for Health” wants to establish standard framework to create and validate IA algorithms.…"ITU and WHO launch new initiative to leverage power of Artificial Intelligence for health"
Even if we have to be cautious with numbers and predictions, it’s clear that immersive technologies in healthcare are big markets opportunities. This report (and some others) shows that the opportunity is a short or middle term. Global Augmented Reality and Virtual Reality in Healthcare Market is expected to grow at a CAGR of +35% during the forecast period 2018-2023. The increase in acceptance of such advanced technologies that deliver new solutions for improved care…"Global Augmented Reality and Virtual Reality in Healthcare Market is expected to grow at +35% during2018-2022"
We know thah geolocalization games like Pokemon Go could help people in doing physical exercises but a new study from the from McMaster University shows that it could also be benefic for those with mental illness. When the game first came out, I noticed patients who had severe social anxiety disorder and a lot of depression starting to go out of their homes—and leave their computer screens and get off their couches—to play the game…"Could Pokemon GO, Augmented Reality Apps be Used for Mental Health Therapy?"
In this article you can discover a AR system use to assist surgeons in laparoscopic partial nephrectomy A projector-based augmented reality intracorporeal system (PARIS) is presented that includes a miniature tracked projector, tracked marker, and laparoscopic ultrasound (LUS) transducer. PARIS was developed to improve the efficacy and safety of laparoscopic partial nephrectomy (LPN). In particular, it has been demonstrated to effectively assist in the identification of tumor boundaries during surgery and to improve the surgeon’s…"Follow the light: projector-based augmented reality intracorporeal system for laparoscopic surgery"
A group from Johns Hopkins University uses augmented reality visualization to help implantation of surgical nails in patients with femoral fractures. Results from first experience show that accuracy is similar to conventional method but procedure time is reduced by nearly 10% and x-ray acquisitions are reduced by 90%. The group from Johns Hopkins University used x-ray images acquired with a C-arm to create virtual lines visible with an AR headset for guiding the implantation of…"Augmented reality guides orthopedic surgery"
In this article Tim Jennings (president of Custom Case Group) presents interesting cases where AR and VR are used to improve autonomy and self-monitoring for patients. AR apps, wearables and mobile devices have shown tremendous potential in patient self-monitoring, diagnosis and patient care. AR technology layers over the real world, providing digital visuals, sounds or other stimuli that give insights from gathered data or add enhanced detail to reality. From contact lenses that give visual cues to…"How augmented reality and virtual reality devices are boosting medicine"
A very simple way to use smartphone AR to help doctors in information visualization ! At the University of Twente in the Netherlands, a research team is developing an economical smartphone technology based on the Simultaneous Localization and Mapping (SLAM) technology, along with augmented reality (AR). The device allows doctors to reconstruct 3D body sections by directing the smartphone to the areas of interest. The smartphone will display AR layers of the 3D skin surface…"How AR and Computer Mapping are Leading to Safer Medical Procedures"
In this article, you will discover how Dr. Joshua Bederson and his team in Mount Sinai Hospital (NYC) use immersive technologies to prepare ans operate complex brain surgeries. The use of “Surgical Theater” software gives surgeons a 360° vision of the patient and is linked to a Occulus VR helmet to see “inside” the brain. It’s a way to limit the workload for the surgeon. The new technology includes a program called Surgical Theater, which…"How augmented reality gives one doctor surgical ‘superpowers’"
In this study about spine surgery at Johns Hopkins Hospital, the use of augmented reality system “xvision” allows a good increase of accuracy (from 94.6% to 96.7% of succeed). The main benefice is that surgeon can work without looking away from the patient. XVS essentially provides the surgeon with ‘X-ray vision’ &mash; enabling them to navigation through a patient’s skin and tissue. It’s intended for use in minimally-invasive or open spine surgeries, but has potential…"Augmedics’ augmented-reality surgical system shows promise"
Google present a great combination between Machine Learning and augmented reality to help pathologists to identify cancers. The presented device is “only” a lightly modified light microscope with real-time analyzing computer. The result is directly displayed in the pathologist field of view. Applications of deep learning to medical disciplines including ophthalmology, dermatology, radiology, and pathology have recently shown great promise to increase both the accuracy and availability of high-quality healthcare to patients around the world.…"An Augmented Reality Microscope for Cancer Detection"