In recent years, the COVID-19 epidemic has swept the world, forcing hospitals, nursing institutions and other medical and health practitioners to open up a new way to deal with the difficulties caused by physical inconvenience.
Telemedicine, a rising method of patient care and treatment, has gained widespread awareness and recognition from the public in the epidemic environment. Many medical centers have begun to explore the charm of remote assistance from the AR field, using AR hardware equipment (glasses) and software applications to carry out medical and health work, and provide patients with services more safely and efficiently without affecting the quality of treatment and nursing.
AR+medicine, create the future of medicine
| let medical care also "hands-free" |
0 | |
12 | Let high-quality medical training bloom everywhere |
| Help the medical industry to develop breakthroughly |
Let medical care also "hands-free"
What doctors care about most are patients, and AR smart glasses allow doctors to completely liberate their hands and focus on their work.
This means that doctors can save patient statistics on smart glasses at any time and make relevant annotations and instructions, and do not stop communicating or exams with the patient. This eliminates the need for a large number of screens and monitoring devices, and also ensures that patient sensitive data can be kept confidential.
can be controlled by voice commands and hands-free smart glasses that allow medical staff to access information on the virtual screen at any time when they need it, without using their hands to operate other devices, paper documents, etc. This freedom of information acquisition and recording is very friendly to sterile operating rooms and other application scenarios that have high environmental requirements.
makes experts everywhere
With AR smart glasses, it has never been easier to acquire medical expertise. Medical staff at the medical site can connect with experts to share her views on the patient’s condition, provide first-hand information, and find and perform the best treatment under the guidance of an expert. This "dispersed dissemination" of professional knowledge is actually an effective way to share knowledge and improve the quality of medical care.
Emergency surgery will not be delayed because it needs to be transferred to a specific location for execution. Finding an expert is as simple as starting an online meeting. Services from experts can be accepted anywhere, which greatly reduces the travel costs between doctors and patients, and greatly improves the efficiency and quality of medical care .
makes medical education simple and efficient
AR glasses 's video stream has the ability to see what the other party sees in real time through the built-in 4K autofocus camera. Smart glasses not only eliminate the need for extra technicians or bulky equipment connected to monitors in the operating room, but also reduce the risk of sterile conditions being damaged by interns entering the operating room.
At the same time, advanced video streaming capabilities allow learners to experience what is happening in real time and in high definition from the perspective of surgeons. In some cases, viewers can even control the camera, which provides a broader idea for future medical education.
Doctors transmit the on-site situation of the surgery through AR glasses
makes medical treatment more breakthrough
Using smart glasses for virtual collaboration not only has the well-known traditional benefits above, but also makes the development of the medical and health industry more breakthrough possible. Smart glasses can be used with certain software to achieve human mapping, so surgeons can see through the surgical sheet, skin and bones to better understand the patient's condition and how the surgery should be performed. AR glasses can display the next surgical steps, and the integrated sensors will also provide real-time help during the operation. The future of AR+ medical care, creativity and breakthrough coexist.
Hongke AR medical case
| ReSurgery uses AR technology to provide surgical assistance |
Hotel 13 | |
Hotel 13 | ReSurge uses AR technology to provide surgical assistance |
| Enhatch uses XR flow technology to improve the surgical level |
1
Telemedical at Chimei Hospital in Taiwan
Chimei is an innovator in Tainan region, introduced robotic surgery, and has the most advanced angiography and radiation therapy system. At the same time, Chimei is also a pioneer in Taiwan's first aid services. In recent years, in order to further improve its medical efficiency and quality, Chimei has adopted another high-tech tool: Hongke Vuzix AR smart glasses.
Emergency Room Application
Emergency Room is the busiest medical place. In the past, the process of first aid was the same after each patient arrived: assess the status quo, collect information, start treatment, share information, and in most cases, experts will take over the patient's final treatment and care.
During the entire first aid process, two key elements are information and time. Doctors need information to quickly and properly handle patient emergency situations. A few minutes of delay is fatal for stroke or heart disease. It is essential for the patient's life and death.
busy doctors and nurses in the emergency room of Qimei Hospital
This gives Hongke Vuzix AR smart glasses a place to work. The application of AR technology enables the possibility of real-time video communication from a first perspective among medical staff involved in treatment.
In traditional emergency situations, patients will receive simple treatment from medical staff during transfer to the hospital, while experts and emergency doctors can only wait for the arrival of patients in the hospital. However, with smart glasses, doctors can start treating patients before they arrive at the hospital. When both medical staff and emergency doctors wear smart glasses, emergency doctors can see the patient in real time from the first perspective of medical staff, understand the patient's real situation, and reach some treatment methods and methods with the medical staff escorting the patient, and remotely lead the treatment in order to gain valuable life-saving time.
In addition, Chime Medical Center also serves rural areas, with many patients coming from its affiliated hospitals in Kerry and Liuying. When wearing smart glasses, emergency doctors in each affiliated hospital can arrange multiple departments in different hospitals to conduct consultations at the same time, so that the patient can be seen wherever the experts are. Doctors in different hospitals can discuss the patient's condition in detail, thereby providing the patients with the most effective and appropriate treatment plan.
Smart glasses that are still suitable for wearing on protective equipment
Operating room application
Any surgical operation is completed through teamwork, including surgeons, nurses, and sometimes even requires the collaboration of technicians. Usually, if the surgeon wants to seek help from an expert, but the expert may not be on site. In the past, the doctor may have used mobile video to contact the expert, but the effect is not ideal due to uneven light, limited video angle, and inability to operate with both hands when contacting.
With the help of AR smart glasses, experts can participate in the operation in real time thousands of miles away. They can accurately see what the surgeon sees, understand the patient's condition, and communicate with the surgeon about the next surgical plan. After the operation is completed, surgeons, experts and the original attending doctors can continue to observe and communicate the patient's rehabilitation from different places to achieve full-process telemedicine.
Medical teaching application
Doctors guide junior physicians to perform clinical tasks
Knowledge sharing is crucial to the development of medicine. In Chimei Medical Center, Hongke smart glasses are also used to train junior physicians in addition to the above purposes.
When training surgeons, the best way is to teach through real-time video transmission, but recording and streaming surgical videos is expensive and time-consuming, and the video quality is usually poor. However, when everyone is wearing the Rainke AR smart glasses, interns and junior physicians can accurately and in real time see the surgeon’s operations, and can also ask questions to communicate with the surgeon. When a junior physician takes the surgery on his own, senior physicians can use the first viewing angle of smart glasses and excellent audio communication capabilities to provide detailed guidance in any place outside the operating room, such as symptom recognition, wound suture, catheter implantation, etc. In short, AR glasses and technology allow medical teaching to be carried out at any time and anywhere, and allows all parties involved to freely participate in each training session with all their hands and mind.
A doctor guides a junior physician to control ventricular assistive equipment
2
ReSurge uses AR technology to provide surgical assistance
Have you seen what I saw?
ReSurge International is a global surgical training nonprofit organization with a mission to carry out high-quality surgical and anesthesia programs in today's world's developing countries. They will also realize their "Surgical Sight program" through AR smart glasses, and use augmented reality (AR) technology to make the world's surgical community more closely connected. The "fusion reality" used by
glasses allows students to truly feel the guidance from the instructors thousands of miles away when wearing glasses, as shown in the figure below. In this way, ReSurge's instructors will see exactly what the surgeons (teachers) in the operating room see, giving them the opportunity to participate in the entire surgical process and provide real-time guidance and teaching.
Through this groundbreaking program, surgical tutors and trainees around the world can use the Hongke Vuzix AR smart glasses and AR software applications for real-time virtual training and operations. This training method supports trainees in learning basic life-saving skills and developing their self-reliance. After that, they can share the knowledge they have learned and train surgeons themselves, thus creating ripples of change and saving countless lives.
3
Enhatch uses XR streaming technology to improve surgical level
Augmented reality (AR) is rapidly becoming popular in the medical field. In addition to the application of AR smart glasses, the role of immersive streaming technology cannot be underestimated. It provides the capability and speed required to visualize 3D data for complex surgery on mobile AR devices —allowing surgeons to access patients’ critical information at any time while maintaining high attention to them. "We want to provide patients with better surgery, and we also hope to reduce stress by reducing surgeons' cognitive burden on devices or patient situations," said Peter Verrillo, co-founder and CEO of Enhatch, a medical technology company in the United States. Enhatch creates the industry’s first intelligent surgical ecosystem, connecting companies, technologies and surgeons to simplify clinical workflows and improve patient care.
Wear augmented reality headsets, and surgeons can use voice to view and record the patient's information data without leaving the surgical area or even taking their eyes off the patient. During the surgery, they can interact with non-invasive UI elements to access patient data records, 3D models, or other preoperative records. Peter Verrillo once said the challenge of doing this is to present these very complex data to doctors.
This shows the powerful function of remote rendering. Enhatch's software platform automatically converts preoperative images such as X-rays, CT scans, and MRIs into accurate 3D models. For a single operation, this usually means processing gigabytes of data, which greatly exceeds the performance capacity of many mobile AR devices. To make it work properly, it is necessary to reduce polygons and oversimplify the model. This means more processing is required, and even in the end, it may produce less accurate visual results, which is absolutely not possible for a surgery.
Enhatch allows doctors to easily access valuable data about patients by integrating the ISAR SDK of the Hongke XR streaming component into its solution. The Hongke ISAR SDK is a developer tool that enables remote rendering and live streaming of entire AR and VR applications from cloud or on-premises infrastructure to HoloLens 2, Meta Quest 2, tablets or smartphones. Therefore, the XR streaming solution allows visualization and manipulation of 3D content, which is much beyond the performance specifications of many mobile devices .
Peter Verrillo said: "The beauty of AR is to integrate the virtual world and the real world to achieve more successful clinical results. XR streaming technology allows surgeons to analyze complex 3D medical data without taking their attention away from the patient. Ultimately, using augmented reality in the operating room is the future of health care."
The development of modern medicine is closely related to the advancement of technology. It can be predicted that the application of AR technology in the medical and health field will surely go to the foreseeable level, and may help the medical field develop a revolutionary change. Let's wait and see.
About Hongke Digital+AR
Hongke is a high-tech company dedicated to providing customers with innovative one-stop software and hardware solutions and high-quality implementation services in various professional and technical fields.
Hongke engineer team has accumulated a lot of practical experience in a series of needs such as AR content development, localized platform deployment, and solution implementation. We have served no less than 30 implementation projects in China, including remote expert guidance for the after-sales department of the OEM equipment manufacturer's production line, digital workflow guidance for factories, and intelligent surgical methods for medical institution experts. It provides valuable technical experience accumulation for China to enter the metaverse and enter the digital expressway.
More professional training, live broadcast content, exciting cases and solutions for Hongke, please stay tuned~
Welcome to click on the homepage to learn more technical information, or visit our official website https://yinghuolu.com/ to present you more cases and information, and we will also have a dedicated person to answer your questions and answer your questions~
