VRAR planet
Today's news quick look
• Apple latest AR eye tracking patent announcement
• Sony expresses optimism for OLED and Micro LED display solutions
• PICO headset-based immersive medical XR solution launches
•Howei Technology releases smaller global shutter CMOS
•Based on Microsoft HoloLens 2's medical visualization solution launches
•Apple VR version AirPlay patent release, seamlessly expands the display
•Snapchat platform AR filters require a fee
•Meta Quest Store official best of the year: more than 40 works won awards
•VR game learning words, "Noun Town" is launched on Meta Quest
• Icelandic audio solution developer Treble successfully financing
01
Apple's latest AR eye tracking patent released
Previously, there have been rumors that Apple is actively developing some form of AR/VR headset or smart glasses. Judging from the patents released by Apple recently, this statement is indeed true.
USPTO recently announced an eye tracking interaction patent for smart glasses. It is understood that the patent proposes a lightweight AR glasses based on binocular waveguide architecture. The infrared LED used for eye tracking can be located at the temple position, which is somewhat similar to the side projection scheme of the LBS laser scheme, so as to ensure that the waveguide is "clean". According to the legend shown in the patent, there may be some problems with the design of this smart glasses , and the temple position may be deformed for some reasons.
For this problem, Apple has also proposed solutions, such as combining infrared LED with image distorted data. Similarly, if the user wears vision correction glasses, he or she needs to regain a benchmark.
02
Sony is optimistic about OLED and Micro LED display solutions
With the popularity of the concept of "metauniverse" in 2021, its main hardware carrier AR/VR equipment has become one of the important areas of technology innovation in in the past one or two years, and has been favored by technology companies such as Google , Meta, Apple, OPPO, Sony, Alibaba , Tencent , Xiaomi and other technology companies. In terms of hardware, display technology has always been the key point of discussion and analysis in the industry.
Recently, Sony predicted the future development path of AR/VR display solutions at the STEF 2022 technology exchange meeting. As can be seen in the path map released by Sony, it believes that AR glasses will initially adopt LCoS+ flat glass optical waveguide solution, and will use Micro LED to replace LCoS in the later stage, and then use curved plastic material optical waveguide to achieve a closer look to the glasses. In terms of VR display, Sony believes that it will adopt the LCD + Fresnel lens solution in the early stage, and then it will be changed to an OLED screen + Pancake lens (curved surface), and gradually iterate into an OLED + planar liquid crystal lens solution.
It is worth mentioning that during this meeting, Sony also expressed its vision for AR glasses.
03
Immersive medical XR solution based on PICO headset launched
Virtual reality (VR) technology was first born, or the first time you came into contact with this technology, it seems that it is all VR gaming experiences, such as VR roller coasters, VR movies, VR multiplayer games, etc. However, with the expansion of technology application, in recent years, more and more cases have shown that VR technology is no longer a simple entertainment assistance, but it has a wider application in industry, education, medical care and military.
It is understood that the European healthcare platform SyncVR Medical is based on the PICO VR headset, providing XR solutions to medical institutions in many countries, which can bring immersive VR medical services to patients. Its platform currently offers the following three products: Horizon IC that can provide customized ICU experience, where patients can recover their minds faster and reduce depression by re-experienced personalized ICU occupancy; SyncVR Dashboard, a mobile device management system specially developed for healthcare, allows users to access a range of XR applications in the XR app store; and the VR gaming store XR App Store, which helps patients and children distract patients.
VR not only distracts patients during treatment, but also helps them relax while waiting for treatment, thereby reducing anxiety and fear before treatment.
04
HOU Technology released a smaller global shutter CMOS
At present, SLAM positioning and gesture handle tracking in VR all-in-one machines are all-in-ones based on low-resolution monochrome CMOS. These products can already perform visual recognition and other uses well. However, we can go further.
Today, the old American giant, OMNIVISION, announced the launch of a new global shutter CMOS, the model is OG0VE, which is characterized by a 26% effect compared to the previous generation, and an energy efficiency increase of 50%. OV's OG0VE uses OmniPixel 3-GS technology, with only 3 microns of pixels, CMOS size 3.6mm×2.7mm, resolution is 640×480, and power consumption is less than 34mW (Howatts) in VGA/60FPS mode. In addition, this new CMOS adopts a global shutter architecture and has high sensitivity in low-light environments, thus meeting the SLAM, gesture and other needs of AR/VR.
In the future, OG0VE will be used in AR/VR/MR headsets, as well as drone , machine vision and barcode scanning fields.
05
Based on Microsoft HoloLens 2's medical visualization solution launch
With the development of technology, more and more medical institutions have begun to use 3D holographic technology as a tool for surgical planning. Recently, German medical technology company apoQlar announced that their medical visualization solution VSI HoloMedicine based on Microsoft HoloLens 2 has been licensed by the US FDA 510(k) Class II. It is understood that the United States is the 30th country to provide medical certification to apoQlar products, and apoQlar plans to distribute VSI HoloMedicine through its subsidiary in Miami, Florida in the second quarter of 2023.
VSI HoloMedicine based on Microsoft HoloLens 2 can leverage 3D holographic technology to provide surgeons with nearly "x-ray vision" perception capabilities. Doctors in any medical field can now plan surgery in 3D, both inside and outside the operating room and visualize medical data. This is beneficial to help improve patient surgical outcomes and provide surgeons with advanced surgical planning tools, etc.
Currently, the company is conducting a Series A financing. After the successful financing, perhaps the technical and national coverage of its products may continue to be broadened, and more patients will benefit.
06
Apple VR version AirPlay patent is released, seamlessly expanding the display screen
Apple's recent patents are indeed quite a few. According to the latest news released by the USPTO, Apple has another patent related to smart glasses CG scene submitted in Europe, and there are currently subsequent progress.
The abstract of this patent shows that this is a virtual screen expansion function based on AR/VR glasses. That is to say, it can use AR/VR as a virtual screen for Mac, MacBook, and Apple TV, and supports seamless expansion. From the patent perspective, this seems to be the AR/VR version of AirPlay mode. In the future, this function may become one of Apple's AR/VR's killer weapons. After all, Apple has a powerful inter-ecological interactive experience.
Regarding the functions of this patent, taking the illustration as an example, the extended display through virtual large screen is basically like this: in the figure, 202 is the user, 204 is a physical display, 460 and 461 are virtual extended displays, and the content 410 and 411 on the screen both support moving to the virtual screen.
07
Snapchat platform AR filters require payment
With the advancement of technology, the field of AR technology is also constantly developing. Snapchat AR virtual e-commerce is a good example. As a veteran player of AR applications, the AR filters on their platform have captured the hearts of most young people. The special effect of crying faces that Douyin, which was particularly popular a while ago, was a type of effect that was moved from Snapchat.
Recently, Snap announced a new feature at the annual AR developer conference Lens Fest 2022 that allows selected developers to sell advanced upgrades to their AR filters. Users can purchase additional content such as digital goods, AR effects and tools using Snapchat’s official in-app currency, Snapchat.As part of the initial pilot program, the company is currently testing the feature closed with a team of creators and developers.
For the newly added paid features, Snap said in its official update: "AR is the core of today's Snapchat experience, and over time we see that hardware has a greater opportunity to bring it into a new dimension. Our goal is to make AR more natural through glasses and let you interact with the AR around you with your hands. Advanced hardware and software, distribution channels, and how we support growth through the Snap AR platform have jointly driven the creativity and business of our global AR community."
08
Meta Quest Store's official best of the year: More than 40 works won the award
2022 is about to end. As a summary of the year, major selections and awards are being held one after another. Recently, Meta has also officially selected Quest Store's best works in 2022, with a total of 10 awards. Among them, in addition to "Best Game" and "Best Application", many works were shortlisted for the other 8 awards. The Last Clockwinder, the winner of the best game of
2022, is a puzzle game developed by Pontoco Studio in the United States. The graphics are fresh and beautiful, and the gameplay is simple and interesting. Although this game was developed by a small production team, it became a dark horse in the VR game industry in early June, and received many praises from players. Its praise rate in Steam was 98% (155 reviews), and the five-star rate of Quest was 87% (239 reviews).
and the winner of the best application "LES MILLS BODYCOMBAT", comes from Spanish developer Odders. It is understood that this app is a virtual extension of the Les Mills fitness brand with high energy martial arts heuristic workouts. Its virtual course will cater to everyone’s needs, offering 30 exercise options from beginner to advanced. The app will be equipped with two coaches and five fantastic workout environments including Mars, New Town, Rome , Japan and Tundra . Les Mills said more environments are under development.
09
VR game learning words, "Noun Town" is online Meta Quest
From childhood to adulthood, what tools have we used to learn foreign languages and memorize words? Pure written rote memorization, copy it three times and write it three times? Or is Baicizhan, scallop, New Oriental green book? Technology can really change life. Now, a more interesting word-memorization application has emerged. Maybe you can try to combine education and entertainment.
Recently, the VR language learning application "Noun Town" has been released for Quest 2 and Quest Pro, and the PCVR version will be launched on December 15. The app supports Japanese, French, Spanish , Italian , German and Chinese. Users learn the language of choice by interacting with items on the island and completing mini games. For example, browse a grocery store, pick a product, and the word of the item appears, and then the user can repeat the word to the application with the Quest microphone to verify.
Although "Noun Town" only designs some words and phrases, it is very good as an auxiliary application for accumulating vocabulary, which is interesting and practical.
10
Icelandic audio solution developer Treble successfully raised funds
For an immersive VR game, the background sound effect of the virtual environment is a very important factor in whether it has a good experience. If the sound cannot reflect the daily audio experience, players will feel unreal in the virtual scene and cannot immerse themselves in it. Many companies have special research on related technologies.
It is understood that recently, Icelandic meta-universe sound experience startup Treble announced that it has completed a seed round of financing of 5.5 million euros (about RMB 40.25 million). Founded in 2020, the company has now developed a sound simulation platform specifically for game development and other scenarios, thereby helping game developers create realistic sound simulation effects in virtual scenes. Or used to help architects understand the reflection effect of sound in the room in advance, etc.Now, Treble's sound simulation platform has connected 3D modeling software and game engine, allowing sound to be displayed graphically, allowing developers to better understand the sound effects.
At present, the Treble sound simulation platform is still in the internal testing stage and is expected to be released by the official version by 2023.
text/R Star Man
