Editing Introduction: Since Facebook changed its name to Meta in October last year, the discussion on the topic of the metaverse has remained high. Recently, Meta has unveiled several new technologies about the metaverse. The author of this article analyzed this and let’s take a look.
Recently, new living water has poured in in the meta-universe world. At a laboratory seminar held by Meta, Meta CEO Xiao Zha announced several new technologies in his own metaverse.
Whether it is capital or technology, Meta is the first in building the meta-universe world. From changing Facebook to Meta in October last year to spending tens of billions of dollars to invest in it, a series of money-making acquisitions, Xiaozha's action-oriented work has penetrated into the deep sea of the meta-universe, and has recently achieved a series of results.
What inspiration will the technological breakthrough of Meta Laboratory in this metaverse bring to the industry? As a technological pioneer in the industry, Xiao Zha's evaluation of her new technology is "a key step in outlining the metaverse, and unlocking many advancements is AI." What is the impact of AI and the metaverse on the world of the metaverse? Do you have many questions in your mind? Without further ado, let’s start with the appearance of these new technologies.
1. AI is fascinating and
Before the new technology was released, the most popular news about Meta was the financial report in early February. Throughout 2021, Meta Reality Laboratory lost $10.19 billion, and its 2020 loss was $6.62 billion.
Real money and silver investment continues, with loud thunder and small raindrops. Many investors and practitioners have awakened from the craze of the metaverse, but the recent breakthrough in Meta's technological breakthrough in the metaverse seems to have given many people some confidence in Meta and also took a step forward in the digital world of the metaverse.
Meta announced new technologies including Builder Bot for speech-generating meta-universe scenes, super AI assistant CAIRaoke, etc.
1. Builder Bot for speech generation scenes. In the recorded video, we can see that Xiao Zha and a companion are added to the originally monotonous virtual background through a series of voice commands. With the end of the voice command, a relatively rich virtual scene is established. However, the current Builder Bot is just a simple demo display. The generation of more complex 3D environments requires time and deeper research.
2. Super AI assistant CAIRaoke. The underlying layer is a self-supervised end-to-end neural network model that can understand and learn user voice and body language, allowing us to have a smoother and more natural conversation with voice assistants in the virtual digital world. In the video demonstration, the AI assistant can communicate with people while paying attention to the amount of salt during the cooking process and promptly remind users to replenish the amount of salt. At present, this technology has been applied in its video call potal devices and will be integrated into AR/VR products in the future to increase interaction with digital assistants.
3. General machine translation tool. This is a technology that Meta is developing - a universal voice translator designed to provide instant voice-to-voice translation in all languages, and the variety of languages covers all written languages. This universal AI machine translation tool can open up the barrier between us and information and people, and language will no longer be a barrier to restricting us from obtaining information.
In addition to this, Meta has also released some other AI tools, the latest AI technologies announced by Meta and the supercomputers previously announced, etc., the future mature transformation will have an imaginative impact on the metaverse.
The metaverse is the next technical form entrance, and the coupling with AI technology allows us to clearly feel the richness of the ecological content of the metaverse world. Intelligent companionship, intelligent interaction, and the generation and construction of scene content in the digital world are all telling the intelligent transformation of the infrastructure facilities of various AI tools in the metaverse world. It not only takes over a large amount of infrastructure and guidance, but also reduces the burden on practitioners, but also provides communication between humans and machines and users' experiences within the ecosystem, providing value different from the real society of human beings.
We see that the capabilities granted by AI accelerate the mode operation of the metaverse world. In other words, the construction of the metaverse world will also go deeper into the "oasis" among the movie's number one player.
2. Intelligent "people" and "environment"
For the meta-universe world, the most essential core is interaction, and making the interaction feel immersive, requires an immersive experience of the meta-universe. As a virtual parallel world, the metaverse needs to contain all the elements that the real world has. If you want to discuss what Meta's new technology has brought to the metaverse, you need to go back to the basic elements of the metaverse to find the answer.
The industry's consensus on the basic elements of the metaverse is basically based on the eight elements of the metaverse given by Roblox, including: identity, sociality, immersion, low latency, diversification, anytime, economic system, and civilization.
The author believes that the changes brought by Meta's technological breakthroughs to the metaverse can be attributed to the richness of interaction and immersion experience.
is first of all an immersive experience, the Builder Bot of voice-generating scenes, ultimately making the metaverse develop in a more intelligent way to immerse. Using voice to produce scenarios, this exploratory approach shows the potential of AI to create complex 3D environments and new worlds in the metaverse.
On the road to building a diverse immersive social meta-universe, if the participants' production capacity is exhausted to construct scene content, the production capacity of content is still limited. If converted into automated construction of AI technology, some repetitive materials and script design, etc., simple and time-consuming work can be completed by AI tools, and the most core product content in the metaverse world can be spent on polishing. In terms of interaction,
contains social, low latency and diversified factor needs. The future form of super AI assistant CAIRaoke and general machine translation tools can make the interaction between people and digital people in the metaverse more smooth. The "people" in the metaverse are the basic constituent units, which include both explorers entering the metaverse and virtual digital people in the metaverse. Super AI assistant CAIRaoke can understand and learn the voice of users, allowing us to interact naturally with various digital people in the ecosystem. At the same time, general machine translation tools can instantly translate languages of different ethnic groups, allowing users of various backgrounds entering the metaverse to communicate without barriers. The future of
super AI assistant CAIRaoke and general machine translation tools can eliminate the language barriers to interaction in the metaverse and make the interaction in the digital world simpler and more unified. The research and development direction and future forms of AI technologies such as
Builder Bot, CAIRaoke, general machine translation tools, etc., will intelligently upgrade the basic components of humans and environment in the metaverse, which will also make the metaverse closer and closer to the ideal state and attract more people to enter the metaverse socialization. Of course, the learning and advancement of virtual AI and real AI technology will feed against each other, and for the real world, it also promotes the advancement of creative artificial intelligence technology.
The ecological content of the meta-universe will become more three-dimensional. We know that content is the key to attracting people, but people’s feelings in the digital world are the basis for adhesion and longevity. This feeling requires digital technology to amplify our senses in the virtual world, and the real qualitative upgrade of immersion.
3. Capture the real world: step-by-step advancement of digital "synchronicity"
Talking about our senses in the digital world, introducing the concept of synesthesia may be easier to understand. The original meaning of synesthesia refers to communicating and transforming different senses such as vision, smell, touch, hearing, etc. to make people feel more three-dimensional and rich. So, in the world of the metaverse, digital "synchronicity" is to use AI and machines to make the body more vividly experience and explore the virtual world, express and convey the temperature of emotions.
In the synesthesia of digital language, language is the basis of interaction, hearing is the basis of language interaction, and digital vision (VR) and touch (sensing devices) give our body a real texture and touch in the virtual world. The advancement of auditory devices and technology, and the coupling with digital vision (VR) and sensor devices, drives the realism of the meta-universe world to deepen step by step.
auditory AI technology mainly focuses on intelligent voice recognition and intelligent voice synthesis. In the previous narrative, we learned that in the virtual world, combined with AI assistants integrated with voice technology, whether it is instructions or normal voice interaction, the introduction of AI voice technology will allow users to experience the company and belonging between machines and people. The temperature of the virtual world is also more natural because of the personification of voice technology. At the same time, the continuous learning of machines in the communication process will also make digital people in the virtual world more understand the characteristics of users. It is only a matter of time before AI assistants grow into virtual close friends.
"synchronicity" in meta-universe digital vision relies on AR/VR technology. Its combination with AI is also an important part of the future development of AR/VR. Take Oculus, a subsidiary of Meta, for example. Oculus is the first choice for many people to choose a headset. In the virtual space of Horizon Home, Oculus can be used to social gatherings. The gesture recognition, the tracking of desktop, keyboard, sofa and other items are inseparable from the blessing of AI technology. The digital synesthesia of vision allows AR and VR to upgrade from the entrance to the virtual world and then to the intelligent upgrade of AI interactive experience, from real to virtual, from virtual to intelligence.
digital tactile synesthesia comes from some sensor devices equipped with AI technology. For example, Meta released wearable gloves and smart wrist devices, which can track hand gestures and wrist dynamically and sense the environment. By analyzing the EMG signal of the wrist, the system can understand tiny finger movements, which can then be converted into digital commands and sent to the device to realize digital interaction and control. Tactile gloves simulate real touch through pneumatic devices and tactile rendering systems. The tactile rendering system needs to build corresponding software and algorithms to model, and analyze the weight, texture, hardness of the virtual environment items based on the position of the hand, and then send the correct instructions to the pneumatic device of the glove to present the touch of the real physical world.
The vision, hearing and touch of numbers have been bolstered by AI technology. With the help of us, we break the dimensional wall of the virtual world. The clones of virtual people in the metaverse can feel the "real sense" of the material in the virtual world in the digital space, collide with information, and grow in the virtual world.
The improvement of the meta-universe infrastructure is a long process, relying on the continuous progress of general intelligent technology. On the road to building the meta-universe, the application of AI is the key to making the meta-universe more immersive and diversified. This is also an effective way to attract countless users to enter the Metaverse platform.
In the traditional Internet, our experience ultimately comes from the transmission and interaction of information as an identity of a bystander. In the metaverse, using AI can not only create a wide and rich environment and content for the metaverse, but the digital synesthesia supported by AI allows users to open and amplify the senses in the virtual space, and be in it as participants as participants. We can lose all the limitations of the body to interact, explore and share.
The integration of digital synesthesia and the metaverse, AI is a bridge of connectivity and is indispensable, building a new future of human-machine symbiosis and integration for hundreds of millions of users.
#cooperative media#
子子子子子子子, WeChat public account:子子子子. Write artificial intelligence, streaming media, overseas technology that will make you understand and understand
This article was originally published by everyone as a product manager. Reproduction of
is prohibited without permission from
. The title image is from Unsplash, based on CC0 protocol
