How generative AI can create assets for the metaverse | Jensen Huang

The metaverse As people yearn for better ways to connect with each other than video calls, our collective awareness has increased in the heat of the pandemic. The game’s hot growth during the pandemic also pushed it forward. But the metaverse has become so fashionable that it’s now facing a backlash and people aren’t talking about it as much.

However, the technologies that will power the metaverse are advancing rapidly. One of those technologies generative AIuses deep learning neural networks to generate creative concept art and other ideas based on simple text prompts.

Jensen Huangso believes the CEO of artificial intelligence and graphics chip maker Nvidia generative AI there will be a transformation and it is just beginning. One of its biggest applications may be with the metaverse, which has huge demands on content as developers need to populate virtual worlds with 3D assets. Numerous companies such as Stable Diffusion, Promethean AI, and Ludo AI use these technologies to automatically generate artwork and other assets for gaming and metaverse applications. Nvidia has its own research going on this front.

Many metaverse companies hope that generative AI will help them provide the resources to help build their worlds. Huang believes that you’ll see progress as you include more and more instructions—like text to bring the concept to life—and the concept description gets better and better. He also believes that when it can be reused in various Omniverse applications, it will be clear that generative AI has reached a more mature stage.

I recently caught up with Huang for a short interview about the metaverse and the game. Ours GamesBeat Summit: Into the Metaverse 3 event is coming on February 1-2.

Here is an edited transcript of our interview.

GamesBeat: I wonder if there are some people who have lost their enthusiasm for the metaverse now? It was last year’s news. Maybe they think it’s an idea that will die in a recession. What would you say about that?

Jensen Huang: First, the concept of “metaverse”, which refers to the virtual environment in which we develop artificial intelligence software. I believe the Omniverse, the metaverse, is essential to this journey. You can’t develop software you can’t test. You can’t deploy software you can’t test. Be software-defined in a software-defined car or software-defined lawnmower or software-defined farm equipment or software-defined pick and place or software-defined warehouse We cannot move with a world that wants. into that new world without a virtual environment to simulate and test this software. That’s what Omniverse was built for in the first place. It seems to me that the next era of artificial intelligence will require the Omniverse, or so some say industrial metaverse.

When it comes to a commercial product—for example, marketing a home appliance—having a digital version of that product that you can actually place in your existing environment can be very helpful for shopping. I believe that in the long term, the idea of ​​looking at a 2D image for shopping, digital shopping and seeing a 3D object in its environment – I think it’s very clear that the metaverse will be used for commerce. Whether Metaverse will be used for video conferencing – I think it will – and other applications, it’s just a matter of time. The examples I mentioned will definitely happen.

GamesBeat: In this age of generative AI, how do you think this will help the metaverse happen?

Huang: Without generative artificial intelligence, how could consumers create a virtual world without much effort? Now you can create virtual worlds in 3D from around the corner. You can see this happening. Now we can create generative AI for images. We can do this for videos. At moving speed, you will do this for entire villages; 3D villages, landscapes, cities, etc. You will be able to collect an image sample and create an entire 3D world. This will activate the metaverse like you wouldn’t believe. You need it. Absolutely.

That’s why I always say that when we talk about the metaverse, when we talk about the Omniverse, AI and the Omniverse go hand in hand. It’s the same for me.

GamesBeat: A forecast from Newzoo has emerged, saying that gaming could decline as an industry for the first time in more than a decade. What do you think about it? Is this a concern or do you see it as something that will be fixed before the game continues to grow?

Huang: In fact, if you go back, you’ll notice that PC gaming has been slow compared to other platforms for quite some time. That’s because PC gaming is about more than what can be measured by bundled game sales or digital download sales.

It’s really hard to say anymore where the game starts and where the creativity starts. Many people are influencers, vloggers and avatars. The definition of gaming is wider on PC. If you look at one of the most important applications on PC right now, it is generative artificial intelligence. All these people who make animated pictures and game pictures. Gaming for PCs has always been an expanding category that is reinventing itself and redefining itself.