Check out a great demo of the changing reality of the Omniverse

Like a magic trick, at one point NVIDIA CEO Jensen Huang was behind a seemingly solid kitchen table. The next day, the kitchen and everything inside slid away, leaving Huang alone with the crowd and DGX A100 . Station From NVIDIA, a glimpse into an alternate digital reality.

For most people, the metaverse is something seen in scenes from a science fiction movie. For entrepreneurs, it’s an opportunity. For gamers, a dream. For a small group of NVIDIA artists, researchers, and engineers, in a very tight time frame in the second half of 2020, this was where they worked on a shared virtual world they used to tell their stories.

Designed for entertainment and information, the opening presentation of GTC From NVIDIA is full of cutting edge demos, highlighting supercomputing, deep learning, and advances in graphics.

“The GTC, above all else, is our opportunity to highlight the incredible work that our engineers and teams have done here at NVIDIA throughout the year,” said Rev Lebaredian, NVIDIA Vice President of Omniverse Engineering and Simulation Technology.

Through the short documentary “Communicating in the Metaverse: The Making of the GTC’s Main Idea,” viewers are getting something special: the story behind the story. story how NVIDIA Omniverse, a tool for linking and describing the metaverse, brought it all together.

Create a story in the world of the universe

It all starts with building a large sliding deck. Creating slides for a presentation worthy of a lecture always requires intense collaboration. But this collection was like no other, filled with not only words and images, but beautiful 3D models and rich textures. With Omniverse, the NVIDIA team was able to work together using different industry content creation tools, such as Autodesk Maya or Substance Painter, in different places.

“There are really great tools that people use every day in every industry that we want them to keep using,” says Leppardian. “We want people to use and grow these great tools with our technology.”

Slides are enhanced by a new generation of tools, including global scene description (in USD), Material Design Language (MDL) and building techniques. ray tracing in real time from NVIDIA RTX. Together, they allowed the NVIDIA team to collaborate to create realistic scenes using physically accurate materials and lighting.

Animation NVIDIA DGX Station A100

Omniverse can create more than just pretty pictures. The documentary showed how, combined with industry tools such as Autodesk Maya, Foundry Nuke, Adobe Photoshop, Adobe Premiere and Adobe After Effects, it is possible to set up and render some of the world’s most complex machines to create realistic cinematic animation. Using Omniverse, NVIDIA was able to turn a CAD model of the NVIDIA DGX A100 terminal into a physically accurate virtual version that Huang used to give the audience an inside look.

Typically, this type of project takes months for the team to create and weeks to deliver. But with Omniverse, the animation was mostly finished by one animator and ran in less than a day.

Omniverse Physics Montage

More than just machines, however, Omniverse can design the way the world works based on existing NVIDIA technologies. PhysXFor example, it has been a NVIDIA milestone in the gaming world for more than a decade. But its implementation in the Omniverse takes it to a new level.

For a presentation highlighting PhysX 5’s current capabilities on the Omniverse, as well as a preview of advanced physics simulation research in real time, the Omniverse research and engineering teams have recreated a set of legacy PhysX demos on the Omniverse.

Demo highlights key technologies PhysX Rigid Body, Soft Body Dynamics, Vehicle Dynamics, Fluid Dynamics, Explosion Destruction and Fracture, Fluid Fuels, Smoke and Fire with Flow. As a result, viewers have seen basic Omniverse technologies that can show more than just seemingly realistic, but real effects, and adhere to the laws of physics in real time.

DRIVE Sim is built in Omniverse

Simulating the world around us is fundamental to unlocking new technologies, and the Omniverse is critical to NVIDIA’s autonomous vehicle initiative. With Omniverse PhysX and its realistic worlds, Omniverse creates the perfect environment for training autonomous machines of all kinds.

In order to display the Omniverse DRIVE Sim, the team imported a map of the area around the Mercedes plant in Germany. Then, using the same software package that runs on NVIDIA’s fleet of autonomous cars, they demonstrated how the next generation of Mercedes cars would perform autonomous functions in the real world.

Using DRIVE Sim, the team was able to quickly test different lighting, weather, and traffic conditions and show the results to the world.

Creating the Factory of the Future with the BMW Group

The idea of ​​a “digital twin” has far-reaching consequences for nearly every industry. This year’s GTC featured a stunning display that exemplified what an idea could do when it was launched in the automotive industry.

demonstration BMW factory of the future The digital twin appears from the BMW assembly plant in Germany. Every detail, including design, lighting and machinery, is digitally reproduced with physical accuracy.

This “digital simulation” of the BMW plant provides a real-time simulation, precision and accuracy of the entire plant. BMW can reconfigure assembly lines to improve worker safety and efficiency, train factory robots to perform tasks and improve all aspects of factory operations.

Virtual Kitchen, Virtual CEO

The highlight of the GTC for this first semester was a perfect virtual replica of Jensen Huang’s kitchen, the complete collection of the last three kitchen offerings, with a digital reproduction of the CEO himself. This demo is the culmination of what GTC stands for, bringing together the work of the graphics and graphics research teams. deep learning From NVIDIA with multiple engineering teams and an amazing NVIDIA creative team.

To create a virtual Jensen, the team scanned their entire body and face to create a 3D model, then trained an AI model to mimic their gestures and expressions, and applied some AI magic to make their clones realistic.

The digital CEO was then brought into a replica of his kitchen that was disassembled to reveal the holodeck inside the Omniverse, surprising audiences and making them wonder how much of the talk was real or given.

“We initially built the Omniverse for ourselves here at NVIDIA,” says Leppardian. “We started the Omniverse with the idea of ​​linking the existing tools that make 3D together for what we now call the metaverse. More and more, we’ll be able to do the same thing, and accelerate what we’re doing together. If we do it right, we’ll be working on the Omniverse twenty years from now.”