On April 12 this year, nvidia go run Inaugural Conference of GTC 2021 Details about the company’s projects, products and services. At various times during the broadcast, the company’s CEO, Jensen Huang, appears in the kitchen to talk about the company’s technologies.

But what no one knows yet is that in one of these sectors the CEO was an all-computer-generated character. in a published text On the company’s blog And in a documentary showing the concept of the idea, NVIDIA explained that the 14 seconds of Huang’s conference don’t show the actual CEO, but rather a “version” modeled on the company’s technologies.

The rest of the time, he’s the body in the speech – and it’s exactly this successful combination that makes the technology so impressive.

Create a CEO

According to the company, the technology involved scanning the CEO’s entire body and face, training an AI to mimic gestures or expressions, and capturing movements using any actor to create a CEO “model.”

Some of the modeling techniques used by NVIDIA.Source: nvidia

Within the few seconds that Huang was the digital edition, every element was introduced by NVIDIA engineers and designers, from the venue décor to the CEO’s signature leather jacket.

When is it “fake”?

In the original broadcast, the CEO survey only appears between 1:02:41 and 1:02:55. In the rest of the video, it’s about the real person in his kitchen. Check out the transition timings below.

This feat is a technical demonstration of what’s called Omniverse, a platform that combines several 3D modeling tools to collaboratively create animations. NVIDIA detailed the concept and creation of a virtual CEO in a long video posted on the company’s channel.