Using GPU Rendering- Achieving Animation Production in Hours

王銓彰Media Lab, Next Media AnimationOctober 22, 2010

NVIDIA Confidential

Objectives

What We Do and WhyClassic Animation Production Pipeline ConceptNext Media Animation PipelineWhat We Have Learned and Will Do with GPU

NVIDIA Confidential

新聞動畫Animate the “Missing Image” inside the NewsOur Objectives

Within Two Hours Finishing One AnimationFrom Story Board to Broadcasting

At least 20 sets of News Animation per DayFamous People Must Look Like ThemselvesNo Quality Sacrificed

Mission ImpossibleRegular Animation Pipeline Not Working NowSome Technical Creativity Needed

NVIDIA Confidential

新聞動畫We Integrate the Game Development with the Computer AnimationUtilizing GPU Computing Power to Solve the Problems

Mission Completed !

NVIDIA Confidential

新聞動畫You Can See the 蘋果動新聞 at

http://tw.nextmedia.comhttp://hk.nextmedia.comYouTube

壹電視 Next TVhttp://www.nexttv.com.tw/

NVIDIA Confidential

Next Media Animation 壹傳媒動畫

From August, 1st, 2007250 Animation Production StaffProduction Capacity

30 Animations / Day, 30-second Animation Each100 min. Animation / Week

Major Customers蘋果日報、壹電視、路透社、 BBC 、 Turner

Medial LabR&D Team in Next Media Animation

NVIDIA Confidential

3D Animation Production Pipeline

VisualDevelopment

Sketches

Storyboarding

Pre-production

ShotProduction

Delivery

Modeling

Texture Paint

Pre-lighting

Rigging

Camera track

Match Movie

Animation Layout

Animation

Animation Cleanup

Tech Animation

Lighting

Effects

Rendering

Composite

NVIDIA Confidential

3D Animation Production Pipeline

VisualDevelopment

Sketches

Storyboarding

Pre-production

ShotProduction

Delivery

Modeling

Texture Paint

Pre-lighting

Rigging

Camera track

Match Movie

Animation Layout

Animation

Animation Cleanup

Tech Animation

Lighting

Effects

Rendering

Composite

For 30-sec Animation : ?? days ?? Days/hours ?? hours

NVIDIA Confidential

Our Solution

1st StepNo More CPU Rendering

No Rendering FarmGPU Rendering

ShadersNext Gen Game Production Spec.Keeping in “OK” QualityGraphics Workstation = Rendering Machine

Final Rendering Quality When Editing WYSWYG

NVIDIA Confidential

Next Gen. Game Rendering

NVIDIA Confidential

Our Solution

2nd StepBuilding Up a high Efficient Motion Capture Pipeline50 Vicon CamerasIn-house Motion Retargeting TechniqueWe Capture 300 Motion Clips Every Day.10 min. Data Processing Time for Each Motion Clip before Delivering to AnimatorsFacial Motion Capture for Facial Expression Synthesis

Facial Mocap Demo

NVIDIA Confidential

Our Solution

3rd StepIn-house Animation Software70% Animation Done by Our Own Tools95% Rendering Work Done by GPU

A 3dsMax Real-time Renderer PluginProcedural AnimationGame AI TechnologiesPhysics Simulation

Integrate PhysX with Our Game EngineReal-time Renderer + Post-processing

AT Demo

NVIDIA Confidential

Our Solution

4th StepGraphics Asset Database and Search Engine

3D ModelsCharactersTexturesMotion ClipsAnimation Templates

Recycling MechanismWorkflow Management System

NVIDIA Confidential

Our Pipeline

VisualDevelopment

Sketches

Storyboarding

Pre-production

ShotProduction

Delivery

Models/Charactersin

Database

Camera track

Game AI

Motion from MoCap

Physics Enigne

Lighting

Effects

(Game Engine)

Real-time 3D

Rendering

By Game Engine

Composite

For 30-sec Animation : 20 min. 30 min. 5 min + 0.5 hour

20 min.

NVIDIA Confidential

What We Have Learned

GPU Rendering Is the Most Important Successful Key for News AnimationGPU Is Not Only for Graphics

Real-time RenderingFacial Expression Synthesis in Real-time (20fps)Computer VisionPhysics SimulationComputational Geometry

GPU Provides Us Super-computing PowerR&D Is Very Important

NVIDIA Confidential

What We Will Do

NVIDIACUDA

NVIDIA Confidential

What We Will Do

Setup a Hybrid Programming EnvironmentGPU + Multi-Core

New ProjectsGPU-based Global Illumination RendererGPU Rendering FarmNew Hair and Fur SolutionNew Skin Deformation with Muscle and Fascia

NVIDIA Confidential

Thanks

Light Stage Light Stage XX @ Next Media Animation, Media Lab @ Next Media Animation, Media Lab