Download - Next-Gen Content Creation for Next-Gen AI
![Page 1: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/1.jpg)
Next-Gen Content Creation for
Next-Gen AI
Damián Isla, Naimad Games
![Page 2: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/2.jpg)
AI Content Creation
What’s the best way to author AI content for games?
(And who does the authoring?)(And what is “AI Content” in the first
place?)
![Page 3: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/3.jpg)
“Photoshop of AI” Panel, GDC 09
![Page 4: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/4.jpg)
![Page 5: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/5.jpg)
![Page 6: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/6.jpg)
![Page 7: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/7.jpg)
The Starting Point
The central competency of Game AI is expressive power for the behavior
author,not “intelligence”
“Intelligence” is only useful insofar as It enables gameplay It supports the fiction It makes the game more fun
![Page 8: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/8.jpg)
The Problem
AI is HARD
Technically complex Highly interconnected Impossible to test Culturally awkward
![Page 9: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/9.jpg)
The Problem
Designer
Engineer
Fundamentally not in a position to fully specify all fun-relevant
behavior
Fundamentally not responsible
for fun
![Page 10: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/10.jpg)
2 Solutions
1. Need a new breed of engineering-competent designers or design-sensitive engineers (Michael Mateas)
2. Need better authoring paradigms, a “Photoshop of AI” (Chris Hecker)
![Page 11: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/11.jpg)
The Photoshop of AI
Why has game AI not settled on Common control structures Common authoring paradigms Common metrics Common APIs
Why are we so very, very far from WYSIWIG?
What does WYSIWIG even mean?
![Page 12: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/12.jpg)
Wisdom from Douglas Adams
AI is a 5-dimensional
problem
How do you Visualize Explore Specify
that entire space?
![Page 13: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/13.jpg)
AI Content Creation
How do we currently author AI content for games?
![Page 14: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/14.jpg)
AI Content Creation
AI is HARD
Technically complex Highly interconnected Impossible to test Culturally awkward
The path of least resistance:“do it in code”
The path of least resistance:“do it in code”
![Page 15: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/15.jpg)
AI Content Creation
Engineer Designer
Everything in code -
All procedure in code Exposed parameters
Framework in codeVisual construction /
managed coding
Harness Everything in script
![Page 16: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/16.jpg)
![Page 17: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/17.jpg)
Disclaimer(s)
This is my own highly-biased point of view.
Not going to talk about content creation for Strategic AI Living-world AI Procedural narrative Spatial Reasoning Etc.
(Also not going to define “AI”)
![Page 18: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/18.jpg)
The State of the Art
Reactive
![Page 19: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/19.jpg)
The State of the Art
when A happens, do Bx 10,000
![Page 20: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/20.jpg)
Managing Complexity in the Halo 2 AI (GDC 05)
melee
shoot
grenade
uncover
pursue
cover
sleep
fight
search
hide
idle
root
![Page 21: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/21.jpg)
BT Editor Prototype, Alex Champandard, AIGameDev.com
![Page 22: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/22.jpg)
misBeHavinG BT Editor, Michael Dawe, Big Huge Games
![Page 23: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/23.jpg)
Situation Editor, NBA 09: The Inside, Brian Schwab, SONY
![Page 24: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/24.jpg)
Zombie, Steve Mariotti, Nihilistic Software
![Page 25: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/25.jpg)
SPIROPS A.I.
![Page 26: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/26.jpg)
Final Fantasy 12 Gambit System, Square Enix
![Page 27: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/27.jpg)
The State of the Art
Planning
![Page 28: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/28.jpg)
F.E.A.R., Jeff Orkin, Monolith Productions
![Page 29: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/29.jpg)
F.E.A.R., Jeff Orkin, Monolith Productions
![Page 30: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/30.jpg)
Planning
Opportunity?
A tool that allows designers to Influence Visualize Debug
their plans
![Page 31: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/31.jpg)
The State of the Art
Affordance-based
![Page 32: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/32.jpg)
The Sims, EA/Maxis
![Page 33: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/33.jpg)
Halo 3: Building a Better Battle (GDC 08)
![Page 34: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/34.jpg)
Halo 3: Building a Better Battle (GDC 08)
![Page 35: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/35.jpg)
Environment markup in Assassin’s Creed, Ubisoft
![Page 36: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/36.jpg)
The State of the Art
Learning
![Page 37: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/37.jpg)
![Page 38: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/38.jpg)
AC Game Recording Viewer, Artificial Contender, TruSoft
![Page 39: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/39.jpg)
AC Knowledge Viewer, Artificial Contender, TruSoft
![Page 40: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/40.jpg)
The Restaurant Game, Jeff Orkin, MIT Media Lab http://theRestaurantGame.net
![Page 41: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/41.jpg)
Behavior Capture
Pros: leverage the data-mining revolution Potentially no custom interface at all?
Questions: Iteration time Tweakability Transparency
Are we learning the right things? Are we learning the deep structure?
![Page 42: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/42.jpg)
N-Grams
“They say all lovers swear more performance than they are wont to keep obliged faith unforfeited.”
- Shakespearean Quadrigram
Troilus and Cressida
Merchant ofVenice
Deep Structu
re Fail
Deep Structu
re Fail
![Page 43: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/43.jpg)
The State of the Art
The Periphery
![Page 44: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/44.jpg)
Kynapse UnrealEd Plugin, Autodesk
![Page 45: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/45.jpg)
Havok Behavior
![Page 46: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/46.jpg)
Endorphin, NaturalMotion
![Page 47: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/47.jpg)
![Page 48: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/48.jpg)
The Future
Middleware continues to eat away at the periphery of the intelligence problem Intelligent animation Pathfinding Gesture recognition Vision Natural language Behavior Capture
But what about the Photoshop of AI?
![Page 49: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/49.jpg)
The Photoshop of AI
Warning: Craziness ahead
![Page 50: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/50.jpg)
![Page 51: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/51.jpg)
? ?
![Page 52: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/52.jpg)
![Page 53: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/53.jpg)
![Page 54: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/54.jpg)
Façade, Mateas & Stern
MC Leon, Improv Technologies,
Siggraph ‘99
![Page 55: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/55.jpg)
Constantin Stanislavski(1863-1938)
"If you know your character's thoughts, the proper vocal and bodily expressions will naturally follow."
"All action on the stage must have an inner justification, be logical, coherent, and real."
![Page 56: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/56.jpg)
Method Acting
DesignerWhoa, whoa, whoa, stop. You should have run away screaming right there.
AIReally? What, because of the grenade?
![Page 57: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/57.jpg)
Method Acting
DesignerNo, no, because of the kitten.
AIHuh. So I’m afraid of kittens?
DesignerYes.
![Page 58: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/58.jpg)
Method Acting
AISo would you say I’m more afraid of kittens
or of water?
DesignerWell, I hadn’t thought of it, but … yeah, I
would say you’re more afraid of kittens.
AIAlright. Let’s go again!
![Page 59: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/59.jpg)
![Page 60: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/60.jpg)
Cooperative AI
Medical Expert Systems Mycin
CALO/IRIS
GPS Navigation
Clippy
![Page 61: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/61.jpg)
2 Solutions
1. Need a new breed of engineering-competent designers or design-sensitive engineers (Michael Mateas)
2. Need better authoring paradigms, a “Photoshop of AI” (Chris Hecker)
![Page 62: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/62.jpg)
2 Solutions
3. Both
Content creation for AI will continue to be extremely technical
It will be a form of coding It will be done by designers*
* where “designer” is defined as the person responsible for making the game fun.
![Page 63: Next-Gen Content Creation for Next-Gen AI](https://reader036.vdocuments.site/reader036/viewer/2022062423/5681438a550346895db00735/html5/thumbnails/63.jpg)
Thanks
Alex Champandard, AiGameDev.com
Petra Champandard-Pail, AiGameDev.com
Michael Dawe, Big Huge Games
Brett Laming, Rockstar Leeds
Steve Mariotti, Nihilistic Software
Jeff Orkin, MIT Media Lab / Monolith Productions
Brian Schwab, SCEA
Bungie Studios