promoting mmo player interaction through …...“reducing the world to mathematical equations!”...
TRANSCRIPT
![Page 1: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/1.jpg)
“Reducing the world to mathematical equations!”
Cover Me!Promoting MMO Player Interaction
Through Advanced AI
Dave MarkPresident & Lead Designer
Intrinsic Algorithm LLC
![Page 2: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/2.jpg)
“Reducing the world to mathematical equations!”
Dave Mark• President & Lead Designer of
Intrinsic Algorithm LLC• Game Studio• AI Consulting Company
• Author of Behavioral Mathematics for Game AI
• Co-founder ofAI Game Programmers Guild
• Organizer and co-host of theAI Summit at GDC 2009
![Page 3: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/3.jpg)
“Reducing the world to mathematical equations!”
Premises/Disclaimers• WoW is a good game.• Not everyone wants to be like WoW.• Bad AI has its place in games.• Not everyone wants to have bad AI.• You are here because you are working on
an MMO.• You are here because you want to know:
– How good AI can make your game better– How to use AI in an MMO environment
![Page 4: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/4.jpg)
“Reducing the world to mathematical equations!”
What makes a game a game?
“A game isa series of interesting choices.”
- Sid Meier
![Page 5: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/5.jpg)
“Reducing the world to mathematical equations!”
In the beginning…• Early games were entirely
played against the computer.• AI sucked• Choices were rudimentary• Problem-solving was simplistic.
![Page 6: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/6.jpg)
“Reducing the world to mathematical equations!”
1-Player Games w/Multi-player Component
• People played against each other more than computer
• Game won’t sell without multi-player
• 1-player campaign often neglected
• “I love Halo 3… but I’ve never played the campaign.”
![Page 7: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/7.jpg)
“Reducing the world to mathematical equations!”
Multiplayer Co-Op• People prefer playing with other people
– Interactivity– Teamwork (AI allies still not up to par)– Solving problems together
![Page 8: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/8.jpg)
“Reducing the world to mathematical equations!”
The Draw of PvP• People prefer playing against other people
– Difficulty of opponents– Adaptability of opponents– Dynamicity (e.g. the unexpected)– Solving problems together Repla
yabilit
y!
![Page 9: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/9.jpg)
“Reducing the world to mathematical equations!”
The Necessity of PvE• Beyond Game Mechanics
– Environments – Weapons– Characters
• World Immersion– Who is going to role-play
the dragon?– The harmless little bunny? – The slime creature?
![Page 10: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/10.jpg)
“Reducing the world to mathematical equations!”
AI is Your World!
Boring AI = Boring WorldDeep AI = Immersive World
Repetitive AI = Monotonous WorldDynamic AI = Dynamic World
![Page 11: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/11.jpg)
“Reducing the world to mathematical equations!”
PvP vs. PvE
PvP• Difficult• Adaptable• Dynamic• Necessitates ongoing
problem-solving
PvE• Simple• Rigid• Predictable• “Solve Once” and repeat
PvE• Difficult• Adaptable• Dynamic• Necessitates ongoing
problem-solving
So how do we do it?
![Page 12: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/12.jpg)
“Reducing the world to mathematical equations!”
Making PvE feel like PvP
• Single-player games have been improving their AI to generate a PvP-like feel
• What techniques can we import from single-player games into MMOs?– What effect does that have on the player’s individual
experience?– What effect does that have on the players working
together?
![Page 13: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/13.jpg)
“Reducing the world to mathematical equations!”
AI Techniques
By Genre• Shooter• RPG• Strategy
By Concept• Behavioral• Tactical• Strategic• Simulation• Economic
![Page 14: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/14.jpg)
“Reducing the world to mathematical equations!”
AI Techniques
By Genre• Shooter• RPG• Strategy
By Concept• Behavioral• Tactical• Strategic• Simulation• EconomicMultiple vs. Multiple
![Page 15: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/15.jpg)
“Reducing the world to mathematical equations!”
Behavioral AI
• How does the NPC make decisions?– Idle behaviors– When to attack – Who to attack– How to attack
![Page 16: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/16.jpg)
“Reducing the world to mathematical equations!”
When to Attack
• Generating “Aggro”– Distance– Environment Threshold Triggers– Line of Sight
• Well documented by the public– Attack happens when the player(s) want it to– Removes sense of enemy’s autonomy
![Page 17: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/17.jpg)
“Reducing the world to mathematical equations!”
Who to Attack
• Nearest opponent• Strongest opponent• Well documented by the public
– Attack is against whom the player(s) expect– Attack is against whom the player(s) want– Removes sense of enemy’s autonomy
![Page 18: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/18.jpg)
“Reducing the world to mathematical equations!”
How to Attack
• Primary attack most of the time• After delay of x, use secondary attack• In given situation, use special attack• Well documented by the public
– Attack happens how the player(s) expect it to– Removes sense of enemy’s dynamicity
![Page 19: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/19.jpg)
“Reducing the world to mathematical equations!”
Effect on the Players• On the Individual Player
– Calculatable– Predictable– Boring
• On the Group– No need for interaction– “Read the script…”– “Play your part…”
![Page 20: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/20.jpg)
“Reducing the world to mathematical equations!”
What is your reaction?
• Want to pet• Want to meet• Just curious• Annoyed• Want to kick• Want to run screaming
Want to pet
Just curious Annoyed
Want to kick
Want to run screaming
Want to meet
![Page 21: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/21.jpg)
“Reducing the world to mathematical equations!”
• Want to pet• Want to meet• Just curious• Annoyed• Want to kick• Want to run screaming
Now what is your reaction?
Want to pet
Want to meet
Just curious
Annoyed Want to kick
Want to run screaming
![Page 22: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/22.jpg)
“Reducing the world to mathematical equations!”
Varieties of Reactions
Want to pet
Just curious Annoyed
Want to kick
Want to run screaming
Want to meet
Want to pet
Want to meet
Just curious
Annoyed Want to kick
Want to run screaming
![Page 23: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/23.jpg)
“Reducing the world to mathematical equations!”
Same Model for All Agents
Want to meet
Want to run screaming
Want to kick
Annoyed
Just curious
Want to pet Want to run screaming
Want to kick
Annoyed
Just curious
Want to meet
Want to pet
Extreme Reactions
![Page 24: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/24.jpg)
“Reducing the world to mathematical equations!”
Varieties of Reactions
Want to pet
Just curious Annoyed
Want to kick
Want to run screaming
Want to meet
• Differences Exist• Don’t need to know why• Need to simulate that difference
do exist– Not completely random selection– Must be reasonable– Can be simulated with weighted
randoms
![Page 25: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/25.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
• Design Decision: “Enemies don’t always fight to the death”
• Enemies can sometimes retreat– Flat % chance
• Is random… therefore looks random• Not realistic
– Situational random• Based on circumstances• Circumstances are flexible and dynamic
![Page 26: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/26.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
![Page 27: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/27.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…How many on my side are still fighting?
8
How many of my enemies are still fighting?
5
1.6
![Page 28: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/28.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
PercentChance = (4 – Ratio)3 / (43)Percent Chance that an Individual will Retreat
0%
25%
50%
75%
100%
0 0.5 1 1.5 2 2.5 3 3.5 4
![Page 29: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/29.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
PercentChance = (4 – Ratio)4 / (44)
PercentChance = (4 – 1.6)4 / (44)
PercentChance = 13%
![Page 30: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/30.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
![Page 31: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/31.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…How many on my side are still fighting?
7
How many of my enemies are still fighting?
5
1.4
![Page 32: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/32.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
PercentChance = (4 – Ratio)4 / (44)
PercentChance = (4 – 1.4)4 / (44)
PercentChance = 18%
![Page 33: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/33.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
PercentChance = (4 × Ratio)4 / (44)Percent Chance that an Individual will Retreat
0%
25%
50%
75%
100%
0 0.5 1 1.5 2 2.5 3 3.5 4
![Page 34: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/34.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
![Page 35: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/35.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…PercentChance =
( ( MaxRatio – Ratio )k × MaxPct ) / (MaxRatio k )
80.50In Base60.75Near Base41.00In FieldkMaxPct
![Page 36: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/36.jpg)
“Reducing the world to mathematical equations!”
Percent Chance that an Individual will Retreat
0%
25%
50%
75%
100%
0 0.5 1 1.5 2 2.5 3 3.5 4
Know when to walk away…
( ( 4 – Ratio )4 × 1.00 ) / ( 44 )( ( 4 – Ratio )4 × 1.00 ) / ( 44 )
( ( 4 – Ratio )6 × 0.75 ) / ( 46 )( ( 4 – Ratio )6 × 0.75 ) / ( 46 )
( ( 4 – Ratio )8 × 0.50 ) / ( 48 )( ( 4 – Ratio )8 × 0.50 ) / ( 48 )
![Page 37: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/37.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…
• Factors to Consider– Number of allies– Number of enemies– Proximity to Base– Strength of allies – Strength of enemies– My own health– Proximity of my leader
![Page 38: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/38.jpg)
“Reducing the world to mathematical equations!”
Know when to walk away…Numberof Allies
Numberof Enemies
Threat Ratio
My HealthProximityto Leader
Strengthof Allies
Strengthof Enemies
Allied Strength Enemy Strength
My Morale
Retreat %
Proximityto Base
Urgency
“Compartmentalized Confidence”
![Page 39: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/39.jpg)
“Reducing the world to mathematical equations!”
How does this look to the players?
• Enemies aren’t completely fearless• They are slightly unpredictable• They are still reasonable• Curiosity: “Where is he going?”• “If we show force, they might break and run.”• “If we back them up, they are more aggressive.”• We have to react to their reactions.
![Page 40: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/40.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”
• Fight normally• Flee• Charge
![Page 41: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/41.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”Percent Chance that an Individual will Retreat or Charge
0%
25%
50%
75%
100%
0 0.5 1 1.5 2 2.5 3 3.5 4
![Page 42: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/42.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”• Fight
– Melee weapon– Ranged weapon– Special rare weapon
• Advance– Press forward– Berserker charge
• Retreat– Fighting withdrawal– Find Cover– Organized pull back– Flee in abject terror– Surrender
![Page 43: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/43.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”Special Press Forward
Berserk Charge
Withdrawal
Cover
Pull Back
Flee
Surrender
Melee
Ranged
![Page 44: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/44.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”SpecialPress ForwardBerserk Charge
Withdrawal
Cover
Pull Back
FleeSurrender
Melee
Ranged
![Page 45: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/45.jpg)
“Reducing the world to mathematical equations!”
More than “Fight or Flight”
Special Press Forward
Berserk Charge
Withdrawal
Cover
Pull Back
Flee
Surrender
Melee
Ranged
“Normal” “Defensive”
SpecialPress ForwardBerserk Charge
Withdrawal
Cover
Pull Back
FleeSurrender
Melee
Ranged
21%42%
![Page 46: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/46.jpg)
“Reducing the world to mathematical equations!”
How does this look to the players?
• Not predictable• Reasonable• Causes us to have to
react to his reaction Want to pet
Just curious Annoyed
Want to kick
Want to run screaming
Want to meet
![Page 47: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/47.jpg)
“Reducing the world to mathematical equations!”
Target Selection• Who should I attack?
– Closest enemy– Biggest threat (highest DPS)– Weakest link (least health)– Most valuable (healer helping the other enemies)
![Page 48: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/48.jpg)
“Reducing the world to mathematical equations!”
Shoot that @$&%#!!
![Page 49: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/49.jpg)
“Reducing the world to mathematical equations!”
Shoot that @$&%#!!
![Page 50: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/50.jpg)
“Reducing the world to mathematical equations!”
Shoot that @$&%#!!
![Page 51: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/51.jpg)
“Reducing the world to mathematical equations!”
Shoot that @$&%#!!
![Page 52: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/52.jpg)
“Reducing the world to mathematical equations!”
Tactics
• Multiple NPCs working in a coordinated plan– Formations
• Protecting high-value units (fighters protecting a mage)• Adequate defense coverage of a point
– Coordinated movement• Flanking• Covering fire• Leapfrogging advance
![Page 53: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/53.jpg)
“Reducing the world to mathematical equations!”
Tactical Manager
Agent Agent Agent Agent
TacticalManager
![Page 54: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/54.jpg)
“Reducing the world to mathematical equations!”
Tactical Manager• Has Rudimentary Goals
– “Protect X”– “Attack Y”
• Situation Analysis• Reactive
– Responds to players’ actions– Responds to situation changes
• Proactive– Looks for opportunities– “Running a play”
![Page 55: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/55.jpg)
“Reducing the world to mathematical equations!”
Protecting High-Value Units/PointsTacticalManagerTacticalManager
![Page 56: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/56.jpg)
“Reducing the world to mathematical equations!”
Protecting High-Value Units/PointsTacticalManagerTacticalManager
![Page 57: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/57.jpg)
“Reducing the world to mathematical equations!”
Protecting High-Value Units/PointsTacticalManagerTacticalManager
![Page 58: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/58.jpg)
“Reducing the world to mathematical equations!”
Protecting High-Value Units/Points
![Page 59: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/59.jpg)
“Reducing the world to mathematical equations!”
Protecting High-Value Units/Points
Flanking!!!
![Page 60: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/60.jpg)
“Reducing the world to mathematical equations!”
How does this look to the players?
• Enemies react to our positioning– “They’re moving to block us.”
• Enemies react to each others’ actions– “They’re pulling back and closing ranks!”
• Enemies dynamically allocate their own resources as a cohesive unit– “OK… he saw me coming around the side.”
![Page 61: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/61.jpg)
“Reducing the world to mathematical equations!”
Strategy
• The entire body of a certain type of enemy working together to accomplish an over-arching goal
• Super-set of tactics– Strategy to tactics = tactical to individual
![Page 62: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/62.jpg)
“Reducing the world to mathematical equations!”
Strategy
Agent Agent Agent Agent
TacticalManager
OrderOrder Order
Order
![Page 63: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/63.jpg)
“Reducing the world to mathematical equations!”
3-tier Hierarchy
Agent Agent Agent Agent
TacticalManager
Agent Agent Agent Agent
TacticalManager
Agent Agent Agent Agent
TacticalManager
StrategicManager
Agent Agent Agent Agent
TacticalManager
Goal
Goal Goal
Goal
![Page 64: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/64.jpg)
“Reducing the world to mathematical equations!”
Using Influence Maps
• Store relevant data in underlying grid structure• Periodically update the data map• Propagate information about individual objects to
surrounding squares• Aggregate the data to yield a broad representation• Different influence maps can be used in conjunction
with one another
![Page 65: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/65.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
B
![Page 66: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/66.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
B
![Page 67: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/67.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
B
![Page 68: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/68.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
B
![Page 69: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/69.jpg)
“Reducing the world to mathematical equations!”
How does this look to the players?
• Requires communication among players:– “There are continual raids on the northern road.”– “We should take the southern road instead.”– “We should send patrols out along the northern road to
keep it open.”• Continually dynamic:
– “The orcs have figured out that we are using the southern road instead.”
![Page 70: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/70.jpg)
“Reducing the world to mathematical equations!”
Quest Givers
• Information can be kept on:– Movements of NPCs and monsters– Significant events in the world
• Quest Givers can use dynamic information from the world to notify players of…– Threats to avoid– Challenges to overcome
![Page 71: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/71.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
FortThe orcs have
gathered…west of town, near the river.
![Page 72: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/72.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
A
FortThe orcs have regrouped…
west of the fort, east of the river.
![Page 73: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/73.jpg)
“Reducing the world to mathematical equations!”
Strategic Disposition
Fort
A
The orcs have moved…
north of town, near the fort.
![Page 74: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/74.jpg)
“Reducing the world to mathematical equations!”
How does this look to the players?
• “There are groups of them moving methodically through the outlying villages.”
• “They have our city surrounded.”• “Their other groups are coming to the aid of the
army we just routed.”• “There is a group trying to cut off our retreat back to
the fort!”
![Page 75: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/75.jpg)
“Reducing the world to mathematical equations!”
Other Uses• Big Bad Dragon in the mountains
– Too many players hunting the dragon
– Moves away from the players to some hills
– Now feasting on Farmer Ted’s cows– Quest giver tells you to help Farmer
Ted
Influence MapInfluence Map
Influence MapInfluence Map
Event LogEvent Log
Influence MapInfluence Map
![Page 76: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/76.jpg)
“Reducing the world to mathematical equations!”
Other Uses• Living Areas
– Moving toward player areas
– Moving away from player areas
– Moving towards food prey
– Moving away from predators
Influence MapInfluence Map
Influence MapInfluence Map
Influence MapInfluence Map
Influence MapInfluence Map
![Page 77: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/77.jpg)
“Reducing the world to mathematical equations!”
Sooo… what have we learned?• People like playing against challenging opponents• Playing against challenging, dynamic, adaptive
opponents forces the players to communicate and work together
• AI can be designed to be challenging in similar ways to human opponents
• By using advanced AI techniques in MMOs, we can create more engaging environments for our players to thrive in
![Page 78: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/78.jpg)
“Reducing the world to mathematical equations!”
How does this change thingsfor our players?
• Identify differences in enemy behavior• Communicate what they see to each other• Communicate their personal needs (“Cover me!”)• Formulate cooperative plans • Execute plans together• Adapt those plans to account for changing
circumstances
![Page 79: Promoting MMO Player Interaction Through …...“Reducing the world to mathematical equations!” Cover Me! Promoting MMO Player Interaction Through Advanced AI Dave Mark President](https://reader033.vdocuments.site/reader033/viewer/2022041909/5e66a94e97daef747370f347/html5/thumbnails/79.jpg)
“Reducing the world to mathematical equations!”
Dave MarkPresident & Lead Designer
Intrinsic Algorithm LLC