identifying physical team behaviors from spatial...
TRANSCRIPT
![Page 1: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/1.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Identifying Physical Team Behaviors from Spatial Relationships
Gita SukthankarKatia Sycara
Robotics InstituteCarnegie Mellon University
![Page 2: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/2.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Team Behavior Recognition• Team behavior recognition is the ability to
recognize a team’s high-level intention from sequences of low-level actions executed by the team members.
• In MOUT, many team behaviors are physical in nature (e.g., patrolling an area, moving in formation) and have distinctive spatial characteristics.
• How can we efficiently and robustly identify these spatial relationships between MOUT entities?
![Page 3: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/3.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Recognition without Spatial Landmarks
Spatial landmarks such as doors and intersections are importantcues for analyzing MOUT team behaviors.
Doorway
![Page 4: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/4.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Problem: Scene Analysis• Team of soldiers
(blue) about to enter building
• Sniper (red) hiding in the trees
• Commonly occurring patterns can be difficult to recognize in cluttered environment
![Page 5: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/5.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Problem: Scene Analysis• Team of soldiers
(blue) about to enter building
• Sniper (red) hiding in the trees
• Commonly occurring patterns can be difficult to recognize in cluttered environment
Building entry
![Page 6: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/6.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Problem: Scene Analysis• Team of soldiers
(blue) about to enter building
• Sniper (red) hiding in the trees
• Commonly occurring patterns can be difficult to recognize in cluttered environment
Likely sniper position
![Page 7: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/7.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Problem: Scene Analysis• Team of soldiers
(blue) about to enter building
• Sniper (red) hiding in the trees
• Commonly occurring patterns can be difficult to recognize in cluttered environment
Same behavior, different orientation
![Page 8: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/8.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Problem: Scene Analysis• Team of soldiers
(blue) about to enter building
• Sniper (red) hiding in the trees
• Commonly occurring patterns can be difficult to recognize in cluttered environment
Cluttered environment
![Page 9: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/9.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Related Work
• Spatial recognition of multi-agent behaviors– Football (Intille & Bobick, 1999)– Robocup soccer (Riley & Veloso, 2002)
• MOUT spatial team plan representations– ACT-R (Best and Lebiere, 2003)– SOAR (Pearson and Laird, 2004)
![Page 10: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/10.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Constructing the Model
Model: Building Entry
Overhead Map
Unreal Tournament view
![Page 11: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/11.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Constructing the Model
Model
Map
Construct point-basedversion of map withlines of visibility andconcealment
![Page 12: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/12.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Spatial Representation• Behavior name • Spatial position (x,y) of entities • Entity type:
– person (unknown), civilian, teammate, opponent, hard cover, softcover, empty area, window, intersection, doorway, hazard, objective
• Pairwise constraints– visibility: points must be connected– occlusion: points across this barrier cannot be connected
• Scaling limitations– range of scale factors for which the model is valid
Spatial models and behaviors don’t have a one-to-one correspondence; each behavior can have multiple models.
![Page 13: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/13.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Constructing the Model
Model
Map
![Page 14: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/14.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Exhaustive Template Matching
Model
Map
Slide model acrossmap checking to seeif the distance metric falls beneath threshold
![Page 15: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/15.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model
Map
Slide model acrossmap checking to seeif the distance metric falls beneath threshold
Exhaustive Template Matching
![Page 16: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/16.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Exhaustive Template Matching
Model
Map
Slide model acrossmap checking to seeif the distance metric falls beneath threshold
![Page 17: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/17.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Exhaustive Template Matching
Model
Map
Slide model acrossmap checking to seeif the distance metric falls beneath threshold
![Page 18: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/18.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Exhaustive Template Matching
Model
Map
Slide model acrossmap checking to seeif the distance metric falls beneath threshold
![Page 19: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/19.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model
Map
Also have to checkdifferent scales androtations
Exhaustive Template Matching
![Page 20: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/20.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model
Map
Also have to checkdifferent scales androtations
Exhaustive Template Matching
![Page 21: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/21.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model
Map
Also have to checkdifferent scales androtations
Exhaustive Template Matching
![Page 22: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/22.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model
Map
Time-consumingexhaustive search
Exhaustive Template Matching
![Page 23: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/23.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Generate and testhypothesized transforms to projectthe model to the map
Fischer & Bolles, 1981
![Page 24: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/24.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Randomly selecttwo points (a minimalset from the model)
![Page 25: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/25.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Randomly select 2corresponding pointsof compatible typesfrom the map.
![Page 26: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/26.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Calculate T, thesimilarity transform,from the pointcorrespondences.
![Page 27: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/27.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Use the transformT to project remainingmodel points to themap coordinate frame
![Page 28: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/28.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Score the hypothesisT based on whetherpoints of compatibletypes fall withinthe distance threshold
![Page 29: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/29.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
3 potential matches(marked in green)found. Normalized modelscore=3/5
![Page 30: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/30.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Iteration 2:Choosea new minimal set
![Page 31: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/31.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Iteration 2:Randomly select 2corresponding pointsof compatible typesfrom the map.
![Page 32: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/32.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Map
Iteration 2:Calculate T’, thesimilarity transform,from the pointcorrespondences.
![Page 33: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/33.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Map
Model
Iteration 2:Use the transformT’ to project remainingmodel points to themap coordinate frame
![Page 34: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/34.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Map
Model
Iteration 2:Score the hypothesisT’ based on whetherpoints of compatibletypes fall withinthe distance threshold
![Page 35: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/35.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Map
Model
Iteration 2:1 potential match(marked in green)found. Normalized modelscore=1/5
![Page 36: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/36.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Model
Iteration 2:New score (1/5) is lessthan previous score(3/5). Our previouslygenerated hypothesis,T, remains the best.
![Page 37: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/37.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Random Sampling Consensus
Map
Model
Iteration 2:1 potential match(marked in green)found. Normalized modelscore=1/5
![Page 38: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/38.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Model Misalignment
Model aligned with best fitting transform, T,scores highly (5/5)
Same model aligned with poor transform,T’, scores poorly (2/5)
We score the model according to the best fitting transform. To determine whether the model is a valid fit, we check the score to see if it falls above a threshold
![Page 39: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/39.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Calculating the Similarity Transform
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡−=
100)cos()sin(
)sin()cos(ysxs
T θθθθ
)},(),,{( 2211 yxyx)},(),,{( 2211 YXYX
1
321
321
321
321
333231
232221
131211
111111
−
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡yyyxxx
YYYXXX
ttttttttt
Model
Map
![Page 40: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/40.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Calculating the Similarity Transform
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡−=
100)cos()sin(
)sin()cos(ysxs
T θθθθ
1213 yyxx −+=
2113 xxyy −+=
1213 YYXX −+=
2113 XXYY −+=
)},(),,{( 2211 yxyx)},(),,{( 2211 YXYX
1
321
321
321
321
333231
232221
131211
111111
−
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡yyyxxx
YYYXXX
ttttttttt
Model
Map
Virtual point
![Page 41: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/41.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Spatial Model Matching Interface
Models of team spatialrelationships (right panels)
Blue circles: teammatesGreen circles: neutralsWhite squares: entry points;Orange triangle: hazard
Annotated overhead situation map (left panel)
![Page 42: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/42.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Example: Opponent Modeling
Model marked in right hand panel scored over threshold; the model combinedwith the highest scoring transform give us a prediction of where an enemy(marked in red) is likely to be found.
![Page 43: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/43.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Example: Identifying Flanking
![Page 44: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/44.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Example: Identifying Flanking
![Page 45: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/45.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Example: Identifying Flanking
Matching fails because the spatial relationship between elementsin the map is different from the idealized model.
![Page 46: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/46.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Advantages of RANSAC Search• Faster than exhaustive template matching• Invariant to many spatial transformations• Robust to occlusions (missing points) and
outliers• Generates an explicit hypothesis of the location
of missing scene elements based on the projection of the template
• Can be calculated in batch across multiple models
• Disadvantage: probabilistic algorithm is not guaranteed to find all possible matches
![Page 47: Identifying Physical Team Behaviors from Spatial Relationshipscc.ist.psu.edu/BRIMS/archives/2005/presentations/05-BRIMS-026.pdf · – range of scale factors for which the model is](https://reader033.vdocuments.site/reader033/viewer/2022042415/5f2fc0eed550ad5a3721e3d9/html5/thumbnails/47.jpg)
14th BRIMS Conference16-19 May 2005Copyright 1998 Institute for Simulation & Training
Conclusion
• Our approach is:– Efficient– Accurate
• Assuming 95% of the points are outliers, RANSAC will find the best match with 99% probability in 1840 iterations
• In 3D, approximately 40000 iterations are required.– Robust to missing points and outliers