language, logic and control: synthesizing correct, high ...muri/y5review/raman_muri_2.pdf ·...
TRANSCRIPT
![Page 1: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/1.jpg)
Intelligent Behavior Correctness and perceived correctness of
continuous execution of synthesized plans
Vasu Raman Cornell University
Joint work with Cameron Finucane, Gangyuan Jing and Hadas Kress-Gazit
![Page 2: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/2.jpg)
Synthesizable
Unsynthesizable
(FSA)
Synthesis
Specification Analysis
(Physical Robot) (Simulation)
Hybrid Controller
Specification Map Robot
![Page 3: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/3.jpg)
Synthesizable
Unsynthesizable
(FSA)
Synthesis
Specification Analysis
(Physical Robot) (Simulation)
Hybrid Controller
Specification Map Robot
![Page 4: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/4.jpg)
Example:
“Robot starts in region r1 with the camera off”
“Activate the camera if and only if you see a person”
“Go to r2 infinitely often”
![Page 5: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/5.jpg)
Continuous Execution
– Camera turns on
– Motion from r1 to r2
How to execute:
Assume all actions except motion instantaneous
Do motion first, then everything else
![Page 6: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/6.jpg)
Camera turns on Motion from r1 to r2
Continuous Execution
![Page 7: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/7.jpg)
PART I Correctness of Execution for Actions with
Different Durations
![Page 8: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/8.jpg)
Original Approach: actions after motion
Camera turns on Motion from r1 to r2
![Page 9: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/9.jpg)
Why is this undesirable?
- Delayed reactivity
- Potentially unsafe states
![Page 10: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/10.jpg)
Alternative Approach: simultaneous actions
Camera turns on
Motion from r1 to r2
![Page 11: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/11.jpg)
Why is this undesirable?
- Potentially unsafe executions
“Do not activate the camera in r1”
![Page 12: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/12.jpg)
What we really want:
• Automatically check for safe continuous execution
during synthesis
• Provide feedback for unrealizability due to continuous
execution
Goal:
![Page 13: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/13.jpg)
Implicit intermediate state
“Slow” = motion, “Fast” = everything else
Synthesis for Fast/Slow Actions
![Page 14: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/14.jpg)
Synthesis for Fast/Slow Actions
For fast and slow actions!
Implicit intermediate states are safe!
Raman, Finucane and Kress-Gazit, IROS 2012
Synthesizable
Unsynthesizable
(FSA)
Synthesis
Specification Analysis
(Physical Robot) (Simulation)
Hybrid Controller
Specification Map Robot
![Page 15: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/15.jpg)
- Explaining unsynthesizability arising from different
controller execution durations
e.g. OK with instantaneous actions, not without
- More that two relative action completion durations
Robot actions (in order of duration):
– Turning on/off the camera
– Waving hand
– Motion between regions
New framework: • Explicitly model action initiation/completion
• Small computational overhead
Raman, Piterman and Kress-Gazit, Submitted
![Page 16: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/16.jpg)
PART II Optimality of Continuous Executions
(“perceived correctness”)
![Page 17: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/17.jpg)
Non-optimality in the continuous execution
Classroom2 Classroom1
Hall1
Office1
Hall2
Hall3 Office2
Classroom2 Classroom1
Hall1
Office1
Hall2
Hall3 Office2
Trajectory when “people” is false Trajectory when “people” is true
![Page 18: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/18.jpg)
Overview of solutions
• Add continuous metric when synthesizing the discrete automaton.
• Minimize cost in continuous domain between consecutive robot goals
• Frame the problem of minimizing cost to satisfy all robot goals as a Travelling Purchaser Problem.
• Reorder robot goals based on approximate solution.
Jing and Kress-Gazit, Submitted
Non-optimal path between goals Non-optimal goal order
![Page 19: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/19.jpg)
Reorder robot goals based on TPP solution
Find shortest path between goals for a specific environment state
3
3 1
3
5
1
2
1
𝑞5 𝑞6
𝑞1 𝑞8
5
9
1
11
6 7 9
2
6
3
10 3
𝑞2
𝑞3
𝑞4
𝑞5
𝑞6
𝑞1
𝑞7
𝑞8
Jing and Kress-Gazit, Submitted
Non-optimal path between goals Non-optimal goal order
![Page 20: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/20.jpg)
Reactive controller for dynamic environment
Reordered Liveness
Extract goal
states
Reorder robot
goals
Synthesize
weighted
automaton
Compute and
follow the
reasonable path
Topological
Map
Specification
State
Synthesize
weighted
automaton
Automaton
New Environment
New Weighted
State
Initial Environment
States
Set of Goals
Automaton Weighted
New Weighted Automaton
Jing and Kress-Gazit, Submitted
![Page 21: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/21.jpg)
Reasonable continuous robot trajectories
Classroom2 Classroom1
Hall1
Office1
Hall2
Hall3 Office2
Classroom2 Classroom1
Hall1
Office1
Hall2
Hall3 Office2
Trajectory when “people” is false Trajectory when “people” is true
Jing and Kress-Gazit, Submitted
![Page 22: Language, Logic and control: Synthesizing correct, high ...muri/y5review/raman_muri_2.pdf · Language, Logic and control: Synthesizing correct, high-level robot behaviors Hadas Kress-Gazit](https://reader036.vdocuments.site/reader036/viewer/2022090609/606093b203a32d5c973cb0c7/html5/thumbnails/22.jpg)
Intelligent Behavior Correctness and perceived correctness of
continuous execution of synthesized plans
Vasu Raman Cornell University
Joint work with Cameron Finucane, Gangyuan Jing and Hadas Kress-Gazit