rule builder at isami 2011
TRANSCRIPT
A USER-FRIENDLY INTERFACE FOR RULES COMPOSITION IN
INTELLIGENT ENVIRONMENTDario Bonino, Fulvio Corno, Luigi De RussisPolitecnico di Torino, e-Lite Research Group
http://elite.polito.it
OUTLINE
•Motivations and goal
• Requirements
• Interface design
• Conclusions
A User-Friendly Interface for RulesComposition in Intelligent Environment 2
MOTIVATIONS
A User-Friendly Interface for RulesComposition in Intelligent Environment 3
•Need to find a suitable trade-off between:
• totally direct user control of the home
• fully automatic home behavior
• Feasible solution: rule-based activity delegation
• lack of effective rules definition interfaces
OUR GOAL
A User-Friendly Interface for RulesComposition in Intelligent Environment 4
Define a rule definition interfacespecifically aimed at non-skilled home inhabitants
FUNCTIONAL REQUIREMENTS
A User-Friendly Interface for RulesComposition in Intelligent Environment 5
• Rules:
• definable by people with basic level of computer literacy
• self-explaining
• always valid
• expressive enough to manage almost home situations
NOT FUNCTIONAL REQUIREMENTS
A User-Friendly Interface for RulesComposition in Intelligent Environment 6
• Facilitate rule creation by means of:
• suggestions
• auto-filling functionalities
• auto-saving functionalities
• Home devices shall be exposed in an abstract and technology independent way
HOW TO?
A User-Friendly Interface for RulesComposition in Intelligent Environment 6
• Rich-web interface
• Formal rule representation grammar
• Constrained editing
• rules are always valid
• Rule objects and grammar easy to render as nearly natural language
PAPER PROTOTYPE
A User-Friendly Interface for RulesComposition in Intelligent Environment 7
INTERFACE CONCEPT (1/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam wants to create the rule: If the living room is dark, turn on the lamp.
• By opening the Rule Builder he sees:
- LAYOUT -
INTERFACE CONCEPT (1/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam wants to create the rule: If the living room is dark, turn on the lamp.
• By opening the Rule Builder he sees:
- LAYOUT -
what he needs to createthe rule
INTERFACE CONCEPT (1/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam wants to create the rule: If the living room is dark, turn on the lamp.
• By opening the Rule Builder he sees:
- LAYOUT -
a wide area to beused for the rule
definition
what he needs to createthe rule
INTERFACE CONCEPT (2/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam decides to drag the “light intensity sensor” under the “IF”:
- DRAG AND AUTO-DOCKING -
INTERFACE CONCEPT (2/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam decides to drag the “light intensity sensor” under the “IF”:
- DRAG AND AUTO-DOCKING -
the sensor docksand shows a list to specify
what event has to intercept
INTERFACE CONCEPT (3/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
•When Sam starts to drag the lamp, two new (optional) “blocks” appear:
- GRAMMAR BASED SUGGESTIONS -
INTERFACE CONCEPT (3/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
•When Sam starts to drag the lamp, two new (optional) “blocks” appear:
- GRAMMAR BASED SUGGESTIONS -
INTERFACE CONCEPT (3/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
•When Sam starts to drag the lamp, two new (optional) “blocks” appear:
- GRAMMAR BASED SUGGESTIONS -
INTERFACE CONCEPT (4/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam concludes the rule by dragging the lamp and selecting the proper action:
- NEARLY NATURAL LANGUAGE -
INTERFACE CONCEPT (4/4)
A User-Friendly Interface for RulesComposition in Intelligent Environment 8
• Sam concludes the rule by dragging the lamp and selecting the proper action:
- NEARLY NATURAL LANGUAGE -
the rule is complete anda sentence summarizes it
THE GRAMMAR BEHIND
A User-Friendly Interface for RulesComposition in Intelligent Environment 9
THE GRAMMAR BEHIND
A User-Friendly Interface for RulesComposition in Intelligent Environment 9
• mandatory• event to trigger
the rule(E-BLOCK)
• controllable devices, clock and sensors
• optional• conditions
constraining the event(C-BLOCKs)
• controllable devices, clock and sensors
• mandatory• set of actions
to be executed(A-BLOCKs)
• controllable devices
THE GRAMMAR BEHIND
A User-Friendly Interface for RulesComposition in Intelligent Environment 9
• mandatory• event to trigger
the rule(E-BLOCK)
• controllable devices, clock and sensors
• optional• conditions
constraining the event(C-BLOCKs)
• controllable devices, clock and sensors
• mandatory• set of actions
to be executed(A-BLOCKs)
• controllable devices
THE GRAMMAR BEHIND
A User-Friendly Interface for RulesComposition in Intelligent Environment 9
• mandatory• event to trigger
the rule(E-BLOCK)
• controllable devices, clock and sensors
• optional• conditions
constraining the event(C-BLOCKs)
• controllable devices, clock and sensors
• mandatory• set of actions
to be executed(A-BLOCKs)
• controllable devices
disjunction for repeatingIF-WHEN more than once
THE GRAMMAR BEHIND
A User-Friendly Interface for RulesComposition in Intelligent Environment 9
• mandatory• event to trigger
the rule(E-BLOCK)
• controllable devices, clock and sensors
• optional• conditions
constraining the event(C-BLOCKs)
• controllable devices, clock and sensors
• mandatory• set of actions
to be executed(A-BLOCKs)
• controllable devices
disjunction for repeatingIF-WHEN more than once
WORK IN PROGRESS...
A User-Friendly Interface for RulesComposition in Intelligent Environment 10
CONCLUSIONS
A User-Friendly Interface for RulesComposition in Intelligent Environment 11
• Rule Builder
• conceptual and first “working” design
• rich-web interface
• for home inhabitants with little or no technological skills
• based on a formal grammar
THANK YOU
A User-Friendly Interface for RulesComposition in Intelligent Environment 12
Luigi De Russis