cloud4all technical overview
DESCRIPTION
Cloud4all is an EC-funded project from the 7th Framework Programme. Cloud4all aims to develop a complete new paradigm in accessibility by augmenting adaptation of individual products and services for a person (2nd generation) with automatic personalization of any mainstream product or service a user encounters using cloud technologies to activate and augment any natural (built-in) accessibility or installed access features the product or service has (3rd generation), based on the user's needs and preferences. This presentation provides an overview of the different technical components that comprise the overall Cloud4all / GPII architecture.TRANSCRIPT
Cloud platforms Lead to Open and Universal access for people with Disabilities and for All
www.cloud4all.info
Cloud4all Technical OverviewGregg Vanderheiden Ph.D.
Raising the Floor – International
1. To test the concept of Auto-Personalization from Preferences• Does it work – for users – and across technologies• Can it be built in a scalable fashion
2. To build the first draft of essential GPII components• The Overall Architecture and run time components• The Semantic components (Ontologies, et al)• The Basic Data Sets required ( Registries and Databases ) • The Data Maintenance and User Tools• The Standards
3. To create demonstration/test implementations• Across technologies (Windows, Linux, Android etc)• Across Application domains (PCs, Mobile, Web, Closed, Appliances, etc)
2Cloud4all Objectives
Will something help me? What?
Getting access automatically, anywhere, onany device
Tools to make it easier, lower-cost to create & market new solutions
3
User Awareness
Needs & PrefsDiscovery Aid
GPII Unified Listing& Marketplace
Prefs & PermServer
Real TimeMatching
Developers’Space
Users find out something exists
for them.
Users can find out which types of
things help them
Find all solutions, AT
& Mainstreamdevice / feature / service
User needs & prefs stored securely andavailable anywhere
Prefs and context used to determine best fit; here, now.
User can call up any assistance
anywhere
Free & commercialparts to speed dev,
and lower costs
Consumers & Experts
Connection
Experts, consumers,testers etc to helpnew developers
Delivery/Launch Management
Built-in + AT are auto-adjusted and
launched, anywhere
ShoppingAid
Users can use their profile to find just what helps them
Micro-FinanceMicro-PaymentInfrastructure
Mechanism for Financing R&D and Service Del
GPII Unified Listing & Marketplace
Developers can quickly, efficientlymarket worldwide
ServiceCreation Tools
To make it easy to Create AOD, Media,& Material service
Needs & Prefs Storage
Users can storeneeds & preferences
info for later use
Assistance on Demand (AOD)
Media & Materials
Auto- augmentationtransformation
and/or replacement
Cloud4allUS Dept of Ed
Major Components of GPII
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
Basic Architecture Limited Intelligence
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
N&P Ontology
Solutions Ontology
Adding Context and Semantics Allows
Increased Matchmaking Intelligence
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
A Personal Control Panel Allows users
real time control of
their settings
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Which can also (if the user chooses)
change their stored
preferences for this context
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
The Matchmaker can offer options
to the user – – – –
The user can also make decisions on how it wants the matchmaker to
operate
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Now where did that Solutions Registry come from ?
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
But Cloud4all/GPII will also match users and different Media and Materials
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources
N&P Ontology
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
And we need tools to maintain the metadata (semantics) for all of these.
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
We also need a way to create
(and edit) User Needs &
Preferences Sets
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
And, as is true anytime you want many entities to
communicate effectively – we need
a common vocabulary.
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
Service Synth Tool
Synthesized
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
Service Synth Tool
Synthesized
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
Service Synth Tool
Synthesized
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Management Options
Spinal Matchmaker
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
Service Synth Tool
Synthesized
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Spinal Matchmaker
Management Options
Flow Manager
Solutions
User Listeners
Lifecycle Manager
Lifecycle Handlers
Settings Handlers
Installed
Preferences Server
Device Reporter
(local Solutions registry)
Match Makers
Transformer
Real-time Components Environment Reporter
Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.
Context rules
Network & download
Global Solution Registry
(Unified Listing)(AT + Mainstream)
N&P Ontology
Solutions Ontology
EASTIN+ Federation
(AT only )Global Solution
Registry(Unified Listing)(AT + Mainstream)
Other DBs
Mainstream
AT
GARI Phone DB
(Mainstream)
EASTIN GROUP DBs
Solutions
Federated Search &
Delivery ofMM&R Metadata
Media, Materials & Resources Semantic Tools
Service Synth Tool
Synthesized
N&P Ontology
Other Ontologies
Materials Ontology
Mainstream Data Maintenance
Metadata Auto-Generation Tools
Manual Metadata Generation Tools
AT Data Maintenance
Solutions Ontology
Common Terms Registry
Common Terms
Viewer/Editor
Personal Control Panel(includes Options /Suggestions UI and
ability to launch NP Editor)
Spinal Matchmaker
Management OptionsKind of like a car.
It takes a lot of pieces to make a car simple to operate.
Kind of like a car.
It takes a lot of pieces to make a car simple to operate.