e gov universal access ahmed gomaa cimic rutgers university
Post on 22-Dec-2015
215 views
TRANSCRIPT
EGOV Universal Access
Ahmed GomaaCIMICRutgers University
Universal Access
Any Information Over Any Network
To Any One
To Any Device
You want to say multimedia information
varying expertise, capabilities, preferences of users
You want to say multimedia information
varying expertise, capabilities, preferences of users
EGOV Universal Access Example
The Entrepreneur can view on the EGOV portal a set of information resources specific to his type of business on any type of internet appliance with customizable preferences based on his appliance and his own preferences and capabilities.
Problems:• Multimedia Synchronization and flexible presentations.
What constraints shall be added to insure presentation integrity? ( Temporal and Spatial constraints )
• Personalize the Multimedia presentations based on user preferences, expertise and capabilities. The middle man (middle man sounds somewhat odd?) issue arise for converting to different formats.
• Adaptation of Multimedia Presentations on different hardware and software. ( OS / MM Boards / Devices )
• Different Networks dealing with different protocols, How to normalize the Network delay? (What is meant by normalize??)
• We need a slide here to describe the three layers• the first layer the synch, constraints and the object
model• second the PN representation• implementation using a user/web-friendly,
adaptable language• a figure with these 3 layers
Why Use Petri-Nets?
• The Above mentioned problems can be implemented by hard coded solution. ( SMIL 2.0)
BUT• How can we identify if there is a temporal or spatial
conflict in case of Forward or Rewind? (even without ff or rewind, there could be conflicts.)
• How can we visualize the runtime of our presentation to prevent any deadlocks, resource constraints, or network constraints?
SO• We need a model to analyze and abstract the
problems mentioned. Petri- Net has been used in the academic field as well as the industrial field to model different systems.
A medical Digital Library Object
• The video must start immediately after the image has been displayed .
• The text must be displayed simultaneously with the image and the video.
• The digital library object is downloaded to the client machine.
Implementation
Implementation
Object Plan as MOPN
DL Object Plan for the above medical object
The modified plan (with only audio and text capabilities)
Parallel and Sequential
An Adjusted plan
Server
ObletAdjusted
Object Plan
Multimedia Boards
Audio/Video
N/Wdelay
Synchronization:Fine and coarse-grain
Temporal Navigation +
Spatial Constraints
Client
Different Devices
User Capabilities
Spatial&Temporal Dynamic
presentation
Still The MOPN may be extended(We want to extend many aspects, not just MOPN, list all the extension
we talked about.)
Why SMIL 2.01. XML Based.
2. Allows you to use clips in different locations . (Separate URL for each clip)
3. Time and control a presentation. (Different approaches for timing)
4. Lay out a presentation. When your presentation includes multiple clips, such as a Real Video clip playing simultaneously with text captions or banner graphics, you use SMIL to define the layout.
5. Content Control module provides alternate presentations ( multiple languages, or different bandwidths. )
Timing
•Styled TimingStyled Timing
CSS or XSL stylesheets used to apply CSS or XSL stylesheets used to apply timing timing to a language- can be used for SMILto a language- can be used for SMIL
•Timesheets
Separate timing from both content and Separate timing from both content and presentation style - can be used for SMILpresentation style - can be used for SMIL
•Styled TimingStyled Timing
CSS or XSL stylesheets used to apply CSS or XSL stylesheets used to apply timing timing to a language- can be used for SMILto a language- can be used for SMIL
•Timesheets
Separate timing from both content and Separate timing from both content and presentation style - can be used for SMILpresentation style - can be used for SMIL
•Inline syntax Inline syntax
• -Attributes added to language elements-Attributes added to language elements
-Approach used in SMIL-Approach used in SMIL
•Inline syntax Inline syntax
• -Attributes added to language elements-Attributes added to language elements
-Approach used in SMIL-Approach used in SMIL
18
SMIL
Document
Timing principals
Internet
Timing is a relation between the 2 other entities rather than a property to them
Timing is a relation between the 2 other entities rather than a property to them
ContentsContents
Provides structure to the content and the links
Provides structure to the content and the links
FormattingFormatting
style and (spatial) layout of presenting
the content
style and (spatial) layout of presenting
the content
TimingTiming
describes the temporal relations between the elements in the content
and formatting section
describes the temporal relations between the elements in the content
and formatting section
Relation Versus Property The objective is let the list
element appear each one after another.
- In assign property, the order is derived from the order of the list.
- In assign relation, the order has been reserved from the order of the list.
This shows immediately the independence created by the principle
Timesheets may be used
– Document structure and timing structure do not align
– Synchronization spans multiple documents– Inline syntax impractical or illegal
• Copyright restrictions• Digital Talking Books
Petri Net To SMIL2.0
Equals ( SYNC):<par dur="30s"> <img id="foo"
src="a.jpg"/> <text src="text.html" /> <audio src="audio.au" /></par> |------------| image |------------| text |------------| Audio 30s
After ( Before):<seq> <img src="a.gif"
dur="6s" /> <img src="b.gif" dur="4s"
begin="1s" /> </seq>|----------| 6 sec |---------|
4sec|--------------------------|
11 seconds
Temporal relations and corresponding OCPN
Data Retrieving Engine
RTSM
Fast Forward operation
Pre- Fetch table
Retrieval time =
(Playback period *play rate) / Estimated BW + RDdelay
Model Global time
Model Fast Forward
Absolute time line
• The main deficiency in the absolute time line is the indeterminism of continuous objects.
• It might take more or less than 10 seconds for the audio file to play. – How to insure synchronization?
Indeterminism and absolute time line
Accessibility• How to render a different
type of media to the client? For example, a blind
person do not need to download text files, instead he needs to convert it to audio format.
Three cases:• Converters on the Server.• Converters on the Client.• Converters with middleman
server
Cost
function?
Cost
function?
Conclusion (This should go where we talk about extensions)
• Converting SMIL 2.0 to Petri-net for interoperability purposes.
• Timesheets use in SMIL2.0.• User input into the Petri net model.• Forward / Rewind / Pause in a PN model.• Presenting Indeterminism and how to minimize
desynchronization for uncontrollable objects in a PN model.
• Presenting both Spatial and temporal constraints in one Petri net model ( In progress)
• Accessibility