Ronen Vaisenber, Zohrab Basmajian, Phong Pham, Keith Mogensen, Arjun SatishMentors: Prof. Sharad Mehrotra, Prof. Ramesh Jain

The problem of browser capability to support multimedia content and synchronization

Browsers stay light weight, secure, and reliable. Hence, not many standards are implemented

Design and Implement a new system to support annotation, retrieval, synchronization, and presentation of lecture documents.

Why lecture management system?◦ Unstructured data collected from sensors are

much of interest to RESCUE project◦ There are lots of unstructured data available to us

on large scale

What’s the overall broad impact?◦ Experience gained from this work will give other

researchers insight on how multimedia repositories should be managed. For example Recording of 911 calls Communication between fire fighters between

during big California fires

SMPL – “Simple Multimedia Presentation Language”◦ A declarative, script free, definition file that can be

generated automatically, and defines multimedia presentation.

◦ It extends SMIL standard, supports W3C standard, and compatible by all browsers.

What’s the benefit of SMPL?◦ It supports the definition of table of contents◦ It supports the usage of bookmarks◦ It supports the definition terms/Search-able keywords◦ It supports the easy authoring of presentation

documents by editing XML file.

Plug-ins◦ Application that interacts with a browser to add a

specific functionality◦ An alternative for SMPL ◦ Disadvantage:

The browser is independent of the plug-ins They have limited interactions with rest of the page’s

content Scripting

◦ Hard to author and maintain Adding features to the browser’s internal code

◦ It will increase the size of the application and decrease reliability

Fusion◦ Synchronization of videos with slides or any other

contents such as text or html Navigation

◦ High level overview by means of table of contents and searchable index/terms

Manageable◦ Easy to manage by just editing XML file, which

defines EVERYTHING in presentation Accessible

◦ Easy support for all browsers and implemented on top of SMIL standard and follows W3C standards a

Won’t it be nicer to have a structured document instead of this cluttered page?

Information Fusion is Needed:

Session 3

Session 2

Session 1

Talk 1

Talk 2

SMIL – Talk 1

SMIL – Talk 2

Slide 1, t=0

Slide 2, t=5

Introduction, t=0

Conclusions, t=114

Slide 1,t=0

Slide 2, t=10

Slide 17, t=114

Slide 18, t=118

Slide 19, t=120

<?xml version="1.0" encoding="UTF-8"?><!ELEMENT rak (toc*)><!ELEMENT toc (toc | smilObject+)>

<!ELEMENT smilObject (smil, previewSlides*, bookmark*, keywordList?)><!ELEMENT smil (#PCDATA)>

<!ELEMENT previewSlides (time, (previewSlides | preview))><!ELEMENT preview (time, comment?, image?)>

<!ELEMENT bookmark (time, comment)>

<!ELEMENT keywordList (term*)><!ELEMENT term (time, comment)>

<!ELEMENT space (#PCDATA)><!ELEMENT image (#PCDATA)><!ELEMENT comment (#PCDATA)><!ELEMENT time (#PCDATA)>

Bookmark- t=76

Conference

Gain research experience, and solve real-world complex projects.

Learn new technologies/concepts such as working with DTD, design XML file, using google web tool kit, Programming in Java Enterprise Edition (J2EE), and etc.

Some of the tasks I have completed during this summer:◦ Design and Implement SMPL language◦ Design and Implement Oracle Database schema◦ Programming in JAVA and Google web tool kit to develop

UI Interface and add additional features such as bookmark

Utilized the following technologies: DTD, XML, Google Web Tool Kit, JAVA EE, Oracle database, AJAX, JavaScript, HTML, and etc.

Is there additional actions beyond this summer effort?◦ Of Course!!! It’s a research◦ Some of the actions are”

Utilize web application framework (Spring, Hibernate, Struts) to make the system more maintainable

Generate Web Traffic to truly test the system under heavy traffic by using tools such as JMeter

Add extra annotations and features such as comment area, private bookmarks, and much more.

The current system supports Power Point Presentations. It would be nice to support additional types such as PDF, Flashes, and so on.

List goes on and on……

Thanks for SURF-IT and all the coordinators Special thanks to Ronen, Professor Sharad,

Arjun, Keith, and Phong

Ready for Demo??