1 belgian laboratory of computer-human interaction (bchi) ::: ucl august 2007 development method for...

Post on 28-Dec-2015

213 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

1 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Development Method for User Interfaces of Rich Internet Applications

By Francisco Javier Martínez RuizPromoteur Dr. Jean Vanderdonckt

Université catholique de Louvain (UCL)Louvain School of Management (LSM)

Information Systems Unit (ISYS)Belgian Laboratory of Computer-Human Interaction (BCHI)

http://www.isys.ucl.ac.be/bchi

2 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Agenda

1. Main Goal of the Work2. Focus3. Introduction / Literature Review4. Method outline

1. Step 1: the Task and Domain Models2. Step 2: the Abstract User Interface3. Step 3: the Concrete User Interface4. Step 4: the Final User Interface

5. Conclusions6. Contributions7. Future work

3 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Main Goal of the Work

The introduction of a meta-model of user interfaces for Rich Internet Applications establishes a common ground to standardize their design and development through a model-based and neutral representation which could be ported by a transformational schema to various web development environments.

What is the goal?

The creation of a Development Method for User Interfaces of

Rich Internet Applications

4 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Focus

What is the focus of this thesis?

Which Type of User Interfaces is studied?

To whom is directed this work?

Web Applications

Graphical User Interfaces

The CHI research community, academics interested in webapps

5 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Introduction| The Web Platform

The World Wide Web (or simply web) is based upon three core components:

The Uniform Resource identifier,

the interaction protocols used by the agents to get the resources and a

representation of the data contained by the resource

6 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Introduction| The Web Architecture

The original function of the web was to deliver plain hypertext documents over a client-server architecture but its success has caused a natural evolution from static and passive contents to dynamic and interactive ones.

7 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Introduction| Web App. Architecture

The web browser remains as the immovable and universal client.

The application server is the most important element in the second-tier (the server one) because it supplies the environment to execute the components of the application.

Finally, in the third-tier is included a repository of data that is available through a data access interface from the second-tier

8 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Introduction| Rich Internet Application

The RIAs are webapps that take into account the power of the client to increase the responsiveness of the Web UI while the management of the application and data remains on the server.

9 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Literature Review | Dialogue models

10 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Literature Review | Dialogue models

11 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Literature Review| Design Approaches

12 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Literature review | CAMELEON Framework

Building a model based application requires a framework to define the design steps needed for describe our computer system, including the features:

Multi-level abstraction, Modality independence, among others

13 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Literature review | Comparison RIA Frameworks

# Description Quick dev Testability License Platform Side Tech Deep linking back button support REST Arch SPA

1 GWT - + open AJAX/java C + ++ - +

2 ZK - + open java S - - - +

3 OpenLaszlo + - open flash/dhtml C + ++ - ++

4 FLEX ++ - comm flash C - - - +

5 Echo2 + + open java S + - - +

6 Wicket - + open java S + - - +

7 RubyonRails - - open ruby S + - - +

8 Rialto - - open AJAX C ++ - - +

9 Thinwire - - open AJAX S ++ - - +

10 CURL - - comm CURL VM C - - - +

11 Nexaweb - + open AJAX/java C + - - +

12 Backbase - + open AJAX C ++ - - +

13 XUIMLcarrousel - + open java S + - - +

14 RIBAX - + open Applet/java C + - - +

15 TIBCO - - open AJAX C ++ - - +

16 ARP - - open Flash C - - - ++

17 Zimbra - - open AJAX C - - - +

18 silverlight ++ + comm NET C + - -  ++

14 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Method outline

15 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

The Role of XLST

The reification process is the process to iterating from the abstract representation to more concrete levels and ultimately arrives to the Final User Interface.

This overall procedure is called: forward engineering.

The CAMALEON framework requires from each UI representation a process of transformation to deliver the next step.

16 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Task & Domain modeling

17 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Running Example

18 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Task model – Panoramic view

19 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Task model – Price Details

20 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Task types in RIA

21 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Task types in RIA

22 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1| Domain modeling

23 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Categorization of RIAs

The Data/Complexity continuum in Web Applications

24 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Categorization of RIAs

Data accessComplexity

Inte

ract

ivity

Web Application HTML with Client Technologies (JavaScript)

Rich Internet Application

Traditional Web Application HTML and CGI

25 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Categorization of RIAs

26 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Categorization of RIAs

27 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 1 | Categorization of RIAs

Size

<=3

>3

AmountOf ChoiceOperators

>2

<=2

AmountOf classes

AmountOf Methods

<=8

>8

>=3

I

II

II

I

AmountOf Concurrentoperators

0..1

>=2

II

III

<3

28 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Abstract User Interface

29 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure

30 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure

31 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure Algorithm

32 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure Algorithm

33 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure Algorithm

SopQPwnBR

FopQw

FopPwnCopQw

CopPw

nB

n

nG

0

1

)(

Let w = {sons tasks which father is the root of v} op = operators interacting with the tasksP = {inner tasks}Q = {leave tasks}C = {|||, |[ ]|, |=| } all the concurrent operatorsF = {[ ]} the Selection operator S = {>>, []>>,|>, [>} is the set of sequential operatorsn = the amount of son tasks (Beginning with zero)

34 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Container Structure Algorithm

35 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

36 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

37 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

38 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

39 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

40 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application to Example

41 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Design of the Menu

Definition

The concept of menu is the activation of a group of actions. A menu is constituted by a name and a list of actions called menu items. Usually, a menu item is followed by an accelerator, i.e. a combination of keywords that allows selecting an item without mouse or keyboard selection.

The advantage of menus is allowing the utilization of the options of the application without worrying about memorizing commands [Vand98]

42 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Design of the Menu

43 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Design of the Menu

44 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Design of the Menu

function Generate-Menu (CTT tree) returns menu-structure or failureinitialize the search tree to root nodeloop do if there are no candidate nodes for expansion then return exit

choose a node and expand its sons if the sons of candidate node include only choice operators then include it in MenuList[ ] and its sons as menu items. if candidate node previously marked as menu item then change the label to submenu associate to upper menu element

if candidate node is unconnected to hierarchy of MenuList thenmark it as flying menu and localized /*isolated*/

45 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application of Menu Algorithm

46 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 2 | Application of Menu Algorithm

47 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 3 |Concrete User Interface

48 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 3| Selection of Target Platform

Graphic Modality components

49 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 3| Concrete Interaction Objects

50 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 3| Concrete Interaction Objects

<?xml version="1.0" encoding="UTF-8"?><uiModel xmlns="http://www.usixml.org" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://www.usixml.org/ http://www.usixml.org/spec/UsiXML-ui_model.xsd" id="FruitStore_31" name="FruitStore" creationDate="2006-03-31T11:03:50.109-06:00" schemaVersion="1.6.3" xsi:type="uiModel"> <head> <version modifDate="2006-03-31T11:03:50.109-06:00">1</version> <authorName>Javier Martinez</authorName> <comment>Generated by GrafiXML 1.1.999 build id : 200602081036</comment> </head><window id="window_component_0" name="window_component_0" width="400" height="350"> <box id="box_1" name="box_1" type="vertical"> <imageComponent id="image_component_2" name="image_component_2" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_2']/resource/@tooltip" defaultTooltip="Apples (£5)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_2']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_3" name="image_component_3" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_3']/resource/@tooltip" defaultTooltip="Bananas (£7)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_3']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_4" name="image_component_4" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_4']/resource/@tooltip" defaultTooltip="Grapes (£9)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_4']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_5" name="image_component_5" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_5']/resource/@tooltip" defaultTooltip="Ready to buy? double click in basket" content="/uiModel/resourceModel/cioRef[@cioId='image_component_5']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> </box> </window>

51 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 3|Behavior

52 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 4 | Final User Interface (FUI)

53 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 4 | Generating the FUI

54 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 4 | XSLT Transformation Doc

<?xml version="1.0" encoding="UTF-8"?><xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:wf="http://schemas.microsoft.com/2003/xaml/" version="1.0"> <xsl:output method="xml" omit-xml-declaration="yes" /> <xsl:template match="*|/"> <wf:UserControl Name="WebForm1" ClientSize="200, 200" xmlns="http://schemas.microsoft.com/2003/xaml/" xmlns:def="Definition" xmlns:wf="wf" def:Class="XamlonApplication8.WebForm1" def:CodeBehind="WebForm1.xaml.cs"> <xsl:apply-templates select="/cuiModel/window"/> </wf:UserControl> </xsl:template> <xsl:template match="window"> <wf:UserControl.Controls> <xsl:apply-templates select="/cuiModel/window/box/inputText"/> <xsl:apply-templates select="/cuiModel/window/box/button"/> <xsl:apply-templates select="/cuiModel/window/box/outputText"/> <xsl:apply-templates select="/cuiModel/window/box/slider"/> </wf:UserControl.Controls> </xsl:template> <xsl:template match="inputText"> <wf:TextBox Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="button"> <wf:Button Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="outputText "> <wf:Label Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="slider "> <wf:TrackBar Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template></xsl:stylesheet>

55 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Step 4 |resultant file

<wf:UserControl xmlns:wf="wf" xmlns="http://schemas.microsoft.com/2003/xaml/" xmlns:def="Definition" Name="WebForm1" ClientSize="200, 200" def:Class="XamlonApplication8.WebForm1" def:CodeBehind="WebForm1.xaml.cs"><wf:UserControl.Controls xmlns:wf="http://schemas.microsoft.com/2003/xaml/">

<wf:TextBox Text="" TabIndex="1" Name="input_text_component_9"/><wf:TextBox Text="" TabIndex="1" Name="input_text_component_11"/>

<wf:TextBox Text="0.00" TabIndex="1" Name="input_text_component_13"/><wf:Button Text="Submit order" TabIndex="1" Name="button_component_14"/><wf:Label Text="Name" TabIndex="1" Name="output_text_component_8"/><wf:Label Text="Address" TabIndex="1" Name="output_text_component_10"/><wf:Label Text="Total to Pay:" TabIndex="1" Name="output_text_component_12"/>

</wf:UserControl.Controls></wf:UserControl>

56 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Conclusion

The purpose of this work was to establish the master plan of our method to develop RUIs.

All the steps have been presented in the current document. These steps are the beginning of a variation/expansion of the UsiXML family of tools and models in order to target RIAs is an ongoing work.

57 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

A Development Method for User Interfaces of RIAs

58 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Summary of contributions

• The contributions are expanded in a series of exploratory papers in which we began to understand more the model of the RIAs: – [Mart06], where present the first attempt to tackle the problem– [Muño06] where we propose a taxonomy of RIAs– [Mart06a] a study case based on XAML UIs.

• We have integrated here a proposal of extensions to the task types and menu features relevant to RIAs (see chapter 3 and 4).

• A proposal of a method for the generation of the container structure

• And Finally, The generation of menus based on task trees

59 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Future work

• The process of making grow our repository of the UI widgets used in RIAs (for complete the XSLT templates).

• The integration of the RIA frameworks GWT into the GrafiXML tool as target language (extension to UsiXML).

• The integration of some elements to make simpler the translation between models, specifically the collecting of patterns to reduce the process of conversion (simplify the XLST translation).

• The web is a distributed environment, we have to profit of that and integrate to the solution the power of the cooperative systems i.e., web agents.

• A proposal of a RIA Behaviour model

60 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007

Development Method for User Interfaces of Rich Internet Applications

By Francisco Javier Martínez RuizPromoteur Dr. Jean Vanderdonckt

Université catholique de Louvain (UCL)Louvain School of Management (LSM)

Information Systems Unit (ISYS)Belgian Laboratory of Computer-Human Interaction (BCHI)

http://www.isys.ucl.ac.be/bchi

top related