runrev live 13 presentation ilker yengin

Sunday, 26 October 14

YENGINIlker A*STAR - IHPC Scientist

Using Live Code in Edutainment,

Human Computer / Robot Interaction Research Studies


“Tell me and I’ll forget.Show me, and I may not remember.

Involve me, and I’ll understand.”

~ Native American Proverb


“Tell me and I’ll forget.Show me, and I may not remember.Involve me, and I’ll understand.”

~ Native American Proverb


Let them try first then they will tell you if they like it.

Involve me, and I’ll understand


Who ?Ilker YENGIN (PhD)[email protected]

Research Areas

•Cognition, Learning and Motivation •Using Technology for Collaborative Knowledge Building •Educational Technology and Interaction Design


Where ?


What ?


Social Situation AwarenessDeveloping devices able to react to social context

Understanding Social Context

Detecting social signals

Understanding the meaning


Social Situation Awareness

Design Tools

Evaluation of Interaction

Developing devices able to react to social context


Social Situation AwarenessCurrent Projects

Edutainment Robot Social Vacuum Cleaner


Why ?My Story With Live Code


A*STAR Student – Research Attachment Programme

Secondary and junior college students (Secondary /High School)


Expose students to science and research from an early age.Fuel students’ interest in research



Gain valuable research experiencesShares with their friends



Project Announcement



Title: Development of a Prototype Tool for Visualizing Online Dialog Games’ Interactions.

Project Summary:

We interact with many digital tools on a daily basis. Sometimes it is difficult for us to understand these digital tools, thus we may need more natural ways to interact with them. Rather than forcing us to learn how to operate these digital tools, the devices should learn to understand us. One way to design such digital tools is to provide them with social interfaces, which aim to utilize people’s natural interaction capabilities for operating tools. In the Social Situation Awareness (SSA) group, we develop such social interfaces for different tools (e.g. Software, Robots and other digital tools) for social interactions in everyday life. One of the tools that SSA designed is a game that helps students to improve their dialog skills. This tool also visualizes dialog interactions so the students participating in the game based dialogs may see their progress during the dialog. Our tool will be expected to enhance learning effectiveness and might be applicable for dialogs within a variety of e-learning platforms. The most prominent instructional use of this tool refers to promoting collaborative knowledge building and critical thinking skills.

SSA welcomes an interested student to take an active role in the project and gives the opportunity to have an established experience in a research project and to develop this prototype tool in C and/or Java.



Project Announcement

What ?



Me (The mentor guy)Dear … ;

Our officer responsible for research attachment program recommended you would be a good candidate for my project. I am sending the document in the attachment which explains the project. Do you think you are interested in that kind of a project and capable to do it? ….. Best;

Student... I am interested with the project, however I am not sure whether I can do it as I have not

do actual programming in a very long time.

Moreover, the knowledge of Java and C that I have may be insufficient in doing the project.

I will be happy if you are still willing to provide me with this project, however I may

still need much assistance in doing it Thank you for the opportunity



Me (The mentor guy)Dear … ;

Do you like to learn this programming language described in the following page? http://www.runrev.com/ Our engineers who knows C and Java are busy in their own work so if you need help programming this is the language that I can only give a hand.

Also you may need to be familiar to this one before you start here. Best;

Dear Mr Yengin,

Sorry to trouble you again. Or maybe may I try out the project first, and see whether I

can do it or not?

I am willing to try it out and learn from my mistakes

Best regard,

A*STAR Student – Research Attachment ProgrammeStudent


Me (The mentor guy)

Dear … ;… I expect that you will work serious and hard on that so you can learn something in the end.

I hope you will enjoy learning and working here.

…Best;

Dear Mr Yengin,

Yes. I will try my best to do the project. Thank you so much!!! :D

Best regard,

Student



Dialog Games

The student enrolled into the Research attachment Program.

She had only 2 weeks to:

Rest of the Story

Learn a programming LanguageDevelop a Prototype tool to do the research onDo Literature Review for her topicDo a user study Collect and analyze data Design a research poster



Dialog Games

Me (the mentor) in two weeks.

Rest of the Story

Give the resources Direct the student to the specific points Do regular meetings ( 15 min. daily updates, 2 hrs weekly) Show her how to do the user studies.Help the data analysis

+

Other Usual Jobs in SSA.



Dialog Games

Happy Ending of the Story

Learned how to program with LCDeveloped a Prototype toolDid Literature Review for her topicDid a user study (n=5) Collected and analyzed the data Designed a research poster

The Student:



Mobile Apps. for Decision Making

Another Story

4 weeks attachment program.4 new students. I am not the mentor but students’ mentor asked for my help to direct the students on user interface design



Mobile Apps. for Decision MakingRest of The Story

Designing the App.




Rest of The Story

Problems :Cant apply new ideas easily.Takes so much time to change.Cant Test on a real device.Show demos at the meetings.




Rest of The Story

Solutions with LC:

Learn and develop quick.Change design easily.Test on real device.Show a working demo at the meetings.




Rest of The Story

2 x 1 hrs meeting to decide the design 2 x 1 hrs Meeting to teach LC. One Week After The Working Demo is ReadyTested on a simulation and real device.Showed a working demo.Changed design 2 times.




How to Change Students Attitudes toward Real World Research

You can only MOTIVATE them to change !


(A)utonomy(C)ompetence(R)elatedness

How to Change Students Attitudes toward Real World Research


Three Essential Psychological Needs

A sense of control and choice (autonomy)

To perceive the self as capable of succeeding in tasks (competence)

Feel socially connected with and valued by others (relatedness).


SO WHAT ?“Satisfying needs that are essential for intrinsic motivations are the predictor of achievement and/or pursuit of goals.”


IN SIMPLE LANGUAGE

AutonomyCompetenceRelatedness


IN SIMPLE LANGUAGE

Intrinsic Motivation

AutonomyCompetenceRelatedness


Motivating Students toward Real World Research With the Help of Live code

(= Satisfy ACR Needs) Gives Free Play Chance.

Create ways for students to work their own.

Offer activities with students’ preferences, interest, sense of enjoyment,

sense of challenge, competencies and choice making.

Give opportunity to students for active Involvement

Make information available for decision-making


Perceive themselves as being in control.

Perceive that they can crate Apps. by their own.

Feel the ownership of the project.

Feel competent on programming

Feel they are progressing and learning.

Feel connected to the researchers and other students.

LC helped to create an environment for our research students to :

Motivating Students toward Real World Research With the Help of Live code

(= Satisfy ACR Needs)


Using Live Code to apply our theoretical ideas into real applications.


Edutainment Project

How robots might support the learning activity of the student.


The Nature of Our Studies


Basic Research Design

Theory

Ideas

Conceptual Models

Computational Model

Mock Ups

Working Prototypes

User Studies


Worked Examples

Theory

Ideas

Worked examples can be looked through in cognitive load theory. Worked examples provide step by step approach for complex structures and procedures in order to reduce cognitive load.

Design a game that is using worked examples

Conceptual Models

We can use the same concept with tutoring agents.


Problem: Takes Time to Program Robot just to test Theory.

Solution: Test the idea first. If it works then use it with robots.

Bonus : Deliver as a mobile App

Worked Examples

Working PrototypesWith


Worked Examples


Dialog Games

Theory

Ideas

Dialog games support learners to gain discussion and argumentation skills.Dialog games help learners to develop skills for understanding others’ mental models.

Dialog games structure thinking in a dialog

Design a dialog game to test its power to structure tutor – learner discussions.

Conceptual Models

How to use dialog games to structure discussions in learner – robot interactions.


Problem: Takes Time to Program Robot just to test Theory.We don’t have a fully working gesture recognition mechanism to play dialog games.

Solution: Design a dialog game running on tablet. Test the idea . If works well, later on replace iPAD with gesture recognition system.

Working PrototypesWith

Bonus : App.

Dialog Games


Dialog Games With Robots


Ilker YENGIN (PhD)

[email protected]
