![Page 1: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/1.jpg)
ReMashed –An Usability Study of a
Recommender System
for Mash-Ups for LearningHendrik Drachsler, Dries Pecceu, Tanja Arts, Edwin Hutten, Peter van Rosmalen,
Hans Hummel & Rob Koper
![Page 2: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/2.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 2 | 23 September, 2009
My background…
Learning Networks
![Page 3: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/3.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 3 | 23 September, 2009
Learning NetworksExplicitly address informal
learning
Learners can publish, share, rate, tag and adjust their own Learning Activities in a Learning Network
Open Corpus that emerges form the bottom upwards
![Page 4: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/4.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 4 | 23 September, 2009
Nowadays …
Social Bookmarking
Blog Reader
Various Communities
More Information Providers
Personal Environments
![Page 5: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/5.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 5 | 23 September, 2009
Personal Learning Environments
![Page 6: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/6.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 6 | 23 September, 2009
Selection problem because …
…of the amount of data that is emerging.
…learners can be overwhelmed by the plethora of information.
![Page 7: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/7.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 7 | 23 September, 2009
Today, Recommender Systems supporting our decisions
Can we create a Recommender Systemfor Mash-Ups for Learning?
![Page 8: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/8.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 8 | 23 September, 2009
What is ReMashed?
A Mash-up environment that allows you to personalize emerging information of online communities with a recommender system.
You tell what kind of Web 2.0 services you use and then you are able to define which contributions of other members you like and do not like.
![Page 9: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/9.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 9 | 23 September, 2009
Goals for ReMashed
1. End-User levelProviding a recommender system for Web 2.0 sources of learners in informal Learning Networks.
2. Researcher level1. Offering researchers a system for the evaluation of
recommendation algorithms for learners in informal Learning Networks.
2. Creating user-generated-content data sets for recommender systems in informal Learning Networks.
![Page 10: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/10.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 10 | 23 September, 2009
How does it work?
ReMashed uses collaborative filtering to generate recommendations.
It works by matching together users with similar tastes (neighbours) on different Web 2.0 resources (delicious, Flickr, blog feeds, Slideshare, Twitter, and YouTube).
![Page 11: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/11.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 11 | 23 September, 2009
How does it work?
Cold-Start = Tag-based recommendation
Collaborative Filtering with ratings
![Page 12: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/12.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 12 | 23 September, 2009
The 1st Release
![Page 13: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/13.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 13 | 23 September, 2009
The 1st Release
RecommendationAlgorithms
Database of Items
User Interface
![Page 14: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/14.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 14 | 23 September, 2009
System Evaluation• At the TENCompetence Winterschool 2009
• Also external users sign up for the evaluation phase
• In total 49 people from 8 different countries
• The evaluation phase ran for one month and was concluded with an online recall questionnaire.
• We received answers from 19 participants in total(response rate of 38%).
After this slide you created some really ugly ones do you really want to show them to the audience?
![Page 15: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/15.jpg)
Usage of Web 2.0 servicesStrongly
agreeAgree Neutral Disagree Strongly
disagree
1. Use a blog 16%(n=3)
5%(n=1)
31%(n=6)
11%(n=2)
37%(n=7)
2. Use socialBookmarking
42%(n=8)
42%(n=8)
6%(n=1)
5% (n=1)
5% (n=1)
3. Share pictures 5% (n=1)
32% (n=6)
21% (n=4)
26% (n=5)
16% (n=3)
4. Sharepresentations
11%(n=2)
26% (n=5)
21%(n=4)
21%(n=4)
17%(n=5)
5. Use micro-blogging
11%(n=2)
21% (n=4)
10%(n=2)
21%(n=4)
37%(n=7)
6. Upload videos 0%(n=0)
15% (n=3)
38%(n=7)
26%(n=5)
21%(n=4)
7. Use YouTubeto collect videos
5%(n=1)
32% (n=6)
15%(n=3)
16%(n=3)
32%(n=6)
48%21%
10%84%
42%37%
38%37%
58%32%
47%15%
48%37%
They just twittered that the table is terrible.
![Page 16: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/16.jpg)
Satisfaction with ReMashedVery
satisfiedSatisfied Unsatisfied Very
unsatisfiedTotal
1. Overallsatisfaction
5%(n=1)
58%(n=11)
26%(n=5)
11%(n=2)
100%(n=15)
2. Satisfaction tag-based algorithmin the beginning
20%(n=3)
40%(n=6)
27% (n=4)
13% (n=2)
100%(n=16)
3. Satisfaction tag-based algorithmat the end
0% (n=0)
69% (n=11)
19% (n=3)
13% (n=2)
100%(n=16)
4. Satisfaction rating-based algorithm in the beginning
8%(n=1)
53% (n=7)
31%(n=4)
8%(n=1)
100%(n=14)
5. Satisfaction rating-based algorithm at the end
8%(n=1)
54% (n=7)
31%(n=4)
8%(n=1)
100%(n=13)
37%63%
40%60%
31%69%
39%61%
38%62%
![Page 17: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/17.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 17 | 23 September, 2009
We received 9 answers:
• Integrate social networks like Linkedin, Facebook, and MySpace.
• Integrate mind mapping tools like Mindmeister.
• Create clusters of Web 2.0 services of the same type, e.g. combine Picassa and flickr in a subcategory ‘Pictures’.
Open Question
![Page 18: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/18.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 18 | 23 September, 2009
The 2nd Release
![Page 19: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/19.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 19 | 23 September, 2009
The 2nd Release
DUINE Prediction Engine
Database of Items
User Interface
![Page 20: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/20.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 20 | 23 September, 2009
You can use it as well!
Register atremashed.ou.nl.
Enter your favorite Web 2.0 potatoes.
Join the community.
ReMashed starts mashing.
Taste your personal flavor of Web 2.0.
![Page 21: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/21.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 21 | 23 September, 2009
Future R&DEnd-user perspective:1. More Web 2.0 services and social networks2. Widget / Portlet interface for other Personal Environments3. Administration interface to create instances of the
ReMashed
Researcher perspective:1. Creating data sets for Technology-Enhanced Learning2. Exploring new recommendation technologies3. Creating web services to offer recommendations to other
Mash Up Personal Learning Environments
![Page 22: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/22.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 22 | 23 September, 2009
Many thanks for your interest!
This slide is available here:http://www.slideshare.com/Drachsler
Email: [email protected]
Skype: celstec-hendrik.drachsler
Blogging at: http://elgg.ou.nl/hdr/weblog
Twittering at: http://twitter.com/HDrachsler
![Page 23: ReMashed - An Usability Study of a Recommender System for Mash-Ups for Learning at ICL Conference 2009, Voillach, Austria](https://reader033.vdocuments.site/reader033/viewer/2022051610/5481b391b07959420c8b45c8/html5/thumbnails/23.jpg)
International Conference on Interactive Computer Aided Learning, ICL 2009,Villach, AT
Page 23 | 23 September, 2009
Please sign up at:
http://remashed.ou.nl