stanford fablearn's paulo blikstein on the efficacy of maker ed_ it's about process, not products _...

7/26/2019 Stanford FabLearn's Paulo Blikstein on the Efficacy of Maker Ed_ It's About Process, Not Products _ EdSurge News

1/13

01/06/2016 Stanford FabLearn's Paulo Blikstein On the Efficacy of Maker Ed: It's About Process, Not Products | EdSurge News

https://w ww.edsur ge.com /new s/2016- 05- 26- stanfor d- fabl ear n- s- paul o- bl iks tei n- on- the- effi cacy -of- maker -ed- it- s- about- pr oces s- not- pr oduc ts 1/13

NEWSEVENTSPRODUCT REVIEWSRESEARCHJOBS

NEWSEVENTSPRODUCT REVIEWSRESEARCHJOBS

Search
https://www.edsurge.com/https://www.edsurge.com/https://www.edsurge.com/jobshttps://www.edsurge.com/researchhttps://www.edsurge.com/product-reviewshttps://www.edsurge.com/jobshttps://www.edsurge.com/researchhttps://www.edsurge.com/product-reviewshttps://www.edsurge.com/ehttps://www.edsurge.com/newshttps://www.edsurge.com/https://www.edsurge.com/jobshttps://www.edsurge.com/researchhttps://www.edsurge.com/product-reviewshttps://www.edsurge.com/ehttps://www.edsurge.com/newshttps://www.edsurge.com/


2/13


3/13



News>Research>Efficacy

Stanford FabLearn's Paulo Blikstein On the Efficacy of Maker Ed: It's

About Process, Not Products
https://www.edsurge.com/news/research/efficacyhttps://www.edsurge.com/news/researchhttps://www.edsurge.com/news


4/13



Image Credit: charles taylor / Shutterstock

By Patrcia GomesMay 26, 2016This article is in our guide:What's Next for Maker EducationSponsored by AdobeMore articles from this guide:
http://www.adobe.com/education.edu.html?https://www.edsurge.com/research/guides/what-s-next-for-maker-educationhttps://www.edsurge.com/writers/patricia-gomeshttp://www.shutterstock.com/gallery-6748p1.html


5/13



The Maker Movement Isn't Just About Making and Electronics: EdSurge Talks to MIT's Mitch Resnickby Mary Jo Madda

How to Marry Computer Science and Maker EdMacGyver Style Plus 10 Resources for CS Maker Integrationby Grant Smith

Russian Icons, Greek Vases and German Code: The Maker Movement Goes to Collegeby Andrew Rikard

The first time that Stanford assistant professor Paulo Bliksteinstudied the impact of maker activities on students' learningway back in the early 2000sthe Maker movement wasn't known as such yet. There were researchers out there interested who were in the concept, especially at MIT, but there wasn'ta common language to discuss its pedagogical principles and the cost of technology was still a barrier to experimentation in classrooms.

There is math in music, for example, but learning music doesn't necessarily increase math scores.

Back then, Blikstein was busy organizing Maker workshops for low-income students in Helipolis, one of largest and, at that time, most violent Brazilianslums. With cutting edge technologies such as robotic kits and electronic circuits, as well as simple materials like cardboard and ribbons, he challenged thekids to solve real-world problems. In a 2011 TEDx talk, he shared, "They start to look at technology not as something magical, but as something that can

be used to improve the life of others."

Fast forward to 2016 in Palo Alto, CA, 6,500 miles north of Sao Paulo. Blikstein is now the director of FabLearn, a program that engages a community ofeducators in disseminating best practices and resources around how to integrate the principles of Maker ed into formal K-12 learning. He has also become
http://fablearn.stanford.edu/http://tedxtalks.ted.com/video/TEDxManhattanBeach-Paulo-Bliksthttps://www.edsurge.com/news/2016-05-23-the-maker-movement-isn-t-just-about-making-and-electronics-edsurge-talks-to-mit-s-mitch-resnickhttps://ed.stanford.edu/faculty/paulobhttps://www.edsurge.com/news/2016-05-16-russian-icons-greek-vases-and-german-code-the-maker-movement-goes-to-collegehttps://www.edsurge.com/news/2016-05-17-how-to-marry-computer-science-and-maker-ed-macgyver-style-plus-ten-resources-for-cs-maker-integrationhttps://www.edsurge.com/news/2016-05-23-the-maker-movement-isn-t-just-about-making-and-electronics-edsurge-talks-to-mit-s-mitch-resnick


6/13



an advocate for equity and diversityin the Maker movement, studying what works and doesn't work in the project-based learning approach.

In an interview with EdSurge, Blikstein talks about efficacy in the Maker movement. He argues that success depends on what is being measured, thatassessments should focus on the process and not products, and that school districts have finally embraced the pedagogy of makerspaces. The problemnow, he adds, is to prove that they are scalable and sustainable.
https://www.edsurge.com/news/2016-05-11-diversity-does-not-happen-by-accident-and-other-lessons-about-equity-in-the-maker-movement


7/13



Paulo Blikstein

How do we measure success in a makerspace?

The first thing to do is define what success means. If it means higher test scores, then we need one kind of measurement. If success means engaging more


8/13



kids in STEM disciplines, we need a different metric. And if success instead means that kids are happier at school and want to spend more time there, weneed yet a third measurement tool.

However, there are some metrics that are recipes for failure. One of them is to rely too much on test scores. There is math in music, for example, butlearning music doesn't necessarily increase math scores.

What's a better form of assessment than test scores?

The kinds of assessments that we have right now are not very adequate for maker activities because they measure product, and not process.

Tests are good for pre- and post- measurements we give a test at the beginning, another at the end and see how much students have improved. That's whatwe call a product-based, outcome-based assessment. However, most of the learning that happens in makerspaces takes place in the process.

So, how can we measure process?

Our takeaway is applicable to all classrooms: build moments of reflection into your hands-on activities.

We have been building a research methodology called "multimodal learning analytics." This is a data collection technique that uses eye tracking, gesturetracking, bio sensing, log file analysis, click chain analysis, and visual analysis. We collect all this data to find interesting patterns in how kids learn.

We use this technique because it's hard to detect a lot of these patterns, even with careful observation. Imagine if you have a room with 20 students andyou want to observe what each individual child is doing step-by-step. Without technology, it would very labor intensive.

You mentioned eye trackers, gesture trackers. Not all teacher will have access to this technology in their classrooms...

We've done a couple of studies, the results of which can help teachers.

For example, we analyzed students in hands-on activities, like building a robot, and concluded that kids who are more activethe ones in whom wedetected more hand movements and gesturestend to learn more, which is what we expected. But we were surprised to find that an even better predictorof learning was not how much students were moving, but how many times they alternated between being active and being passive in an activity.

Our takeaway is applicable to all classrooms: build moments of reflection into your hands-on activities.

Any other recommendation about hands-on activities?

In another study, we had students working in pairs on maker activities. We identified one as the "driver" of the activityin control of the computer, thekeyboard, etc.and the other as the "passenger."

The 2015-2016 FabLearn Fellowshave just written, Meaningful Making: Projects and Inspirations for Fab Labs and Makerspaces. Learn more about the program or applyto
http://fablearn.stanford.edu/fellows-new/stanford2016/http://bit.ly/m_makinghttp://fablearn.stanford.edu/fellows-new/http://blog.bertrandschneider.com/wp-content/uploads/2012/01/23_102-844-3-CE.pdfhttps://tltl.stanford.edu/project/multimodal-learning-analytics


9/13



be a 2016 FabLearn Fellow.

We paired low and high GPA students in different types of grouppairs of high GPA students, pairs of low GPA students and pairs with one of each.When we had a pair of two high GPA students, of course they performed well. When we had a pair of low GPA students, they tended not to perform well.But when we paired a high GPA student with a low GPA student, and mixed up the roles driver and passenger, we found something unexpected. Thegroups that had the low GPA student as the driver performed almost as well as the groups of two high GPA students. The groups in which the high GPAstudent was the driver and the low GPA was the passenger performed almost as poorly as the groups of two low GPA students.

The message to teachers is: when you are creating groups in a makerspace, try having the "weaker" student be in control of the computer, Legos, robotickit, etc. with the help of a "stronger student.

What are the most common misconceptions around maker activities?

Our main finding was that even though kids around the world are very familiar with technology, most don't use it to create products in thephysical world but to consume them in the digital one.

In the first large scale experiment in makerspaces, we surveyed more than 1,085 students from sixth to twelfth grades in the US, Mexico and Australia,and Finland. Our work was sponsored by theNational Science Foundation, and will be published this October in the Journal of Engineering Education.We were looking at career choice, familiarity with technology and other aspects. Our main finding was that even though kids around the world are very

familiar with technology, most don't use it to create products in the physical world but to consume them in the digital one. They play games and useFacebook, but only 30% use technology to create things in the digital worldsuch as videos, music, or a blog. And only about 15% of the studentsurveyed use technology to create physical products, such as an electronic circuit or a little robot.

It's as if they are going to the kitchen to eat, but they are not cooking.

Right. They just go to the kitchen and heat the food in the microwave, but they don't learn how to cook their own food. Because those kids are not familiarwith maker technology, they need a lot of help. Without it, they get easily discouraged and run the risk of confirming the stereotypes they already haveabout themselves: "I can't do this I'm not good at engineering."

When you are talk to school districts, do you still have to convince them that project-based learning, constructivism and making are good

pedagogical approaches?

The discussion has been less and less about the value of the activities and more about how to scale and sustain them. That's great news because we haveless resistance to the idea of Maker Ed. But we still have to build careful models of implementation so that we can survive the hype.

Continue Reading

Add Comment
https://www.asee.org/papers-and-publications/publications/jeehttp://www.nsf.gov/


10/13



Add Comment

Close

Comments

More Articles in Research

10+ Tips for Using Brain-Based Methods to Redesign Your Classroom

0 Comments Sort by

Facebook Comments Plugin

Oldest

Add a comment.. .
https://www.edsurge.com/news/2016-03-01-10-tips-for-using-brain-based-methods-to-redesign-your-classroomhttps://developers.facebook.com/docs/plugins/comments/https://www.facebook.com/alex.garcia.733https://www.edsurge.com/news/2016-03-01-10-tips-for-using-brain-based-methods-to-redesign-your-classroomhttps://www.edsurge.com/news/research


11/13



Making Technology Click in the Classroom: Teachers Share What Makes Digital Tools Worth The Time

It Takes Two: The Practical Benefits of K-12 Public Education and Higher Ed Partnerships

10+ Tips for Using Brain-Based Methods to Redesign Your Classroom
https://www.edsurge.com/news/2016-03-01-10-tips-for-using-brain-based-methods-to-redesign-your-classroomhttps://www.edsurge.com/news/2016-04-21-it-takes-two-the-practical-benefits-of-k-12-public-education-and-higher-ed-partnershipshttps://www.edsurge.com/news/2016-03-29-making-technology-click-in-the-classroom-teachers-share-what-makes-digital-tools-worth-the-time


12/13



Making Technology Click in the Classroom: Teachers Share What Makes Digital Tools Worth The Time

Related Pages

STEM EducationAnything related to Science, Technology, Engineering, and Math education.

Assessment Driven CurriculumTools for instruction that emphasize assessing a learner's achievement on standardized tests (particularly based on state standards).

Stanford University

01/06/2016 St f d F bL ' P l Blik t i O th Effi f M k Ed It' Ab tP N t P d t | EdS N
https://www.edsurge.com/schools/stanford-universityhttps://www.edsurge.com/research/edtech-wiki/assessment-driven-curriculumhttps://www.edsurge.com/research/edtech-wiki/stem-educationhttps://www.edsurge.com/news/2016-03-29-making-technology-click-in-the-classroom-teachers-share-what-makes-digital-tools-worth-the-time


13/13



MITPrestigious Cambridge, Mass.-based university and research institution

WHO WE AREEdSurge helps schools find, select and use the right technology to support all learners.WHAT WE DO

NewsSummitsResearchJobs BoardConciergeProduct Reviews73,774

FOLLOWERS11,855TEACHER REVIEWSSTAY UPDATED IN EDTECHSubscribe To Our Newsletters

Copyright (c) 2011-2016 EdSurge Inc. All rights reserved. Every student succeeds.About EdSurge| Privacy Policy| Terms of Use| Ethics Statement| Contact
https://www.edsurge.com/contacthttp://about.edsurge.com/ethics-statementhttp://about.edsurge.com/terms-of-servicehttp://about.edsurge.com/privacy-policyhttp://about.edsurge.com/https://www.edsurge.com/signuphttps://www.edsurge.com/reviews/faqhttp://twitter.com/edsurgehttps://www.edsurge.com/product-reviewshttps://www.edsurge.com/conciergehttps://www.edsurge.com/jobshttps://www.edsurge.com/research/reportshttps://www.edsurge.com/e/summits/overviewhttps://www.edsurge.com/newshttps://www.edsurge.com/schools/mit

stanford fablearn's paulo blikstein on the efficacy of maker ed_ it's about process, not products _...

Documents