identifying the variation in ways to deal
TRANSCRIPT
![Page 1: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/1.jpg)
Identifying the variation of experiences when dealing with problems in complex systems.
John Mendoza Garcia1, 2, Monica E. Cardella1 William C. Oakes1
1Purdue University, IN2Pontificia Universidad Javeriana, Bogotá, Colombia,
South America
![Page 2: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/2.jpg)
05/03/2023 Tool to Assess Interest in PP 2
Agenda
• Introduction• Summary of literature• Research Approach• Impact
![Page 3: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/3.jpg)
05/03/2023 Tool to Assess Interest in PP 3
Introduction
• Introduction• Summary of
literature• Research
Approach• Impact
High order thinking skills
Technical knowledge
• Creativity• Critical
thinking• Design thinking• Problem
solving• Systems
thinking
![Page 4: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/4.jpg)
Who is calling?
Eng. Professional
societies
Eng. Academics
Management Scientist
Thought leaders in Eng
Ed.Industry ABET
Policy makers
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 5: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/5.jpg)
05/03/2023 Tool to Assess Interest in PP 5
Why?
Technological systems
EnvironmentHuman systems
designing and implementing solutions – Sustainable products– Processes– Organizations– Public policies.– Etc.
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 6: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/6.jpg)
05/03/2023 Tool to Assess Interest in PP 6
We have been teaching Systems Thinking for several years…
• Why perception says… engineers lack its development? • Why research findings show failure in its learning?
But…
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 7: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/7.jpg)
05/03/2023 Tool to Assess Interest in PP 7
Curriculum design
Effective curriculum design
Achievement of learning goals
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 8: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/8.jpg)
05/03/2023 Tool to Assess Interest in PP 8
Curriculum design
Effective curriculum design
Achievement of learning goals
How can we know if my curriculum is working??
Guilty?
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 9: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/9.jpg)
05/03/2023 Tool to Assess Interest in PP 9
Curriculum design
05/03/2023 TravelGrant 9
Content
Assessment Pedagogy
We need to know effectiveness of teaching of Systems Thinking • Introduction
• Summary of literature
• Research Approach
• Impact
![Page 10: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/10.jpg)
Assessment Triangle (Pellegrino, 2002)
05/03/2023 TravelGrant 10
Observation Interpretation
Cognition
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 11: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/11.jpg)
Research questionIteration 1
–How people develop systems thinking?
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 12: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/12.jpg)
What do we know about the development of systems thinking and its assessment?
- Studies from expert’s point of view- Lineal path based on Bloom: Hooper and Stave (2008)
- Studies from learner’s point of view (qualitative)- Frank, 2000
- 30 Laws for Capacity for Engineering systems thinking- Richmond, 2001
- A subset of 7 critical thinking skills- Davidz, 2006
- experiential learning, individual characteristics and supportive environments key to develop systems thinking
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 13: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/13.jpg)
Variation theory of learning
learning is about an increase of the amount of critical aspects and features the learner can discern and be focused on simultaneously [from a dimension or conception]. (Marton, 2014, p. 60
Learning can be seen as moving from one way of seeing and dealing with the problem to another more powerful (Marton, 2014)
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 14: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/14.jpg)
05/03/2023 Tool to Assess Interest in PP 14
This study’s research question
“what are the variations in the ways people experience dealing with problems in complex systems?”
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 15: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/15.jpg)
05/03/2023 Tool to Assess Interest in PP 15
• Introduction• Summary of
literature• Research
Approach• Impact
Engineering complex systems
Complexity
Environmental
Technological
Humans
![Page 16: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/16.jpg)
05/03/2023 Tool to Assess Interest in PP 16
• Introduction• Summary of
literature• Research
Approach• Impact
Development of systems thinking from learner’s point of view
Davidz, H,. (2006)
Graphic from Richmond. (1990)
![Page 17: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/17.jpg)
05/03/2023 Tool to Assess Interest in PP 17
Systems thinking inventoryand its test
Identify intuitive systemsthinking
Measuring change ofmental models
Assessment ofsystems thinking
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 18: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/18.jpg)
05/03/2023 Tool to Assess Interest in PP 18
Variation theory of learning
Transfer of learning Conceptual change
Cognitive/constructivist learning theories
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 19: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/19.jpg)
05/03/2023 Tool to Assess Interest in PP 19
• Introduction• Summary of
literature• Research
Approach• Impact
Phenomenography
• Understanding the variation in how “we “see” the world and how it “shows itself” to us (Marton, 2014, p. 122)
• Main assumption– limited number of qualitatively different ways
![Page 20: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/20.jpg)
05/03/2023 Tool to Assess Interest in PP 20
• Introduction• Summary of
literature• Research
Approach• Impact
Phenomenography
Figure 1- Points of departure between phenomenography and other research approaches. Trigwell (2000)
![Page 21: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/21.jpg)
05/03/2023 Tool to Assess Interest in PP 21
Data Collection
How many participants?– I will recruit 20 participants for this study• 10 students• 10 professionals
20 – 30 (Bowden, 2005)10-15 (Trigwell, 2000)10 (Harding, 2013)20 (Sandberg (2000), citing
Alexandersson (1994) who cited more than 1000 research and 50 doctoral theses)
17 Sandberg (2000)
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 22: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/22.jpg)
05/03/2023 Tool to Assess Interest in PP 22
Data Collection
• Undergraduate students–Random survey to capture variation
• Graduate/Professionals– Purposeful sampling –maximize variation
• Criteria for variation– Framework: Enablers of systems thinking
(Davidz,2006)
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 23: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/23.jpg)
05/03/2023 Tool to Assess Interest in PP 23
Data Collection
• Think aloud• 5 tasks tested – 2 chosen.
– Scene it! – Wolves and Rabbits (L. B. Sweeney & Sterman, 2007)– The manufacturing case: (L. Sweeney & Sterman, 2001)– The coffee challenge (Purzer, Ş. & Wertz, 2013). – Disaster relief scenario (Adams et al., 2010)
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 24: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/24.jpg)
05/03/2023 Tool to Assess Interest in PP 24
Data Analysis
Marton’s approach- Look for different ways to address the problem- Have them in one place- Rip them off their context and the participant- Define different categories- Define a hierarchy
- Simple to powerful
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 25: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/25.jpg)
05/03/2023 Tool to Assess Interest in PP 25
Data Analysis
Marton’s approach- Look for different ways to address the problem- Have them in one place- Rip them off their context and the participant- Define different categories- Define a hierarchy
- Simple to powerful
• Introduction• Summary of
literature• Research
Approach• Impact
![Page 26: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/26.jpg)
05/03/2023 Tool to Assess Interest in PP 26
Data Analysis
• Introduction• Summary of
literature• Research
Approach• Impact
Expected outcome
Ways to address the task, from less to more powerful
![Page 27: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/27.jpg)
05/03/2023 Tool to Assess Interest in PP 27
• Introduction• Summary of
literature• Research
Approach• Impact
• Maybe one of firsts theories cognitive theories about systems thinking development from engineering education
• Several disciplines and fields in academy and in industry– Assessment!– Curriculum design
Impact
![Page 28: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/28.jpg)
05/03/2023 Tool to Assess Interest in PP 28
• Introduction• Summary of
literature• Research
Approach• Impact
• Current programs could support claims• Application of variation theory of learning
Impact
![Page 29: Identifying the variation in ways to deal](https://reader035.vdocuments.site/reader035/viewer/2022062904/58805abf1a28ab0b098b45fd/html5/thumbnails/29.jpg)
05/03/2023 Tool to Assess Interest in PP 29
Thank you …