bpm seminar understandability of process models a user’s perspective on learning
TRANSCRIPT
![Page 1: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/1.jpg)
BPM Seminar
understandability of process models
A user’s perspective on learning
![Page 2: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/2.jpg)
Topics
1. Context of the research
2. Theoretical Background
3. Theoretical Design & Conceptualisation
4. Measurement
5. Questions?
![Page 3: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/3.jpg)
1. Context of the research
Goal:
Defining understanding as a result of learning, how do differences in user
characteristics contribute to differences in understanding process models?
![Page 4: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/4.jpg)
An example
![Page 5: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/5.jpg)
Kick-off
• Curtis et al. (1992)
Goal:
“facilitate human understanding and communication”
Sub-goal:
“represent processes in forms understandable by humans”
![Page 6: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/6.jpg)
Gap-analysis
• Independent variables
The effect of:
task complexity
technology/process model characteristics
on performance
![Page 7: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/7.jpg)
Visualisation
Human
Data Model
Task
Performance
![Page 8: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/8.jpg)
Gap-analysis II
• Understandability defined as an intrinsic property of a process model
• Complexity, learnability, usability, etc.
• Pragmatic quality
![Page 9: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/9.jpg)
Why is this important?
• Practically:) helps representing processes in forms understandable by humans) additional insights allow for more effective
training
• Academically:) effects of users often averaged out by assuming homogeneity (or x vs. y)) Maturity of the discipline will benefit from an interdisciplinary approach
![Page 10: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/10.jpg)
2. Theoretical background
“To learn is to be human”
(Goward)
![Page 11: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/11.jpg)
Theory of Cognitive Load
• Define information integration as a learning process
• Control factors of:Content
&Content Presentation
![Page 12: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/12.jpg)
An example
WOOL
MEDDOW
GRASS
GOAT
![Page 13: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/13.jpg)
Learning Conceptualised
PRESAGE PROCESS PRODUCT
USERCHARACTERISTICS
LEARNING CONTEXT
KNOWLEDGECONSTRUCTION
LEARNINGOUTCOMES
![Page 14: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/14.jpg)
Revisions
• Controlled Learning Context
• Limited Mutuality
USERCHARACTERISTICS
KNOWLEDGECONSTRUCTION
LEARNINGOUTCOME
![Page 15: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/15.jpg)
Controlling the Learning Context
HOW?
![Page 16: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/16.jpg)
3. Theoretical Design& Conceptualisation
a Cognitive Perspective onLearning
![Page 17: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/17.jpg)
Structure
• Gap Analysis
• Introduction of a framework
• Integration into learning theory
![Page 18: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/18.jpg)
Prior to Learning
USERCHARACTERISTICS
KNOWLEDGECONSTRUCTION
LEARNINGOUTCOME
![Page 19: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/19.jpg)
User CharacteristicsGap analysis
distalvariables
affective variables psychosocial variables
skills & expertise
Agarwal et al., 1999 Cognitive Fit
Aranda et al., 2007 Domain ExpertiseLanguage Expertise
Bandara et al., 2005 User Competence
Chiew & Wang, 2004
Syntactic KnowledgeSemantic KnowledgeSchematic KnowledgeStrategic Knowledge
Maes & Poels, 2007 Perceived Ease of UsePerceived Usefulness
Perceived Semantic QualityUser Satisfaction
Mendling et al., 2007
ExperienceDomain Expertise
Patig, 2008 AgeGender
ExperienceDomain Knowledge
Reijers & Mendling,2008
EducationJob type
Domain KnowledgeCompany Experience
Field Experience
![Page 20: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/20.jpg)
Input: User Characteristics
• Identification of a framework which conceptualises user characteristics in an integrative manner
• Problem-solving is inherent to human nature
Usage of goal-setting behavioural theory
![Page 21: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/21.jpg)
Goal-setting Behavioural Theory
![Page 22: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/22.jpg)
Eight VariablesPresage
User Characteristics
Learning Context
Self-Efficacy
Skills
Attitude
Traits,Beliefs
SubjectiveNorm
PositiveAnticipatedEmotions
NegativeAnticipatedEmotions
PerceivedBehavioural
Control
Process
LearningStrategies
GoalMotives
GoalIntention
Knowledge Construction
Product
LearningOutcome
NoLearning
MeaningfulLearning
FragmentedLearning
![Page 23: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/23.jpg)
During Learning
USERCHARACTERISTICS
KNOWLEDGECONSTRUCTION
LEARNINGOUTCOME
![Page 24: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/24.jpg)
Knowledge ConstructionGap analysis
• Static Approach; hence limited availability
Cardoso et al. (2006): short- and long-term memory
chunking and tracing
Hungerford et al. (2004):
Task Planning
Others, e.g.: Central vs. Peripheral, Queues
![Page 25: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/25.jpg)
Throughput: Knowledge Construction
• Identification of a framework that describes Knowledge Creation
• Mandviwalla & Hovav (1995)
Motivational process
![Page 26: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/26.jpg)
Motivational Hub (Locke, 1991)
Motives Goals Strategy
Personal Agency Beliefs &
Expectancy
Volition
Volitional dimension
Goal
Approach to Learning
Commitment
![Page 27: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/27.jpg)
Three VariablesPresage
User Characteristics
Learning Context
Self-Efficacy
Skills
Attitude
Traits,Beliefs
SubjectiveNorm
PositiveAnticipatedEmotions
NegativeAnticipatedEmotions
PerceivedBehavioural
Control
Process
LearningStrategies
GoalMotives
GoalIntention
Knowledge Construction
Product
LearningOutcome
NoLearning
MeaningfulLearning
FragmentedLearning
![Page 28: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/28.jpg)
After Learning
USERCHARACTERISTICS
KNOWLEDGECONSTRUCTION
LEARNINGOUTCOME
![Page 29: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/29.jpg)
Learning OutcomeGap analysis
Cognitive Performance Behavioural Performance
Affective Performance
Agarwal & Karahanna, 2000
Behavioural Intention to Use
Aranda et al., 2007
Correctness of understanding Time to completion ConfidencePerceived Difficulty
Goodhue et al., 2000
Time to completion User Evaluation of consistencyUser Evaluation of training
Igbaria et al., 1997
System Usage
Mendling et al., 2007
Number of questions correct Perceived understandability
Recker & Dreiling, 2007
Number of questions correctCloze Recall testProblem Solving task
Time to task completion Ease of Understanding
Venkatesh & Bala, 2008
Use Behaviour
![Page 30: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/30.jpg)
Output: Learning Outcome
• Identification of a framework which distinguishes between different types of
understanding
![Page 31: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/31.jpg)
Motivational Hub (Locke, 1991)
Test Performance
Learning Outcome Cognitive Description Retention Transfer
No learning No knowledge Poor Poor
Rote learning Fragmented knowledge Good Poor
Meaningful learning Integrated knowledge Good Good
![Page 32: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/32.jpg)
Three VariablesPresage
User Characteristics
Learning Context
Self-Efficacy
Skills
Attitude
Traits,Beliefs
SubjectiveNorm
PositiveAnticipatedEmotions
NegativeAnticipatedEmotions
PerceivedBehavioural
Control
Process
LearningStrategies
GoalMotives
GoalIntention
Knowledge Construction
Product
LearningOutcome
NoLearning
MeaningfulLearning
FragmentedLearning
![Page 33: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/33.jpg)
Time Out
![Page 34: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/34.jpg)
Variables Explained
• Eight Presage
• Three Process
• Three Product
![Page 35: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/35.jpg)
User Characteristics
Categories Variables Sub-variables
Distal Variables Distal Variables Demographics & CultureAttitude towards targetsPersonality traits Exposure to mediaOther individual difference variables
Affective Variables AttitudePositive Anticipated EmotionsNegative Anticipated Emotions
Psychosocial Variables Subjective NormPerceived Behavioural ControlSelf-efficacy
Skills and Expertise Skills and Expertise Syntactic SkillsSemantic SkillsPragmatic SkillsExpertise
![Page 36: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/36.jpg)
Knowledge Construction
Factors Variables Sub-variables
Approach to Learning Goal Motives Fear of failureAim for qualificationIntrinsic interestCommitment to work
Goals PerformanceLearning
Learning Strategies SurfaceDeepNon-directed
![Page 37: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/37.jpg)
Learning Outcome
Variables
No learning
Rote learning
Meaningful learning
![Page 38: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/38.jpg)
4. Measurement
![Page 39: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/39.jpg)
Configuration
• What to measure?
• How to measure?
• Who to sample?
![Page 40: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/40.jpg)
What to measure?• Due to model complexity,
test a part of the model:
a) Personal data prior to learning
b) Information of their learning approach during learning
c) Questions on understanding post learning
![Page 41: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/41.jpg)
a) Personal Data
• What to collect?
Distal Variables: Personality?Demographics?Culture?
Skills: Reading skills?Studying skills?Modelling skills?
![Page 42: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/42.jpg)
Examples of Frameworks
• Frederiks & Weide (2006) Analysis Skillsincl. Handle implicit knowledge, grammatical analysis, abstract sentence structure, think on an abstract level
• Bandara et al. (2007) Content for IS SubjectsFrom focus group: analytical skills, understand the problem, ability to communicate with client
• Lindland et al. (1994) QualitySyntactic, Semantic & Pragmatic Quality
• Vanderfeesten et al. (2007) Complexity metricsincl. Coupling, Cohesion, Modularity
![Page 43: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/43.jpg)
Skills• Syntactic Skills a) Word comprehension
b) Vocabulary & syntaxII) Identify obstacles
• Semantic Skills c) Spatial abilityc) BMP modelling discoursed) experience/past behavioural skillsI) studying habitsII) identify obstacles
• Pragmatic Skills e) Working memorye) Integration capacityf) Real time self-evaluationI) Develop effective strategiesII) Problem-solvingIV) Emotional stability
![Page 44: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/44.jpg)
b) Learning Approach
• Methods available
Yet, is this useful?
![Page 45: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/45.jpg)
c) Understanding
• Methods available
• Only cognitive measurement?Indicators:Recall & Transfer
Question answered correctly Problem solving
Time?
• Incorporation of affective constructs
Cognitive Performance Behavioural Performance Affective Performance
![Page 46: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/46.jpg)
How to measure?
Qualitative vs. Quantitative
+
Ability to measure all skills
Control over context
Scope
No additional layer of interpretivism
![Page 47: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/47.jpg)
Fixed vs. Loose
• Should respondents be provided with a goal?
• Should meaningful learning be the outcome to aim for?
![Page 48: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/48.jpg)
Tests, tests, tests
some examples• Spatial ability test• Working memory
integration test• Reading ability• Understanding of story• Problem solving• Cloze Recall test• Cognitive Coupling
![Page 49: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/49.jpg)
Who to sample?
• Controlling the Learning Context
vs.homogeneity of population
• Assume group differences (e.g. expert/novice)
vs.differences by measurement
![Page 50: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/50.jpg)
Encore un foisPresage
User Characteristics
Learning Context
Self-Efficacy
Skills
Attitude
Traits,Beliefs
SubjectiveNorm
PositiveAnticipatedEmotions
NegativeAnticipatedEmotions
PerceivedBehavioural
Control
Process
LearningStrategies
GoalMotives
GoalIntention
Knowledge Construction
Product
LearningOutcome
NoLearning
MeaningfulLearning
FragmentedLearning
![Page 51: BPM Seminar understandability of process models A user’s perspective on learning](https://reader030.vdocuments.site/reader030/viewer/2022032803/56649e3f5503460f94b306ca/html5/thumbnails/51.jpg)
5. Questions?
?