performance prediction: truths and falsehoods
DESCRIPTION
Performance Prediction: Truths and Falsehoods. Dr. Jordan B Peterson Professor of Psychology University of Toronto. What do psychologists do?. Pursue scientific truth Pursue careers. How to pursue scientific truth. MEASUREMENT If the phenomenon cannot be measured It does not exist. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/1.jpg)
Performance Prediction: Truths and Falsehoods
Dr. Jordan B PetersonProfessor of Psychology
University of Toronto
![Page 2: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/2.jpg)
What do psychologists do?
• Pursue scientific truth• Pursue careers
![Page 3: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/3.jpg)
How to pursue scientific truth
• MEASUREMENT– If the phenomenon cannot be measured
• It does not exist
![Page 4: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/4.jpg)
How to pursue scientific truth, continued
• CONSTRUCT VALIDATION– Multimethod, multitrait
• Analogous to sensory analysis– Five senses, not one– Plus intrasubjective measurement– Plus technological extension of sensory analysis
![Page 5: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/5.jpg)
Use statistics destructively
• Aim at demolishing your effect
![Page 6: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/6.jpg)
How to pursue a career
• Invent a scale (or a construct)– Or rename a scale that already exists
• Refuse to validate it– No convergence– No divergence– No criterion– No multimethod, multitrait analysis
• Correlate it with some phenomenon
![Page 7: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/7.jpg)
How to pursue a career, continued
• Publish the paper• Establish a small primate dominance hierarchy
– Based on the scale– Climb the hierarchy
• Use statistics selectively– Very selectively
• Enjoy the fruits of your success!– But seriously distort the knowledge base– And spend your time chasing red herrings
![Page 8: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/8.jpg)
NATURE | NEWS FEATURE
• Replication studies: Bad copy– In the wake of high-profile controversies,
psychologists are facing up to problems with replication.
• Ed Yong– 16 May 2012
![Page 9: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/9.jpg)
Things that might not exist
• Self-esteem– (neuroticism – extraversion)– 25000 published papers
• Whole political and educational agendas
• Working memory and EF– IQ?
• Emotional intelligence– Agreeableness
![Page 10: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/10.jpg)
Things that might not exist
• Grit• MacArthur Genius Grant (Angela Duckworth)• Martin Seligman (positive psychology)• Conscientiousness
• Optimism/Pessimism– Extraversion/neuroticism
• Promotion/prevention– Extraversion/conscientiousness
![Page 11: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/11.jpg)
Things that might not exist
• Empathy– Measures do not correlate well, but distill to
agreeableness
• Psychopathy– Agreeableness, negative, minus conscientiousness– Predatory parasite
![Page 12: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/12.jpg)
Things that might not exist
• Positive illusions– Extraversion, by Taylor’s own analysis
• Practical intelligence– Sternberg is a crook
• Multiple intelligences– Gardner is a crook
![Page 13: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/13.jpg)
Things that might not exist
• Any questionnaire measure independent of the Big Five
• Any measure of cognitive function independent of IQ
• Any behavioral measure of a trait, independent of IQ and the Big Five
![Page 14: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/14.jpg)
Things that might exist
![Page 15: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/15.jpg)
Individual Differences
• Contextual and individual factors
– Contextual• Cultural factors• Peer networks• Social support
– Individual• Personality• Cognitive ability
![Page 16: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/16.jpg)
Personality
![Page 17: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/17.jpg)
TraitsMeasurement
ItemsEmployment Variables
Economic Value
![Page 18: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/18.jpg)
Traits
![Page 19: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/19.jpg)
STABILITY Emotional Stability
Agreeableness
Industriousness
Orderliness
Politeness
Compassion
Conscientiousness
Volatility (r)
Withdrawal (r)
![Page 20: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/20.jpg)
PLASTICITY
Extraversion
Openness
AssertivenessEnthusiasm
CreativityIntellect
![Page 21: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/21.jpg)
Personality• Extraversion
– Happiness, optimism, enthusiasm, gregariousness, assertiveness• Neuroticism
– .2-.3 with major life outcomes• Particularly anxiety and depression, since that’s what it measures
• Agreeableness– Compliance, empathy, maternality, kinship– criminality
• Conscientiousness– .4 with major life outcomes
• Openness– Creativity, intelligence
• Disagreeable/neurotic– Personality disorders
• Gender differences– 75% classification accuracy
![Page 22: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/22.jpg)
Emotion & Motivation• Extraversion
– Incentive reward (hope, curiosity, play, enthusiasm)/dopamine– Harvest attention/approach and exploit social situations
• Neuroticism– Pain, frustration, disappointment, fear, anxiety/GABA, Serotonin– Avoid threat, uncertainty and punishment
• Agreeableness– Empathy, sympathy, compliance, CARE (Oxytocin)– Form intimate relationships and share
• Vs
– Pursue individual agenda/defend territory– People vs things
• Conscientiousness– Orderliness: DISGUST– Industriousness: GUILT, SHAME– Maintain order
• Stay uncontaminated and sparkly clean
– Implement goals• Openness
– Manipulate abstractions prior to implementation– General Cognitive Ability– Awe, curiosity– Non-social incentive reward/dopamine
![Page 23: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/23.jpg)
Models are grounded in motivation
Capitalize on social groupsMaintain order
![Page 24: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/24.jpg)
![Page 25: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/25.jpg)
Measurement
![Page 26: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/26.jpg)
Items
![Page 27: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/27.jpg)
Measurement• Trait Measures
• Big Five Aspect Scale• Unfakeable Big Five
• General cognitive ability• Fluid• Crystallized• Dorsolateral prefrontal
• Creativity • Creative Achievement Questionnaire• Divergent thinking and fluency
![Page 28: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/28.jpg)
(BFAS) Conscientiousness
• Industriousness– Waste my time (r)– Always know what I am doing
• Orderliness– Am not bothered by disorder (r)– Follow a schedule
![Page 29: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/29.jpg)
(BFAS) Emotional Stability
• Volatility– Get angry easily– Keep my emotions under control
• Withdrawal– Seldom feel blue– Am filled with doubts about things
![Page 30: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/30.jpg)
(BFAS) Agreeableness
• Politeness– Respect authority– Believe that I am better than others (r)
• Compassion– Am not interested in other people’s problems (r)– Take no time for others (r)
![Page 31: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/31.jpg)
(BFAS) Openness
• Creativity– Believe in the importance of art– Love to reflect on things
• Intellect (but see general cognitive ability)– Am quick to understand things– Can handle a lot of information
![Page 32: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/32.jpg)
(BFAS) Extraversion
• Assertiveness– Take charge– Lack the talent for influencing people (r)
• Enthusiasm– Make friends easily– Am hard to get to know (r)
![Page 33: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/33.jpg)
Unfakeable Big Five (+)
![Page 34: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/34.jpg)
Unfakeable Big Five (-)
![Page 35: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/35.jpg)
Cognitive Ability
• The complexity of the world– Motivated ends must be met– Modeling of possibility prior to implementation
• Models generate solutions to three problems:– Where are you?– Where are you going?– How are you going to get there?
– Allows testing and failure• Popper: “Our hypotheses die in our stead”
![Page 36: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/36.jpg)
Conceptions of cognitive ability
– INTELLIGENCES–Practical vs analytical–Social, emotional, moral–Multiple: linguistic, musical, logical-mathematical, spatial, body-kinesthetic, intrapersonal, interpersonal
– INTELLIGENCE–Highest strata has the most explanatory power
» “g” measures “success” across broad domains» r ~ .50
![Page 37: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/37.jpg)
![Page 38: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/38.jpg)
Effect Size
• Relative magnitude
• r= .50 90-97%ile• r= .35-.50 75-90%ile• r= .15-.35 25-57%ile• r< .15 0-25%ile
• Hemphill, J.F. (2003). Interpreting the magnitudes of correlation coefficients. American Psychologist, 58, 78-8.
• Binomial
– Predictor r = .30• From 50/50• To 65/30
– Predictor r = .50• From 50/50• To 75/25
![Page 39: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/39.jpg)
General Cognitive Ability
![Page 40: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/40.jpg)
Creativity
• Visual Arts (painting, sculpture)• 0. I have no training or talent in this area.• 1. I have taken lessons in this area.• 2. People comment on my talent in this
area.• 3. I won one or more prizes at juried art
shows.• 4. I showed my work in a gallery.• 5. I sold a piece of my work.• 6. My work was critiqued in local
publications.• 7. My work was critiqued in national
publications.
• Inventions• 0. I do not have recognized talent in this area.• 1. I find novel uses for household objects.• 2. I sketched out an invention and worked on
its design flaws.• 3. I created original software for a computer.• 4. I built a prototype of one of my designed
inventions.• 5. I sold an inventions to people I know.• 6. I received a patent for one of my inventions.• 7. I sold an invention to a manufacturing firm.
Creative Achievement Questionnaire
![Page 41: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/41.jpg)
Employment Variables
![Page 42: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/42.jpg)
Complexity
Inno
vatio
n
Hi/HiEntrepreneurial
Lo/HiManagerial/Administrative
Lo/LoRote Tasks
Hi/Lo
![Page 43: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/43.jpg)
Who suits which position?
• Cognitive ability
• High levels of fluid and executive intelligence– Decision making and planning– Research
• High levels of retrieval– Creativity and ideational production– Leadership and public speaking
• High levels of crystallized intelligence– Information dispensing and storage– Writing and lecturing
![Page 44: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/44.jpg)
Who suits which position?
• Specific Performance• Openness (r = .30 - .40)
– Associated with high levels of creativity/entrepreneurial ability
– Extraversion (r = .20)» Managers» Sales People» Leadership
– Agreeableness» Lower levels associated with creativity/managerial excellence» Higher levels for public relations, customer service (?)
![Page 45: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/45.jpg)
Openness
• Complexity and Intelligence
• Innovation and Creativity
![Page 46: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/46.jpg)
Conscientiousness
• Duty and Industriousness
• Disgust and Orderliness
![Page 47: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/47.jpg)
Employment Variables II
• Emotional Stability• High vs Low Stress
• Agreeableness• People vs Things
• Extraversion• Solitary vs Gregarious
![Page 48: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/48.jpg)
Economic Value
![Page 49: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/49.jpg)
Complexity and cognitive ability
• 95-86 percentile– IQ 130 – 116
• 85-73 percentile– IQ 115-110
• Attorney, Research Analyst• Editor, Advertising Manager• Chemist, Engineer, Executive• Manager, Trainee, • Systems Analyst, Auditor
• Copywriter, Accountant• Manager/Supervisor • Sales Manager • Sales, Programmer• Analyst, Teacher, Adjuster• General Manager • Purchasing Agent• Registered Nurse• Sales Account Executive
![Page 50: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/50.jpg)
Complexity and cognitive ability
• 70-60 percentile
– IQ 108-103
• 55-50 percentile– IQ 102-100
• Administrative Assistant• Store Manager, Bookkeeper• Credit Clerk. Drafter, Designer • Lab Tester/Tech, Assistant Manager • General Sales, Telephone Sales• Secretary, Accounting Clerk,• Medical Debt Collection • Computer Operator • Customer Service Rep • Technician, Automotive Salesman• Clerk, Typist
• Dispatcher, General Office• Police Patrol Officer• Receptionist, Cashier • General Clerical• Inside Sales Clerk, Meter Reader• Printer, Teller, Data Entry • Electrical Helper
![Page 51: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/51.jpg)
Complexity and cognitive ability
• 45-42 percentile
– IQ 98-95
• 37-21 percentile– IQ 93-87
• Machinist, Food Dept Manager• Quality Control Checker • Claims Clerk, Driver/Deliveryman• Security Guard, Unskilled Labor• Maintenance, Machine Operator• Arc Welder, Die Setter, Mechanic• Medical/Dental Assistant
• Messenger, Factory Production• Assembler, Food Service Worker• Nurse’s Aide, Warehouseman• Custodian/Janitor• Material Handler• Packer
![Page 52: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/52.jpg)
Economic Value I
• Predictive Power• r = .6 to r = .2
– Intelligence– Conscientiousness (managerial)– Openness Creativity (innovative)– Emotional Stability
– Agreeableness– Extraversion
![Page 53: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/53.jpg)
Economic Value II
• Binomial Effect Size
• Price’s Law
• Economic Impact of Prediction
![Page 54: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/54.jpg)
Pareto Distribution
![Page 55: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/55.jpg)
Individual variation and productivity
0 0.1 0.2 0.3 0.4 0.5 0.6
education
interest
academic achievement
training/experience ratings
interview
experience
reference check
personality
biographical inventory
job tryout
cognitive ability
prefrontal ability
![Page 56: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/56.jpg)
– Number of years– Current - Potential Predictor– Job Complexity
• High complexity = high variability
– Salary• Theoretically proportionate to output• Average output must be 2x salary
Economic value and placement
![Page 57: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/57.jpg)
![Page 58: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/58.jpg)
Process
• Advertise• Test online• Screen• Interview best candidates
![Page 59: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/59.jpg)
![Page 60: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/60.jpg)
The Founder Institute is the world's largest entrepreneur training and startup launch program, helping aspiring founders across the globe build enduring technology companies.
Based in Silicon Valley and with chapters across 35 countries, the Founder Institute has helped launch over 1,112 companies in 5 years.
The company's mission is to "Globalize Silicon Valley" and build sustainable startup ecosystems that will create one million new jobs worldwide.
![Page 61: Performance Prediction: Truths and Falsehoods](https://reader034.vdocuments.site/reader034/viewer/2022052603/56814846550346895db55bb2/html5/thumbnails/61.jpg)
• First, only roughly 30% of applicants are accepted to the program.
• Then, less than 40% of accepted Founders generally make it through the program to Graduation.
• To date, over 20,000 people have applied, and the Founder Institute can predict with 85% accuracy somebody's potential to become a successful technology entrepreneur.