Mixed Methodologies

Philip Adu, Ph.D. Methodology Expert

National Center for Academic & Dissertation Excellence (NCADE) The Chicago School of Professional Psychology

Research Approaches Quantitative approaches

Descriptive study Correlational study Quasi-experimental study Experimental study

(Creswell, 2007; Keele, 2011; Plano Clark & Creswell, 2008)

Qualitative approaches Narrative Phenomenology Grounded theory Ethnography Case study

Philosophical assumptions 1. Objectivity 2. Generalizability 3. Deductive reasoning 4. breadth 5. Numbers

1. Subjectivity 2. Contextualization 3. Inductive reasoning 4. Depth 5. Words

Mixed Methods Research Outline

1. Definition 2. Essence

3. Emergence 4. Philosophical Foundations

5. Design Purposes 6. Features

7. Types 8. Designing & Conducting

Definition of Mixed Methods Research

Collecting, analyzing, and interpreting qualitative and quantitative data in a single study

Integrating/mixing quantitative and qualitative data, findings, and/or interpretations

(Hanson, Creswell, Plano Clark, Petska, & Creswell, 2005)

Essence of Mixed Methods Research

1. Enriching the findings 2. Increasing the depth and breadth 3. Testing a theory or model 4. Seeking for participants inputs

(Hanson, et. al., 2005)

Emergence of Mixed Methods Research

Using multiple data collection methods A study by Campbell and Fiske (1959): Construct validity assessment Collecting multiple quantitative data

Completing questionnaire Conducting observations Measuring performance

Multitrait-multimethod matrix

Applying the concept of triangulation to research

A term from the military – using multiple points to find the precise location of an object The strength of one method offsetting the weakness of

another – complementary purpose (Hanson, et. al., 2005; Trochim, 2006)

Philosophical Foundations

Paradigm underlying mixed methods research Pragmatist perspective: Focuses on “what works” – using the appropriate method Theoretical lens underlying mixed methods is pragmatism

Transformative perspective: Critique of pragmatist perspective – “what works for who?” Concern with addressing the needs of the marginalized

‘Dialectical’ perspective: Freedom to choose appropriate method Paradigm chosen should be consistent with research problem

and researcher’s beliefs Not affiliated to a specific theoretical lens or paradigm

(Hanson, et. al., 2005; Mertens, 2003)

Purpose of mixed methods design 1. Triangulation Using different methods to address the same phenomenon

2. Complementarity Using different methods to address the different parts of a

phenomenon

3. Development Using the results of one method to inform the other method

4. Initiation Looking for contradictory results and using different method to

collect data to explain the discrepancy.

5. Expansion Increasing the depth and/or breadth of a study by using different

methods Using different methods to address the different parts of a

phenomenon (Greene, Caracelli & Graham, 1989)

Features of Mixed Methods Design

(Hanson, et. al., 2005; Plano Clark & Creswell, 2008)

Types of Mixed Methods Design Sequential Designs

(a) Sequential Explanatory Design (b) Sequential Exploratory Design (c) Sequential Transformative Design

Concurrent Designs (a) Concurrent Triangulation Design (b) Concurrent Nested Design (c) Concurrent Transformative Design

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Sequential Designs

Theoretical Lens

Timing Integration Purpose Priority

Implicit (Post-positivist

lens)

Sequential – beginning with

quantitative phase

Interpretation stage

Complementarity and/or

expansion

Quantitative data

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Sequential Designs

Theoretical Lens

Timing Integration Purpose Priority

Explicit (constructivist

lens)

Sequential – beginning with

qualitative phase

Data analysis (connected) and Interpretation

stages

Development, complementarity,

and/or expansion

Qualitative data

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Sequential Designs

Theoretical Lens

Timing Integration Purpose Priority

Explicit – advocacy

lens

Sequential – beginning with

either quantitative or

qualitative phase

Data analysis (connected) and Interpretation

stages

Complementarity, development

and/or expansion

Either quantitative or qualitative data

(Sometimes both…)

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Concurrent Designs

Theoretical Lens

Timing Integration Purpose Priority

Implicit Concurrent Data analysis (Separated) and Interpretation

stages

Triangulation Equal – both quantitative

and qualitative data

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Concurrent Designs

Theoretical Lens

Timing Integration Purpose Priority

Implicit or explicit

Concurrent Data analysis (data transformed and

merged) and Interpretation

stages

Complementarity, initiation, and/or

expansion

Unequal

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Types of Mixed Methods Design (Cont.) Concurrent Designs

Theoretical Lens

Timing Integration Purpose Priority

Explicit – advocacy

lens

Concurrent Data analysis (separate) and Interpretation

stages

Complementarity, initiation, and/or

expansion

Equal or unequal

(Creswell, Plano Clark, Gutmann, & Hanson, 2003)

Designing and Conducting a Mixed Methods Study

Things to consider…

1. Working knowledge of both methods 2. Theoretical lens 3. Sequence (timing) 4. Stage to integrate 5. Purpose/rationale of the mixed methods design for

your study 6. Type of data that will be given more priority 7. Clearly define and illustrate your design

References Creswell, John W. (2013). Qualitative Inquiry and Research Design: Choosing Among Five Approaches (3rd). Thousand Oaks, CA: Sage. Creswell, J. W., Plano Clark, V. L., Gutmann, M. L., & Hanson, W. E. (2003). Advanced mixed methods research designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 209–240). Thousand Oaks, CA: Sage. Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed-methods evaluation designs. Educational Evaluation and Policy Analysis, 11(3), 255-274. Hanson, W. E., Creswell, J. W., Plano Clark, V. L., Petska, K. S., & Creswell, D. J. (2005). Mixed methods research designs in counseling psychology. Journal of Counseling Psychology, 2(55), 224-235. doi:10.1037/0022-0167.52.2.224 Keele, R. (2011), Nursing Research and Evidence-Based Practice. MA: Jones & Bartlett, LLC. Plano Clark, V. P., & Creswell, J. W. (2008). The mixed methods reader. California: Sage Publications, Inc. Trochim, W. M. (2006, October 20). The multitrait-multimethod matrix. Retrieved from Research methods knowledge base website: http://www.socialresearchmethods.net/kb/mtmmmat.php

Questions