FIRST PUT IN THE SUGAR, AND THEN ADD THE EGGS... OR IS IT THE OTHER WAY AROUND? MIXING QUALITATIVE AND QUANTITATIVE METHODS Niina Nummela RETHINKING RESEARCH METHODOLOGY 3rd Annual Conference of Doctoral Candidates of the Faculty of Education & National FinEd Conference November 16, 2016 Turku
MIXED-METHOD RESEARCH Controversy of terms Blended/multiple/combined/integrated methods Methodological mix Multi-method research Triangulation Mixed-method study is a study which involves the collection and/or analysis of both quantitative and/or qualitative data in a single study in which the data are collected concurrently or sequentially and are combined at one or more stages in the research process (Hurmerinta-Peltomäki & Nummela 2006)
MIXED-METHOD VS. QUANTITATIVE AND QUALITATIVE RESEARCH TRADITION Source: Johnson et al. (2007, 124)
SHOULD YOU/CAN YOU MIX METHODS? Yes, we can and we should it has become increasingly popular it decreases single-method bias the state of the field favours it combining different data and methods has a number of benefits No, we can t and we shouldn t replication is impossible time and resource constraints competence in multiple methods required quantitative and qualitative research methods are set on different philosophical positions and should not be combined Nummela 2016
PROS AND CONS OF MIXED-METHODS RESEARCH STRATEGY (HURMERINTA-PELTOMÄKI&NUMMELA 2004, JICK 1979) Has value added Facilitation Validitation Knowledge creation Provides a holistic view of the phenomenon Compensates the weaknesses of one method with another Gives variety to research design Allows creativity Stimulates intellectual debate and thinking Combining findings into a coherent whole what if they do not converge? A never-ending story? New questions keep arising A process which you cannot predict the role of unexpected events? A validity challenge impossible to replicate? How to find the balance between your effort and the value added?
KEY DECISIONS IN MIXED METHODS STUDIES (HURMERINTA-PELTOMÄKI & NUMMELA 2004) Order sequential parallel Decisions related to mixed methods Role equal dominant less dominant Purpose
PURPOSE FOR USING MIXED METHODS (HURMERINTA-PELTOMÄKI & NUMMELA 2006) To facilitate the research process e.g. to form a sample or to find potential informants To increase the validity of the findings e.g. to test constructs or create preunderstanding To add to existing knowledge base with new type of knowledge creation e.g. deeper understanding of the phenomenon in question
The fundamental principle of mixed-method research: The research should strategically combine qualitative and quantitative methods, approaches and concepts in a way that produces complementary strengths and nonoverlapping weaknesses. (Johnson et al. 2007, 127) Niina Nummela
Levels of valued-added of mixed methods INITIAL Facilitation: (a) to gather information about the object or/and the subject for preunderstanding, research-problem formulation and theory selection, (b) to find the informants and data; to define (c) the sample, (d) the data-collection method, and (e) the constructs and measures. INITIAL IMPLEMENTATION INTEGRATION INTERPRETATION Validity checking at the initial phase: (a) to define the constructs and measures, (b) to pre-test the measures, (c) to test the acceptability and understandability of the questions, (d) to test the structure and length of the questionnaire, (e) to define the data-collection method. Validity checking at the implementation, integration and interpretation phases: to cross-check the data and results Hurmerinta-Peltomäki & Nummela 2006 INTEGRATION INTERPRETATION Knowledge creation: (a) illustrative knowledge (b) supportive knowledge, (c) dis/confirmative knowledge (d) more detailed knowledge (e) explanatory knowledge Phases of the research process
TRUSTWORTHINESS IN MIXED-METHOD RESEARCH validity of qualitative data and analysis validity of quantitative data and analysis validity of the mixed-method study (Ihantola & Kihn 2011) integrative framework design suitability & adequacy/fidelity, analytical adequacy, withindesign consistency interpretive rigour (consistency, agreement, distinctiveness, efficacy) legitimation framework continuous, iterative and interactive process sample integration, inside-outside, weakness minimization, conversion, paradigmatic mixing, commensurability, multiple validities Niina Nummela
RECOMMENDED LITERATURE (1) Brannen, M.Y. (1996). Ethnographic international management research. In B.J. Punnett & O. Shenkar (Eds.), Handbook for International Management Research (pp.115-143). Cambridge, MA: Blackwell. Caracelli, V.J. & Greene, J.C. (1993) Data analysis strategies for mixed-method evaluation designs, Educational Evaluation and Policy Analysis, Vol.15 No.2, 195-207. Creswell, J.W. & Plano Clark, V.L. (2007) Designing and conducting mixed methods research, Sage Publications: Thousand Oaks. Edmondson, A.C. & McManus, S.E. (2007) Methodological fit in management field research, Academy of Management Review, Vol. 32 No.4, 1155 1179. Handbook of mixed methods in social and behavioral research (2003) Tashakkori, A. and Teddlie, C. (eds.), Thousand Oaks: Sage Publications.
RECOMMENDED LITERATURE (2) Hurmerinta-Peltomäki, Leila Nummela, Niina (2006) Mixed methods in international business research. A value added perspective, Management International Review, Vol.46 No.4, 439-459. Hurmerinta-Peltomäki, Leila Nummela, Niina (2004) First put in the sugar, and then add the eggs or is it the other way round? Mixing qualitative and quantitative methods in international business research, In: Handbook of Qualitative Research Methods in International Business, eds. Marschan-Piekkari, R. Welch, C., Edward Elgar: Cheltenham, UK, 162-180. Jick, T.D. (1979). Mixing qualitative and quantitative methods: triangulation in action. Administrative Science Quarterly, 24 (4): 602 11. Journal of Mixed Methods Research (Sage) all volumes
Niina Nummela Thanks!