Miriam Kramer, EPI Jennifer Massey, Queen s University John Pollard, York University Sybil Wilson, Niagara College

Similar documents
How do we know what we know?

Prepared by the Policy, Performance and Quality Assurance Unit (Adults) Tamsin White

2. Choose the location and format for focus groups or interviews

Organize a Community Forum Contents

Running surveys and consultations

How to Sell Yourself in a Job Interview

FOCUS GROUP KIT - Experiences of delivering Let s Read - - Families experiences of Let s Read -

Section 4: Key Informant Interviews

Assessing Research Protocols: Primary Data Collection By: Maude Laberge, PhD

Interviewing. Structure/Format of an Interview The typical structure of an interview is as follows:

Interview as a Method for Qualitative Research

Single and Multiple-Case Study Designs IS493

Goals, Objectives and Norms

Evaluating Training. Debra Wilcox Johnson Johnson & Johnson Consulting

Needs Assessment Proposal

Semi-structured interviews

User research for information architecture projects

Fraser Health Research Skills Workshop: The ABC s of Focus Groups and Interviews

National Disability Authority Resource Allocation Feasibility Study Final Report January 2013

WORKBOOK D: CONDUCTING FOCUS GROUPS

Planning a Successful Lobby Day

Qualitative Interview Design: A Practical Guide for Novice Investigators

Conducting Formative Research

Conversation Toolkit. Guide. To assist individuals and groups to participate in the development of the Metropolitan Planning Strategy.

The Focus Group Interview and Other Kinds of Group Activities

GUIDE TO CONDUCTING FOCUS GROUPS FOR COMMUNITY-BASED RESEARCH AND EVALUATION April 2011

Using Focus Groups to Enhance Your Evaluation

Start Right. Week 7: Student Recruitment and Lottery, Project Management

6 Essential Characteristics of a PLC (adapted from Learning by Doing)

How to Manage a Virtual Meeting

Appendix 1: Adaptable Templates

Using Focus Groups in Program Development and Evaluation


Training and supervising your research team. Qualitative Data Analysis Class Session 13

Whanganui Reputation Management Strategy

A Guide. to Assessment of Learning Outcomes. for ACEJMC Accreditation

WORKBOOK E: CONDUCTING IN-DEPTH INTERVIEWS

CHILDREN AND ADULTS SERVICE RESEARCH APPROVAL GROUP

Exploratory Research & Beyond

Identifying Risk Factors for Suicide and Barriers to Behavioral Health Care in Military Populations Using Focus Groups

Stakeholder Engagement Working Group

COMPETENCY ACC LEVEL PCC LEVEL MCC LEVEL 1. Ethics and Standards

Avoiding Bias in the Research Interview

Setting the Expectation for Success: Performance Management & Appraisal System

Qualitative Assessment in Student Affairs

JHSPH HUMAN SUBJECTS RESEARCH ETHICS FIELD TRAINING GUIDE

Student s Guide To Interviewing..

Faculty of Science and Engineering Placements. Stand out from the competition! Be prepared for your Interviews

Grant Proposal Outline

Psych 204: Research Methods in Psychology

Interviewing Strategies & Tips. Career Center For Vocation & Development

Brenda M. Joly, PhD, MPH Master of Public Health Program University of Southern Maine

Measuring Success: A Guide to Becoming an Evidence-Based Practice

Advantages of the Phone Interview. Types of Telephone Interviews. What to Expect

CAREERS & ENTREPRENEURSHIP

Patient Engagement Workbook

A Newcomers Guide to Market and Social Research

Title Block. Ontario College of Teachers Thinking About Teaching?

Conducting A Communications Audit

Focus Groups. Best Practices in Research & Evaluation. What Is a Focus Group? About ETR Best Practice Guides. Focus Group

Your Guide to Hosting a School Board Trustee All Candidates Meeting

Functionality Is the app functional? Do users feel that the sequence of screens makes sense? How would they use the app in real life?

9. Data-Collection Tools

III. Best Practices/Resources

Motivation: Igniting Exceptional Performance

ICF CORE COMPETENCIES RATING LEVELS

INSTITUTIONAL QUALITY ASSURANCE POLICY

Tools for Visioning. In Visioning Basics, we pointed out that it is not often difficult to get people

Research Ethics Review Committee (WHO ERC)

The Financial Advisor Opportunity at Edward Jones

EFFECTIVE TIME MANAGEMENT. Instructor s Workbook

INTERVIEW QUESTIONS AND ASSIGNMENT EXAMPLES

Office of Leadership Activities 815 North Broadway Saratoga Springs New York

STUDENT ACTIVITIES STUDENT ORGANIZATION ANNUAL CERTIFICATION PACKET

12. Event Planning and Evaluation

Lesson 3: HOW TO WRITE INTERVIEW QUESTIONS

APPLICATION FOR BOARD OF DIRECTORS AND BOARD COMMITTEES

Components of a Reading Workshop Mini-Lesson

Lights! Camera! Action! How to put on a perfect filmscreening

Community Assessment Tools. A Companion Piece to Communities in Action: A Guide to Effective Projects (605A)

EVENT PLANNING CHECKLIST

Patience In Patient Recruitment

Consulting Performance, Rewards & Talent. Measuring the Business Impact of Employee Selection Systems

The Problems With Combining Telephone and Online Survey Data In Market Research

Event Planning Activity Learning Center FACS Classroom. Carson-Newman College

Gender Sensitive Data Gathering Methods

Administration of Academic Advising

ADHS-BTCD Evaluation Training 2

How to Run a Focus Group

Accreditation at Highly Accomplished and Lead Teacher. Information for Referees

Section 2b: Observation/Feedback Approach

Request for Proposal For Qualitative Research to Increase Viewing Frequency and Loyalty

General Dental Council Website Review: Dental Professionals Survey Invitation to Tender

Arizona Association of Student Councils

PREPARATION: - facilitator coordinates focus of panel, introduces and summarizes - briefs panel

Your Portfolio. A portfolio shows examples of your work and may include the following items from events you have planned, or been involved with:

Interviews and Focus Groups in Advertising, Public relations and Media

Survey Research. Classifying surveys on the basis of their scope and their focus gives four categories:

Theatre Bay Area General Auditions FAQ (for actors)

Developing an implementation research proposal. Session 2: Research design

Transcription:

Focus Groups Miriam Kramer, EPI Jennifer Massey, Queen s University John Pollard, York University Sybil Wilson, Niagara College

What is a focus group? Focus groups are group interviews. A moderator guides the interview while a small group discusses the topics that the interviewer raises. What the participants say during their discussions are the essential data in focus groups. Typically, there are six to eight participants who come from similar backgrounds, and the moderator is a well- trained professional who works from a predetermined set of discussion topics (Morgan, 1997).

What is a focus group? A carefully planned discussion designed to obtain perceptions on a defined area of interest in a permissive, nonthreatening environment. It is conducted with approximately 7 to 10 people by a skilled interviewer. Group members influence each other by responding to ideas and components in the discussion. (Krueger, 2000)

What is a focus group? A rich, wide-ranging discussion which is grounded in the perspective of the participants Used in marketing research, policy and program evaluation, needs assessments, qualitative research, and assists with survey development Not meant to replace surveys, focus groups gather a range of experiences around a particular topic but do not explain how many people feel the same way Appear relatively straightforward, but require a certain rigour: designing questions, recruiting participants, ethics, trained moderator, analyzing data

What is a focus group? Discussion guide about 12 questions - pre-scripted or conversational? Moderator main tasks are topic coverage and traffic control Ice-breaker question to begin, track topics throughout Degree of moderator involvement how to probe - moderator bias? Create an environment where participation is possible, handling monopolizers Give everyone a chance to have one final comment on topic of interest

What is a focus group? Every group has its own dynamic and you need to acknowledge the participants priorities if you want to hear what they have to say. Put simply, it is your focus, but it is their group (Morgan, 1997).

Why conduct a focus group? Selecting/designing an instrument Factors to consider: Why am I doing this? Purpose of the assessment Type of assessment outcomes Methodology Resource availability Audience expectations Focus group versus interviews i

Why conduct a focus group? In-depth understanding Rich descriptive details Understand and explain the way in which individuals make meaning of a situation, experience, or concept Unpack embedded ideas

Why conduct a focus group? Mixing Methods Focus group data to design quantitative instrument Focus group to explain quantitative data

How Do I Conduct a Focus Group? Who? Logistical Nuts and Bolts Determine inclusion and exclusion criteria Participants with the same characteristics or different? Friends or strangers? How many? How many groups? exploratory (3-4) or detailed (8-12) minimum of two! How many people? Ideal size is about 7-8; maximum is 10; over recruit for no-shows

How Do I Conduct a Focus Group? Where? Logistical Nuts and Bolts Quiet, confidential, comfortable location Seated so everyone can be seen Acoustics are important College or university board room, library, hotel, research centre, etc. Do you need a viewing room (do your clients want to observe)? What kind of audio/video equipment is necessary? When? Time of day (who s your target population and when is good for them?) Date within research project: you will need (ideally) about a month s time to pull it all together. You should take this into consideration when planning your research timeline.

How Do I Conduct a Focus Group? Timeline At Least One Month Prior to Groups Undergo any necessary research ethics processes and protocols (at least one month in advance, depending on ethics review guidelines and calendar) Figure out honoraria amounts Find and book location (at least three weeks in advance; will need to solidify location before recruiting so you can ideally invite participants to groups at a particular location) If necessary, find and book a group moderator Main tasks are topic coverage and traffic control Important for them to be viewed as objective as possible; must not directly be involved in the project/service that is being investigated or reviewed.

How Do I Conduct a Focus Group? Timeline At Least Three Weeks Prior Draft recruitment t screener and dfind a recruiter Consider inclusion and exclusion criteria Hire marketing firm or staff/assistant Important that they are not directly involved in the program/service that is being researched Recruit How are you going to recruit (e.g. posters, email, flyers, phone calls, website, mixed, etc.

How Do I Conduct a Focus Group? Two Weeks Prior Timeline Continue recruiting in earnest Draft discussion guide: What are the research questions? Includes moderator introduction and ice breaker Order food and drinks Appropriate to audience and time of day Have honoraria ready Several Days Prior Gather supplies/make sure facility has: audio/video recorder, name tags, wipe board, paper, pens, sign in sheets Confirm participants and recruit more as necessary: one to two nights before

How Do I Conduct a Focus Group? Timeline Day/Night of Groups Get final confirmed list; sign in sheets; informed consent Meet and greet participants; check identification and sign informed consent Conduct focus group GOOD LUCK! After the Groups Listen/View recordings Transcribe groups Produce report Evaluate yourself Did you get the research you were looking for? Did you ask the right questions? Are you/your client satisfied? What can you do better for next time?

Challenges of Focus Groups Recruitment t Participation Confidentiality Recording

Challenges of Focus Groups Recruitment Recruiting participants Selection Representative ti sample

Challenges of Focus Groups Maintain participation of group members There eemight beado dominant voice in the group Some members of the group might need encouragement to speak Silence might require the moderator to do additional probing

Challenges of Focus Groups Confidentiality Cannot guarantee a confidentiality of information among group members No guarantee that signing a Statement of Confidentiality means that group members will not talk about the issues outside of the focus group setting

Challenges of Focus Groups Recording Locating the recording device so it captures all voices in the group clearly If recording with videotape, a challenge is for the technician to be unobtrusive so as not to distract participants Transcriptionist may have difficulty distinguishing voices of individuals consistently

Challenges of Focus Groups What other challenges can you think of?

Questions? Miriam Kramer Senior Research/Policy Analyst Educational Policy Institute 207-20 Maud Street Toronto, ON M5V 2M5 Phone: (416) 848 0215, ext. 227 Fax: (416) 849 0500 E-mail mkramer@educationalpolicy.org Web: www.educationalpolicy.org Jennifer Massey Coordinator Assessment, Evaluation & Outreach Associate Vice Principal & Dean of Student Affairs Queen s University 300 Gordon Hall, 74 Union Street Kingston, K7L 3N6 Phone: (613) 533 6000 ext. 74022 Fax: (613) 533 6447 www.queensu.ca/studentaffairs/assessment.html Sybil Wilson, Ph.D. Articulations Facilitator Niagara College St. Catharines, L0S 1J0 Phone: (905) 227-2652 E-mail: sywilson@niagaracollege.ca John Pollard Project Manager, Focus Groups and Qualitative Research Institute for Social Research (ISR) York University, 4700 Keele Street t Toronto, M3J 1P3 Phone: (416) 736 5446 Fax: 416-736-5749 Email: isrnews@yorku.ca Web: www.isr.yorku.ca