Data Collection Methods

Transcription

1 Quotation Data Collection Techniques and Instruments Scientists do not collect data randomly and utterly comprehensively. The data they collect are only those that they consider *relevant* to some hypothesis or theory. Dr. Ahmed Awaisu, Ph.D, M.Pharm, B.Pharm Asst. Professor of Clinical Pharmacy and Practice College of Pharmacy, Qatar University. David Lewis-Williams, The Mind in the Cave: Consciousness and the Origins of Art Introduction to Research Methodology for Pharmacists and Health Professionals Muscat, Oman; 10 th to 12 th September, 2013 Objectives of Module At the end of this module, participants should be able to: describe the different types of data collection methods describe different types of data collection tools understand the ABC of designing a data collection tool or adapting an established instrument understand basic principles of designing a questionnaire 1

2 What Is Data Collection? The process by which the researcher collects the information needed to answer the research questions or problems In collecting data, the researcher must decide: o What data to collect o How to collect the data o Who will collect the data o When to collect the data Selection of the Method Choice of techniques varies with study design and objectives Sometimes mixed methods design: so more than one method Each method has pros and cons o Questionnaires and surveys: self-report bias such as socially desirability answers rather than honest opinions o Observations: susceptible to observer bias such as seeing what one wants to see rather than what is actually there Selection of the Method Selection of the Method The data collection method is a function of: o The research hypothesis or problems o The research design Quantitative study design o Observational o Experimental Qualitative study design o Interviews o Focus Groups o Observations Quantitative Study Designs in Health and Epidemiology 2

3 Yes Selection of the Method Quantitative Study Designs in Health and Epidemiology Randomised controlled trial Yes Experimental study Random allocation? No Non-randomised controlled trial Investigator assigns exposures? No Observational study Yes Analytical study Direction? Comparison group? No Descriptive study Types of Collection Methods 3 major techniques for data collection: o Surveys o Observations o Interviews; focus group discussions Cohort study Casecontrol study Crosssectional study Exposure -> outcome Exposure <- outcome Exposure & outcome at same time Types of Collection Methods Quantitative Qualitative Data Collection Instruments Surveys Observations Interviews Focus groups Observations 3

4 Selection of the Tool An instrument is described as a device used to collect data Instrument facilitates variable observation and measurement The type of instrument used depends on the data collection method selected Validity and reliability of instrument development requires a high degree of expertise Selection of the Tool Exercise 1 Which type of instrument(s) do you think should be used in each of the following scenarios? 1. A group of researchers at Sultan Qaboos University are interested to determine reasons for psychological insulin resistance among patients with T2DM. 2. Pharmacists at Muscat General Hospital would like to determine patients satisfaction with a newly introduced automated computer-aided dispensing system. Selection of the Tool Exercise 1 Selection of the Tool Exercise 1 Which type of instrument(s) do you think should be used in each of the following scenarios? 3. The Directorate General of Medical Supplies is embarking on a cost containment strategy by promoting the supply and use of generic medicines. The DG would like you to determine patients knowledge and attitude on generics. 4. A new pharmacist-managed anticoagulation clinic was established. The MOH Oman would like to evaluate the clinical and humanistic outcomes of the new service compared with usual care. Which type of instrument(s) do you think should be used in each of the following scenarios? 5. Pharmacists initiated an integrated counseling service to improve the adherence of patients with hypertension. You are interested to measure the impact of the pharmacists counseling on the primary outcomes (BP and adherence to medications). 6. Medication use review services will be introduced in Oman. You are requested to conduct a study among community pharmacists to determine their KAP. 4

5 Types of Research Instruments Many tools for data collection in pharmacy practice and health care research: o Questionnaire o Predesigned validated forms o Interview schedule o Interview guide o Other instruments (checklist, records) Types of Research Instruments - Questionnaire A series of questions designed to elicit information which is filled in by all participants in a sample The most common type of research instrument Can be gathered verbally or self-administered Advantages of a questionnaire: o relatively simple method of obtaining data o less time consumption o able to gather data from a widely scattered sample Types of Research Instruments - Questionnaire Disadvantages of a questionnaire: o Data are limited to the information voluntarily provided o Response to questions lack depth o Participants may omit or disregard certain items o Some items may force respondents to select responses that are not their actual choice o Recall bias o Items may be misunderstood o Sample often limited by literacy Types of Research Instruments Predesigned Forms A form designed by the researcher based on research objectives and hypothesis Contains items that address the research goals Facilitates variable observation and measurement Data gathered through data sources such as medical records, observations, prescription database Advantages of a predesigned data collection form: o relatively simple method of obtaining data o less rigorous validity and reliability testing 5

6 Types of Research Instruments Interviews Involves either structured or unstructured verbal communication between the researcher and the subject, during which data are obtained Conducted orally (face-to-face or telephone) Data captured in writing and/or audiotaped Structured interviews guided by a formal written instrument (interview schedule) Unstructured interviews more conversational, long, flexibility in questioning Types of Research Instruments Interviews Advantages of Interviews: o depth of response o basis for developing a questionnaire o clarification is possible o no items overlooked o greater amount of flexibility Disadvantages of Interviews: o time consuming o costly Searching for a Research Instrument Searching and Developing Research Instruments Search scholarly articles from journals: o Learn what kind of instruments are being used for similar studies o Recognize the format, style, and how they are used Read books on research or field-related: o provide description or an actual copy of various instruments used Consult experts/researchers in the area: o Might have developed certain tools o Might have known or used tools developed by others Adapt one or more tools: o Tools developed by others Develop own instrument: o To fulfill your specific objectives and needs 6

7 Guidelines for Developing an Instrument Effective only if it relates to its particular purpose o Suitable for its function Based on theoretical framework for the study o Theory that is appropriate for the investigation Validity o Content appropriate to test the hypothesis or answer the RQ Reliability o Provide comparable data every time the subject uses it Non-manipulable o Designed in such a way that manipulation is minimized o Should be free of bias Guidelines for Developing an Instrument... Should not contain measures that function as hints for desired response (leading questions) Researcher needs to read extensively to identify which aspects of theory are appropriate Instrument must gather data that are appropriate in order to test the hypothesis or to answer the questions o o o o Researcher should gather group of items from such sources: person knowledgeable in the field accepted theories or hypothesis personal experiences materials reported in books and professional journals Guidelines for Developing an Instrument Developing a Questionnaire (Detail Dr. Fahad) Generate pool of items from available literature Open-ended vs. close-ended questions Every item should related to the topic under study Attributes of a good questionnaire: o Clarity of language o Singleness of objective o One-to-one correspondence (study objectives) o Correct grammar, spelling, and construction o Avoids double-barreled, double-negative questions o Well stated title and statement of purpose o Has clear direction and design corresponds to easy data tabulation Guidelines for Developing an Instrument Reliability and Validity of Instruments Validity o The extent to which an instrument measures what it is designed to measure Reliability o The degree of consistency and accuracy with which an instrument measures a variable Measures of Validity Testing o Face validity o Content validity o Concurrent validity o Predictive validity o Construct validity 7

8 Guidelines for Developing an Instrument Reliability and Validity of Instruments Measures of Reliability Testing o Stability testing (test-retest, repeated observation) o Internal consistency o Test of equivalence Beyond the Scope of this Introductory Workshop! Exercise 2 Designing Which instrument(s) would you use and how would you develop it/them? Please explain to the participants. 1. A team of pharmacists just started a new pharmacist-run anticoagulation clinic. Your research curiosity is to determine: i. the knowledge of patients on oral anticoagulation ii. the satisfaction of patients with the pharmacy service iii. The quality of life of patients attending your clinic OAK, DASS Exercise 2 Designing Which instrument(s) would you use and how would you develop it/them? Please explain to the participants. 2. Your team is interested to determine the adherence of patients with heart failure attending a pharmacists-led heart failure clinic in Muscat. 3. Your group is interested to evaluate the attitudes and practices of pharmacists in Oman on generic drugs substitution. Exercise 2 Designing Which instrument(s) would you use and how would you develop it/them? Please explain to the participants. 4. You are interested to investigate the relationship between taking steroids and development of osteoporosis among RA patients on prednisolone. 5. Your research group are contemplating to use St. George's Respiratory Questionnaire. Resp Med 1991;85:2531 or SF-36 questionnaire to measure the QoL of COPD patients receiving different drug regimens. Which is the most appropriate? Why?? What?? 8

9 Readings and References Smith F. Research methods in pharmacy practice. London: Pharmaceutical Press; Boynton PM, Greenhalg T. Selecting, designing and developing your questionnaire. BMJ 2004; 328: Punch K. Survey research: The basics. London: Sage Publications Ltd; Oppenheim A. Questionnaire design, interviewing and attitude measurement. London: Pinter Publisher Ltd; DeVellis RF. Scale development: Theory and applications. Newbury Park, California: Sage Publications, Inc; Saw SM, Ng TP. The Design and Assessment of Questionnaires in Clinical Research. SMJ. 2001;42(3) : g{tç~á yéü çéâü tààxçà ÉÇ 24 Dec. 2012, AA Where is Qatar on the Globe? Location: A small peninsular in the Middle East region Economy: Oil- and gas-rich country with the highest GDP per capita Growth: Fastest growing economies in the Middle East Population: 1,963,124 (over 80% expatriates) Currency: Qatar Riyals College of Pharmacy at Qatar University 9