C2 Training: June 8 9, 2010
|
|
- Tiffany White
- 8 years ago
- Views:
Transcription
1 C2 Training: June 8 9, 2010 Data Evaluation: Initial screening and Coding Adapted from David B. Wilson and Mark W. Lipsey The Campbell Collaboration
2 Overview Coding protocol: essential feature of systematic review Goal: transparent and replicable description of studies extraction of findings Forms should be part of C2 protocol
3 Topics Eligibility criteria and screening form Development of coding protocol Assessing reliability of coding
4 Study Eligibility Criteria Flow from research question Identify specifics of: Defining features of the program/policy/intervention Eligible designs; required methods Key sample features Required outcomes Required statistical data Geographical/linguistic restrictions, if any Time frame, if any Also explicitly states what is excluded
5 Study Eligibility Screening Form Develop a screening form with criteria Complete form for all studies retrieved as potentially eligible Modify criteria after examining sample of studies (controversial) Double-code eligibility Maintain database on results for each study screened Example from MST review in handouts
6 Screening Form Effects of Multisystemic Therapy (MST) Initial Screening Form Is this paper about MST (perhaps in addition to other topics)? 1. No 2. Yes 99. Can t tell 2. What kind of paper is this? 1. MST outcome evaluation 2. Review of MST outcome studies 3. Descriptive, correlational, or case study 4. Theoretical or position paper, editorial, or book review 5. Practice guidelines or treatment manual 6. Other 99. Can t tell
7 Effects of Multisystemic Therapy (MST): Eligibility Screening Form Does this study include two or more parallel cohorts? Note: This means that at least two groups that received different treatments were assessed at the same point in time. 1. No 2. Yes 99. Can t tell IF NO THEN STOP 2. Is this a randomized experiment? 1. No 2. Yes 99. Can t tell IF NO THEN STOP 3. Does this study include a licensed MST program? 0. No 1. Yes 99. Can t tell IF NO THEN STOP 4. Does this study include youth ages with social, emotional, or behavioral problems? 0. No 1. Yes 99. Can t tell IF NO THEN STOP
8 Screening Coding Guide for Internet-based Interventions for English Language Learners Report Characteristics 1. First author (Last, initials) 2. Journal 3. Volume 4. Pages Inclusion Criteria 5. Are participants English language learners? Yes/No If no stop 6. Does each student in the intervention group have Internet access at school and/or at home? 7. Does the study English language skills/proficiency as an outcome measure? Yes/No Yes/No If no stop If no stop 8. Are the participants in the U.S.A.? Yes/No If no stop 9. Is the study a between-group? Yes/No If no stop
9 Coding practice exercise 1 For the articles provided, code Levels 1 and 2 from the MST coding sheet Compare your codes with those created by someone else. Do you agree?
10 Development of Coding Protocol Goal of protocol Describe studies Differentiate studies Extract findings (effect sizes if possible) Coding forms and manual Both important Sample coding item from form Sample manual instructions for item
11 Development of Coding Protocol Types of Information to Code Setting, study context, authors, publication date and type, etc. Methods and method quality Program/intervention Participants/clients/sample Outcomes Findings, effect sizes
12 Types of Information to Code Setting, study context, authors, publications date and type, etc. Multiple publications; study vs report Geographical/national setting; language Publication type and publication bias issue Publication date vs study date Research, demonstration, practice studies Example from MST review in handouts
13 Types of Information to Code Methods: Basic research design Nature of assignment to conditions Attrition, crossovers, dropouts, other changes to assignment Nature of control condition Multiple intervention and/or control groups Design quality dimensions Initial and final comparability of groups Treatment-control contrast treatment contamination blinding
14 Types of Information to Code Methods: Other aspects Issues depend on specific research area Procedural, e.g., monitoring of implementation, fidelity credentials, training of data collectors Statistical, e.g., statistical controls for group differences handling of missing data
15 Types of Information to Code Method quality ratings (or not) More than 200 scales and checklists available, few if any appropriate for systematic reviews (Deeks et al., 2003) Overall study quality scores have questionable reliability/ validity (Jüni et al., 2001) Conflate different methodological issues and study design/ implementation features, which may have different impacts on reliability/validity Preferable to examine potential influence of key components of methodological quality individually Weighting results by study quality scores is not advised!
16 Cochrane risk of bias framework Focus on identifying potential sources of bias in studies: Selection bias - Systematic differences between groups at baseline Performance bias - Something other than the intervention affects groups differently Attrition bias - Participant loss affects initial group comparability Detection bias - Method of outcome assessment affects group comparisons Reporting bias - Selective reporting of outcomes
17 Types of Information to Code Program/Intervention General program type (mutually exclusive or overlapping?) Specific program elements (present/absent) Any treatment received by the comparison group Treatment implementation issues integrity amount, dose Goal is to differentiate across studies Examples
18 Types of Information to Code Participants/clients/sample Data is at aggregate level Mean age, age range Gender mix Racial/ethnic mix Risk, severity Restrictiveness; special groups (e.g., clinical) Examples
19 Types of Information to Code Outcome measures Construct measured Measure or operationalization used Source of information Composite or single indicator (item) Scale: dichotomous, count, discrete ordinal, continuous Reliability and validity Time of measurement (e.g., relative to treatment) Examples
20 Types of Information to Code Findings Compute effect sizes when possible May need to aggregate data or reconfigure findings Add back the dropouts Compute weighted means of subgroups (e.g., boys and girls) Code data on which computations based (common situations) We will look at this part of the coding in the next section
21 Development of Coding Protocol Iterative nature of development Structuring data Data hierarchical (findings within studies) Coding protocol needs to allow for this complexity Analysis of effect sizes needs to respect this structure Flat-file (example) Relational hierarchical file (example)
22 Data extraction Double data extraction Cohen s kappa Agreement on key decisions Study inclusion/exclusion, key characteristics, risk of bias, coding of results Pilot-test and refine codes!
23 Example of a Flat File Multiple ESs handled by having multiple variables, one for each potential ES. Note that there is only one record (row) per study
24 Example of a Hierarchical Structure Study Level Data File Note that a single record in the file above is related to five records in the file to the right Effect Size Level Data File
The Campbell Collaboration www.campbellcollaboration.org. Study content coding Effect size coding (next session)
Systema(c Review Methods Workshop Study Coding Sandra Jo Wilson Vanderbilt University Editor, Campbell Collabora9on Educa9on Coordina9ng Group Workshop Overview Levels of Study Coding Study eligibility
More informationAssessing study quality: critical appraisal. MRC/CSO Social and Public Health Sciences Unit
Assessing study quality: critical appraisal MRC/CSO Social and Public Health Sciences Unit Assessing study quality: why? Why critical appraise? Evidence informed decision-making assumes people make better
More informationCRITICALLY APPRAISED PAPER (CAP)
CRITICALLY APPRAISED PAPER (CAP) FOCUSED QUESTION What is the effect of life review through writing on depressive symptoms in older adults residing in senior residences? Chippendale, T., & Bear-Lehman,
More informationHow To Randomize A Program
How to Randomize Nassreena Sampaco-Baddiri Innovations for Poverty Action Philippines 3 rd September, 2014 Lecture Overview Unit and method of randomization Real-world constraints Revisiting unit and method
More informationIf several different trials are mentioned in one publication, the data of each should be extracted in a separate data extraction form.
General Remarks This template of a data extraction form is intended to help you to start developing your own data extraction form, it certainly has to be adapted to your specific question. Delete unnecessary
More informationTreatment for Adolescent Substance Use Disorders: What Works?
Treatment for Adolescent Substance Use Disorders: What Works? Mark W. Lipsey Emily E. Tanner-Smith Sandra J. Wilson Peabody Research Institute, Vanderbilt University Addiction Health Services Research
More informationHow To Write A Systematic Review
Formulating the Review Question & Writing a Protocol Madhukar Pai, MD, PhD Associate Professor Department of Epidemiology & Biostatistics McGill University, Montreal, Canada Email: madhukar.pai@mcgill.ca
More informationUsing Case Management Data to Improve Programs and Achieve Results
Using Case Management Data to Improve Programs and Achieve Results Agenda Presentation (30 minutes) Q&A and Discussion (15 minutes) Small Group Exercise (15 minutes) Sharing and Wrap-Up (15 minutes) A
More informationForm B-1. Inclusion form for the effectiveness of different methods of toilet training for bowel and bladder control
Form B-1. Inclusion form for the effectiveness of different methods of toilet training for bowel and bladder control Form B-2. Assessment of methodology for non-randomized controlled trials for the effectiveness
More informationEvidence for evidence- based practice: Research and reality in juvenile justice
Evidence for evidence- based practice: Research and reality in juvenile justice Mark W. Lipsey Vanderbilt University Jerry Lee Lecture Campbell Collaboration Colloquium Vancouver, May 2008 Our point of
More informationGUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES
GUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES These guidelines are intended to promote quality and consistency in CLEAR reviews of selected studies that use statistical techniques and other
More informationSystematic Reviews in JNEB
Systematic Reviews in JNEB Introduction 3 Associate Editors and 3 Board of Editors members Panel then small workshop tables Evaluation, please Thank you to Elsevier for refreshments! KCN Systematic Reviews
More informationCRITICALLY APPRAISED PAPER (CAP)
CRITICALLY APPRAISED PAPER (CAP) FOCUSED QUESTION Does a neurocognitive habilitation therapy service improve executive functioning and emotional and social problem-solving skills in children with fetal
More informationTo Rapid Evidence Assess or systematic review? An example using persistent and prolific offenders
To Rapid Evidence Assess or systematic review? An example using persistent and prolific offenders Amanda E. Perry Centre for Criminal Justice Economics & Psychology, University of York. 8 th International
More informationPEER REVIEW HISTORY ARTICLE DETAILS
PEER REVIEW HISTORY BMJ Open publishes all reviews undertaken for accepted manuscripts. Reviewers are asked to complete a checklist review form (http://bmjopen.bmj.com/site/about/resources/checklist.pdf)
More informationChart Audits: The how s and why s By: Victoria Kaprielian, MD Barbara Gregory, MPH Dev Sangvai, MD
Chart Audits: The how s and why s By: Victoria Kaprielian, MD Barbara Gregory, MPH Dev Sangvai, MD By Victoria Kaprielian, MD Associate Clinical Professor Barbara Gregory, MPH Quality Analyst Dev Sangvai,
More informationGuidelines for AJO-DO submissions: Randomized Clinical Trials June 2015
Guidelines for AJO-DO submissions: Randomized Clinical Trials June 2015 Complete and transparent reporting allows for accurate assessment of the quality of trial and correct interpretation of the trial
More informationCRITICALLY APPRAISED PAPER (CAP)
CRITICALLY APPRAISED PAPER (CAP) FOCUSED QUESTION What is the effectiveness of community-based occupational therapy in enhancing participation in valued activities for people 6 months post-stroke in comparison
More informationWelcome! We will begin at 2:00 p.m. EDT
Welcome! We will begin at 2:00 p.m. EDT Please enable your speakers for audio. If you are unable to hear the webinar through your speakers, please call 408-600- 3600. You will be asked to enter the 9-digit
More informationDefining your PICO Question. In: Patient or Problem or Risk Factor EXAMPLE: Does: Treatment A or Exposure A EXAMPLE: EXAMPLE: Outcome of interest
Defining your PICO Question P = The Patient or Population Who will be the focus? EXAMPLE: In: Patient or Problem or Risk Factor I = Intervention or Exposure What is the Exposure or Treatment of interest?
More informationCHANGES OVER TIME IN THE EARLY POSTSCHOOL OUTCOMES OF YOUTH WITH DISABILITIES
June 2005 CHANGES OVER TIME IN THE EARLY POSTSCHOOL OUTCOMES OF YOUTH WITH DISABILITIES A Report of Findings from the National Longitudinal Transition Study (NLTS) and the National Longitudinal Transition
More informationRed Light Camera Interventions for Reducing Traffic Violations and Accidents: A Systematic Review
Red Light Camera Interventions for Reducing Traffic Violations and Accidents: A Systematic Review Ellen Cohn, Suman Kakar, and David Farrington Submitted to the Coordinating Group of: XX Crime and Justice
More informationEvidence-based Practice Center Comparative Effectiveness Review Protocol
Evidence-based Practice Center Comparative Effectiveness Review Protocol Project Title: Comparative Effectiveness of Case Management for Adults With Medical Illness and Complex Care Needs I. Background
More informationPrinciples of Systematic Review: Focus on Alcoholism Treatment
Principles of Systematic Review: Focus on Alcoholism Treatment Manit Srisurapanont, M.D. Professor of Psychiatry Department of Psychiatry, Faculty of Medicine, Chiang Mai University For Symposium 1A: Systematic
More informationStudy Design and Statistical Analysis
Study Design and Statistical Analysis Anny H Xiang, PhD Department of Preventive Medicine University of Southern California Outline Designing Clinical Research Studies Statistical Data Analysis Designing
More informationCritical Appraisal of a Research Paper
Critical Appraisal of a Research Paper Andrew MacInnes, BDS (Hons.) MFDS, RCPS (Glasgow), Senior House Officer 1 Thomas Lamont, BDS, MFDS, RCPS (Glasgow), Clinical Research Fellow/Honorary Restorative
More informationTitle Registration Form Campbell Collaboration Social Welfare Coordinating Group
Title Registration Form Campbell Collaboration Social Welfare Coordinating Group 1. Title of review (Suggested format: [intervention/s] for [outcome/s] in [problem/population] in [location/situation] Example:
More informationBiostat Methods STAT 5820/6910 Handout #6: Intro. to Clinical Trials (Matthews text)
Biostat Methods STAT 5820/6910 Handout #6: Intro. to Clinical Trials (Matthews text) Key features of RCT (randomized controlled trial) One group (treatment) receives its treatment at the same time another
More informationTitle Registration Form Campbell Collaboration Social Welfare Coordinating Group
Title Registration Form Campbell Collaboration Social Welfare Coordinating Group 1. Title of review (Suggested format: [intervention/s] for [outcome/s] in [problem/population] in [location/situation] Example:
More informationPhone: 020 79115334 Email: j.tripney@ioe.ac.uk
Title Registration for a Systematic Review: Post-basic technical and vocational education and training (TVET) interventions to improve employability and employment of TVET graduates in low- and middle-income
More informationGOI Protocol 4-3-04 Page 1. General Organizational Index (GOI) (Expanded) Item Definitions and Scoring
GOI Protocol 4-3-04 Page 1 General Organizational Index (GOI) (Expanded) Item Definitions and Scoring Note: This version identical to GOI version of 11-25-02 for Items G1-G12. Items G13 & G14 added by
More informationPEER REVIEW HISTORY ARTICLE DETAILS TITLE (PROVISIONAL)
PEER REVIEW HISTORY BMJ Open publishes all reviews undertaken for accepted manuscripts. Reviewers are asked to complete a checklist review form (http://bmjopen.bmj.com/site/about/resources/checklist.pdf)
More informationNKR 13 Alkoholbehandling. Disulfiram for alcohol dependency
NKR 13 Alkoholbehandling. Disulfiram for alcohol dependency Review information Authors Sundhedsstyrelsen 1 1 [Empty affiliation] Citation example: S. NKR 13 Alkoholbehandling. Disulfiram for alcohol dependency.
More informationThe Persistence of Head Start Program Effects: What Role Does Subsequent Schooling Play? Katherine Magnuson & Hilary Shager UW-Madison
The Persistence of Head Start Program Effects: What Role Does Subsequent Schooling Play? Katherine Magnuson & Hilary Shager UW-Madison Outline Evidence & conceptual question about HS persistence effects
More informationCitation: Robertson, I.H., Gray, J.M., Pentland, B., & Waite, L.J. (1990). Microcomputerbased
A computer-based cognitive rehabilitation program, involving scanning training twice a week for 7 weeks, did not improve cognitive function in patients with unilateral left visual neglect. Prepared by:
More informationPrepared by:jane Healey (Email: janie_healey@yahoo.com) 4 th year undergraduate occupational therapy student, University of Western Sydney
1 There is fair (2b) level evidence that living skills training is effective at improving independence in food preparation, money management, personal possessions, and efficacy, in adults with persistent
More informationUsing an Instructional Systems Development Model as a Framework for Research on Scale Up 1
Using an Instructional Systems Development Model as a Framework for Research on Scale Up 1 Michael R. Vitale East Carolina University Nancy R. Romance Florida Atlantic University Abstract This paper presents
More informationValue of Accreditation: Review of Evidence
Value of Accreditation: Review of Evidence Mayer Brezis, MD MPH, Professor of Medicine Center for Clinical Quality and Safety Hadassah Hebrew University Medical Center Hadassah Board Quality Committee
More informationRUTLAND COUNTY TREATMENT COURT
Data Driven Decisions RUTLAND COUNTY TREATMENT COURT CONTROL GROUP EVALUATION FINAL REPORT Submitted to: Karen Gennette State Treatment Court Coordinator Vermont Court Administrator s Office Submitted
More informationAuthors Checklist for Manuscript Submission to JPP
Authors Checklist for Manuscript Submission to JPP Prospective authors should use the following checklist guide in order to maximize the chance for their manuscript to be published and to ease our reviewers
More informationEUROPEAN FRAMEWORK OF GOOD PRACTICES
EUROPEAN FRAMEWORK OF GOOD PRACTICES in Raising Literacy Levels of Children, Adolescents and Adults JUNE 2015 This project has been funded with support from the European Commission. This publication reflects
More informationInstitutional Research and Data Warehouse (IRDW) Office of the Vice President of Planning and Development (OIPD) Qatar University
Institutional Research and Data Warehouse (IRDW) Office of the Vice President of Planning and Development (OIPD) Qatar University November 2008 Executive Summary: In spring 2008, the Office of Institution
More informationMODEL POLICY LANGUAGE
MODEL POLICY LANGUAGE FOR CHARTER SCHOOL EQUITY Julie F. Mead University of Wisconsin-Madison Preston C. Green III Pennsylvania State University February 0 National Education Policy Center School of Education,
More informationFinding and Evaluating Evidence: Systematic Reviews and Evidence-Based Practice
University Press Scholarship Online You are looking at 1-10 of 54 items for: keywords : systematic reviews Systematic Reviews and Meta-Analysis acprof:oso/9780195326543.001.0001 This book aims to make
More informationThe effect of microcredit on women s control over household spending in developing countries
Title registration for a review proposal: The effect of microcredit on women s control over household spending in developing countries Jos Vaessen, Frans L. Leeuw, Sara Bonilla, Ana Rivas, Ruslan Lukach,
More informationDeveloping a Tool to Assess Administrative Evidence-Based Practices in Local Health Departments
Frontiers in Public Health Services and Systems Research Manuscript 1044 Developing a Tool to Assess Administrative Evidence-Based Practices in Local Health Departments Rodrigo S. Reis Kathleen Duggan
More informationResearch-Based Guidelines for Juvenile Justice Programs 17
P Research-Based Guidelines for Juvenile Justice Programs 17 Special Issue on Evidence -Based Policy and Practice * Research-Based Guidelines for Juvenile Justice Programs James C. Howell The Comprehensive
More informationPEER REVIEW HISTORY ARTICLE DETAILS TITLE (PROVISIONAL)
PEER REVIEW HISTORY BMJ Open publishes all reviews undertaken for accepted manuscripts. Reviewers are asked to complete a checklist review form (http://bmjopen.bmj.com/site/about/resources/checklist.pdf)
More informationPower Calculation Using the Online Variance Almanac (Web VA): A User s Guide
Power Calculation Using the Online Variance Almanac (Web VA): A User s Guide Larry V. Hedges & E.C. Hedberg This research was supported by the National Science Foundation under Award Nos. 0129365 and 0815295.
More informationA Guide To Producing an Evidence-based Report
A Guide To Producing an Evidence-based Report by Dr. James L. Leake Professor and Head, Community Dentistry, Dept. of Biological and Diagnostic Sciences, Faculty of Dentistry University of Toronto Evidence-based
More informationDatabase of randomized trials of psychotherapy for adult depression
Database of randomized trials of psychotherapy for adult depression In this document you find information about the database of 352 randomized controlled trials on psychotherapy for adult depression. This
More informationUTAH STATE CHARTER SCHOOL BOARD CHARTER SCHOOL PROPOSAL PACKAGE
UTAH STATE CHARTER SCHOOL BOARD CHARTER SCHOOL PROPOSAL PACKAGE Thank you for your interest in applying for a charter from the Utah State Charter School Board. Enclosed are the instructions and forms necessary
More informationEPPI-Centre Methods for Conducting Systematic Reviews
Evidence for Policy and Practice Information and Co-ordinating Centre The EPPI-Centre is part of the Social Science Research Unit, Institute of Education, University of London EPPI-Centre Methods for Conducting
More informationProtocol for a Systematic Review: Comparing Alternatively Certified to Regularly Certified Teachers: A Systematic Review and Meta-Analysis
Protocol for a Systematic Review: Comparing Alternatively Certified to Regularly Certified Teachers: A Systematic Review and Meta-Analysis Jeffrey C. Valentine, Spyros Konstantopoulos, Timothy Lau Submitted
More informationThe University of the State of New York The State Education Department DIAGNOSTIC TOOL FOR SCHOOL AND DISTRICT EFFECTIVENESS (DTSDE)
The University of the State of New York The State Education Department DIAGNOSTIC TOOL FOR SCHOOL AND DISTRICT EFFECTIVENESS (DTSDE) BEDS Code 51110106007 School Name West Side Elementary School School
More informationFunctional Family Therapy
Functional Family Therapy An integrative model for working with at risk adolescents and their families Dana Phelps, EBP Manager, Childrens Adminstration Jeff Patnode, FFT QA Manager, Juvenile Rehabilitation
More information1. Systematic literature review
1. Systematic literature review Details about population, intervention, outcomes, databases searched, search strings, inclusion exclusion criteria are presented here. The aim of systematic literature review
More informationDate Self-Assessment Evaluator Assessment
Rubric for BEHAVIOR SPECIALIST/ANALYST (BS/BA) Date Self-Assessment Evaluator Assessment 1a: Demonstrating Knowledge of Behavior Analysis Principles, Laws, Regulations, and Research Domain 1: Planning
More informationGuidance for Peer Reviewers. The Journal of the American Osteopathic Association (JAOA)
Guidance for Peer Reviewers The Journal of the American Osteopathic Association (JAOA) JAOA Editorial Staff This module is available online at http://jaoa.org/documentlibrary/prmodule.pdf Guidance for
More informationADOLESCENT HEALTH SYSTEM CAPACITY ASSESSMENT TOOL
ADOLESCENT HEALTH SYSTEM CAPACITY ASSESSMENT TOOL SECTION 1: INTRODUCTION ADOLESCENT HEALTH SYSTEM CAPACITY ASSESSMENT TOOL 1 SECTION 1: INTRODUCTION Adolescent Health System Capacity Tool: A state public
More information252 10:15AM to 1:15PM Organizers: David Denyer, Cranfield U.; Rob B. Briner, U. of London Primary Sponsor: Research Methods
Systematic Review and Research Synthesis 252 10:15AM to 1:15PM Organizers: David Denyer, Cranfield U.; Rob B. Briner, U. of London Primary Sponsor: Research Methods Agenda Evidence-based management (EBMgt)
More informationNEW YORK STATE TEACHER CERTIFICATION EXAMINATIONS
NEW YORK STATE TEACHER CERTIFICATION EXAMINATIONS TEST DESIGN AND FRAMEWORK September 2014 Authorized for Distribution by the New York State Education Department This test design and framework document
More informationByram Hills Administrators Association / Superintendent Agreement Annual Professional Performance Review Compliance
BYRAM HILLS CENTRAL SCHOOL DISTRICT ARMONK, NY Byram Hills Administrators Association / Superintendent Agreement Annual Professional Performance Review Compliance This Annual Professional Performance Review
More informationOCRe: Ontology of Clinical Research
OCRe: Ontology of Clinical Research 11 th International Protégé Conference June 28, 2009 Samson W. Tu 1, Ida Sim 2, Simona Carini 2, Steve Harris 3, Peter Maccallum 3, Alan Rector 4, Igor Toujilov 3 1
More informationLEARNER OBJECTIVES. Roxanne Vandermause, PhD, RN Mary Lee Roberts, PhD (Music), RN, PhD Nursing Student Merry Armstrong Fougere, DNSc, APRN
DIMENSIONS OF RELATIONAL HEALTH IN ADOLESCENT SUBSTANCE USE Roxanne Vandermause, PhD, RN Mary Lee Roberts, PhD (Music), RN, PhD Nursing Student Merry Armstrong Fougere, DNSc, APRN LEARNER OBJECTIVES 1)
More informationChapter 17 Qualitative Data Analysis
Chapter 17 Qualitative Data Analysis (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The purposes of this chapter are to help you to grasp
More informationGLOSSARY OF EVALUATION TERMS
Planning and Performance Management Unit Office of the Director of U.S. Foreign Assistance Final Version: March 25, 2009 INTRODUCTION This Glossary of Evaluation and Related Terms was jointly prepared
More informationNew York University Steinhardt School of Culture, Education, and Human Development Department of Teaching and Learning
New York University Steinhardt School of Culture, Education, and Human Development Department of Teaching and Learning Professor: Russ Schulman, PhD Office: By appointment Phone: 917-596-9023 Email: russ.schulman@nyu.edu
More informationUNIT: PSYCHOLOGICAL RESEARCH
Assignment: Research Experiment Instructor Guide UNIT: PSYCHOLOGICAL RESEARCH Standards that Apply to this Assignment National Standards for High School Psychology Curricula August 2005 Standard Area IA:
More informationBasic Results Database
Basic Results Database Deborah A. Zarin, M.D. ClinicalTrials.gov December 2008 1 ClinicalTrials.gov Overview and PL 110-85 Requirements Module 1 2 Levels of Transparency Prospective Clinical Trials Registry
More informationSubject: No. Page PROTOCOL AND CASE REPORT FORM DEVELOPMENT AND REVIEW Standard Operating Procedure
703 1 of 11 POLICY The Beaumont Research Coordinating Center (BRCC) will provide advice to clinical trial investigators on protocol development, content and format. Upon request, the BRCC will review a
More informationPART 2: General methods for Cochrane reviews
PART 2: General methods for Cochrane reviews Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series Edited by Julian PT Higgins and Sally Green 2008 The Cochrane Collaboration.
More informationAppendix II Annex IV. Summary of the quality assessment
Appendix II Annex IV Summary of the quality assessment This table summarizes the assessment of the quality of the reviews and primary. The overall quality is provided, as well as a for major criteria (the
More informationProtocol registration and outcome reporting bias in randomised controlled trials of
Title: Protocol registration and outcome reporting bias in randomised controlled trials of eczema treatment Rationale: As one of the measures to reduce the likelihood of selective reporting bias in RCTs,
More informationMAT 155. Chapter 1 Introduction to Statistics. Key Concept. Basics of Collecting Data. 155S1.5_3 Collecting Sample Data.
MAT 155 Dr. Claude Moore Cape Fear Community College Chapter 1 Introduction to Statistics 1 1 Review and Preview 1 2 Statistical Thinking 1 3 Types of Data 1 4 Critical Thinking 1 5 Collecting Sample Data
More informationCHECKLIST FOR CONFLICT SENSITIVITY IN EDUCATION PROGRAMS
CHECKLIST FOR CONFLICT SENSITIVITY IN EDUCATION PROGRAMS NOVEMBER 2013 This publication was produced for review by the United States Agency for International Development. It was prepared by Valerie Haugen
More informationCochrane Review: Psychological treatments for depression and anxiety in dementia and mild cognitive impairment
23 rd Alzheimer Europe Conference St. Julian's, Malta, 2013 Cochrane Review: Psychological treatments for depression and anxiety in dementia and mild cognitive impairment Orgeta V, Qazi A, Spector A E,
More informationMultidimensional Family Therapy (MDFT) for young people in treatment for illicit
Title registration for a review proposal: Multidimensional Family Therapy (MDFT) for young people in treatment for illicit non-opioid drug use Pernille Skovbo Rasmussen, Maia Lindstrøm, Krystyna Kowalski,
More informationPEER REVIEW HISTORY ARTICLE DETAILS VERSION 1 - REVIEW. Avinesh Pillai Department of Statistics University of Auckland New Zealand 16-Jul-2015
PEER REVIEW HISTORY BMJ Open publishes all reviews undertaken for accepted manuscripts. Reviewers are asked to complete a checklist review form (http://bmjopen.bmj.com/site/about/resources/checklist.pdf)
More informationAPA Div. 16 Working Group Globalization of School Psychology
APA Div. 16 Working Group Globalization of School Psychology Thematic subgroup: Evidence-Based Interventions in School Psychology Annotated Bibliography Subgroup Coordinator: Shane Jimerson University
More informationBACKGROUND Kids Help Phone s Service Evaluations: Key Learnings
BACKGROUND Kids Help Phone s Service Evaluations: Key Learnings Kids Help Phone s professional counselling is effective Kids Help Phone s phone and Live Chat counselling evaluations demonstrate that our
More informationReception baseline: criteria for potential assessments
Reception baseline: criteria for potential assessments This document provides the criteria that will be used to evaluate potential reception baselines. Suppliers will need to provide evidence against these
More informationA Systematic Review Process for Software Engineering
A Systematic Review Process for Software Engineering Paula Mian, Tayana Conte, Ana Natali, Jorge Biolchini and Guilherme Travassos COPPE / UFRJ Computer Science Department Cx. Postal 68.511, CEP 21945-970,
More informationFRAMEWORK OF SUPPORT: SCHOOL-LEVEL PRACTICE PROFILE
FRAMEWORK OF SUPPORT: SCHOOL-LEVEL PRACTICE PROFILE S The Framework of Supports are a set of Practice Profiles that serve as an implementation overview of Support for Personalized Learning (SPL). Practice
More informationCharacteristics of studies
PICO 6 for ALKO DOB FINAL Review information Authors [Empty name] 1 1 [Empty affiliation] Citation example: [Empty name]. PICO 6 for ALKO DOB FINAL. Cochrane Database of Systematic Reviews [Year], Issue
More informationOak Park School District. School Psychologist Evaluation
Oak Park School District School Psychologist Evaluation School Psychologist Evaluation Instrument Domain I: Databased Decision Making and Accountability School psychologists have knowledge of varied models
More informationDeveloping Competency- Based Assessments in Field Education Courses. Cheryl Regehr Marion Bogo
Developing Competency- Based Assessments in Field Education Courses Cheryl Regehr Marion Bogo Competence An individual s ability to use or translate the knowledge, skills, attitudes, and judgment associated
More informationCampbell Collaboration Systematic Reviews: Policies and Guidelines
Campbell Systematic Reviews 2015: Supplement 1 First published: 01 May 2014 Updated: 14 January 2015 Campbell Collaboration Systematic Reviews: Policies and Guidelines Version 1.1 Colophon Title Authors
More informationTitle Registration for a Systematic Review: Tutoring Programs to Improve Educational Outcomes in Children Aged Four to Eleven
Title Registration for a Systematic Review: Tutoring Programs to Improve Educational Outcomes in Children Aged Four to Eleven Lead Reviewer: Dr. Sarah Miller Title: Lecturer Email: s.j.miller@qub.ac.uk.
More informationComparative Effectiveness of Substance Abuse Treatment Programs for Adolescents: Results from Three Meta-analyses
Comparative Effectiveness of Substance Abuse Treatment Programs for Adolescents: Results from Three Meta-analyses Emily E. Tanner-Smith Mark W. Lipsey Sandra J. Wilson Peabody Research Institute Vanderbilt
More informationIs an intervention using computer software effective in literacy learning? A randomised controlled trial
Educational Studies, Vol. 32, No. 2, June 2006, pp. 133 143 Is an intervention using computer software effective in literacy learning? A randomised controlled trial G Brooks a *, JNV Miles b, CJ Torgerson
More informationLisa R. Fortuna, MD, MPH Michelle V. Porche, Ed. D Sripallavi Morampudi, MBBS Stanley Rosenberg, PhD Douglas Ziedonis, MD, MPH
CBT for Youth with Co-Occurring Post Traumatic Stress Disorder and Substance Disorders Lisa R. Fortuna, MD, MPH Michelle V. Porche, Ed. D Sripallavi Morampudi, MBBS Stanley Rosenberg, PhD Douglas Ziedonis,
More informationPatient Reported Outcomes
Patient Reported Outcomes 16 December 2013, Nottingham Esther van Zuuren Dermatologist, Leiden University Medical Centre Netherlands Patient Reported Outcomes A Patient Reported Outcome (PRO): any aspect
More informationCreating and Evaluating a Credentialing System for Vocational Schools in China
Creating and Evaluating a Credentialing System for Vocational Schools in China Phase 2 Final Report, 2015 Electronic Industry Citizenship Coalition (EICC) Stanford University s Rural Education Action Program
More informationScoring (manual, automated, automated with manual review)
A. Source and Extractor Author, Year Reference test PMID RefID Index test 1 Key Question(s) Index test 2 Extractor B. Study description Sampling population A Recruitment Multicenter? Enrollment method
More informationPromoting professional behaviour change in healthcare what interventions work, and why? Protocol for a theory-led overview of systematic reviews
Promoting professional behaviour change in healthcare what interventions work, and why? Protocol for a theory-led overview of systematic reviews Mark J Johnson, Carl R May Abstract Background: An overview
More information13-30 14:15 Focusing the Question
13-30 14:15 Focusing the Question Andrew Booth, Reader in Evidence Based Information Practice, ScHARR, University of Sheffield, UK Importance of a focused question The review question should specify the
More informationIntroduction to Longitudinal Data Analysis
Introduction to Longitudinal Data Analysis Longitudinal Data Analysis Workshop Section 1 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development Section 1: Introduction
More informationWeb appendix: Supplementary material. Appendix 1 (on-line): Medline search strategy
Web appendix: Supplementary material Appendix 1 (on-line): Medline search strategy exp Venous Thrombosis/ Deep vein thrombosis.mp. Pulmonary embolism.mp. or exp Pulmonary Embolism/ recurrent venous thromboembolism.mp.
More informationImpact of youth business loan scheme on enterprise development: A case study from Pakistan
Impact of youth business loan scheme on enterprise development: A case study from Pakistan Asif Chowdhury Ross Mcintosh Akhtar Nadeem Javed Younas Group-6 Background Youth in Pakistan are the largest population
More information