Suggestions provided by APA Writing Behavioral Learning Objectives and Assessments

Transcription

1 Suggestions provided by APA Writing Behavioral Learning Objectives and Assessments Learning objectives, or learning outcomes, are statements that clearly describe what the learner will kw or be able to do as a result of having attended an educational program or activity. Learning objectives must be observable and measurable. Learning objectives should (1) focus on the learner, and (2) contain action verbs that describe measurable behaviors Verbs to consider when writing learning objectives: list, describe, recite, write compute, discuss, explain, predict apply, demonstrate, prepare, use analyze, design, select, utilize compile, create, plan, revise assess, compare, rate, critique Verbs to avoid when writing learning objectives kw, understand learn, appreciate become aware of, become familiar with Example of well-written learning objectives: This workshop is designed to help you: 1. Summarize basic hypsis theory and technique; 2. Observe demonstrations of hyptic technique and phemena; 3. Recognize differences between acute and chronic pain; 4. Utilize hypsis in controlling acute pain; 5. Apply post-hyptic suggestions to chronic pain; and 6. Practice hyptic technique in dyads. Objective learning assessments should be written in a manner that determines whether participants learned what you planned to teach them. The evaluation (or learning assessment) should be based on the stated learning objectives of the program. Example of well-written learning assessment: Based on the content of the workshop, I am able to: Strongly Agree Strongly Disagree 1. Describe at least two theoretical approaches to hypsis; Employ at least two hyptic induction techniques; Explain how psychological approaches differ when applied to acute vs. chronic pain; Demonstrate a technique for applying hypsis to acute pain; Provide a post-hyptic suggestion for controlling chronic pain; and State that I had the opportunity to practice the technique during the workshop

2 Criteria and Processes for Determining Proposed Programs CE-Eligibility Acceptable programs must adhere to the definition of continuing education in that they improve service to the public and enhance contributions to the profession. Programs that address the personal or professional well-being of the psychologist must also demonstrate how they meet the above definition. Determination of eligibility is t made on the basis of topic alone. The responsibility is on the applicant to adequately establish the bridge between program content and the elements of the criteria. The more distant a topic appears from core disciplinary kwledge, the greater the responsibility of the sponsor to demonstrate the connection to improvement of services to the public and contributions to the profession. The CE Committee will use the Standards and Criteria for Approval of Sponsors of Continuing Education to evaluate proposals. In so doing, they will employ the following evaluative steps: Intent Will it help psychologists better serve the public and enhance the profession? Can it be understood as building on a doctoral degree in psychology? Reject Is it credible (e.g., theoretically; empirically; accepted conventional practice) or does it address legal, ethical, or regulatory professional standards? Proceed to Evaluation Using Additional Criteria ILLUSTRATIVE EXAMPLE: BUILDING YOUR PRACTICE Insufficient learning objectives Acceptable learning objectives Compare advantages and disadvantages of buying versus renting office space Identify the professional, legal and ethical issues related to buying versus renting office space Learn to read a financial report List three regulatory issues concerning electronic medical records and billing systems Maximize income from managed care Negotiate contracts for managed care services which maximize patient care Develop successful strategies for locating sublettors for office space Analyze and minimize confidentiality concerns involving shared office space Maximize case load through successful marketing Create ethically sound marketing tools and techniques Design promotions to attract the self-pay clientele Provide effective client advocacy to third party payors Note: Insufficient learning objectives successfully articulate the advantages that might accrue to the practitioner, but do t extend these to underscore their value to the clients or the broader society that may follow from the kwledge gains associated with this program. Acceptable learning objectives, by comparison, clearly identify the

3 broader contributions that might support the welfare of the consumer and the society by addressing ethical and regulatory implications associated with successful business practice. Criterion D 1 needs to be satisfied in one or more of the following four ways. Although any given program may utilize two or more of these criteria, only one is required. Programs are t advantaged by selecting more than one of the four criteria to satisfy Criterion D1. Each of the four criteria (1.1, 1.2, 1.3, and 1.4) are designed to satisfy Criterion D 1 in qualitatively different ways. Criterion 1.1 reflects the broad consensus of the discipline of psychology in relation to content that is generally accepted as building upon doctoral level training within core areas of psychology. As an example, a program focused on the dialectic conceptualization of borderline personality disorder might use Criterion 1.1 to satisfy Criteria D1 because dialectic theory is a commonly accepted theory. A discussion of theoretical developments concerning borderline personality disorder might build upon the foundational kwledge of the disorder. Criterion 1.2 reflects program content that has been subjected to accepted research practices within psychology and has satisfied broader scientific scrutiny within the field. The emphasis of Criterion 1.2 is placed on the application of sound methodological practices and the availability of scientific support for the program content. As an example, a program focused on a new instrument for assessing, or a new intervention for treating, borderline personality disorder might use Criterion 1.2 to satisfy Criterion D1 by clearly describing empirical work or citing published research that supports the validity of the program content. Criterion 1.3 reflects program content that has been subjected to mechanisms of external professional peer review. This content can extend beyond empirical research (cf. Criterion 1.2) and may include theoretical, conceptual, case studies or secondary research reviews. Criterion 1.3 emphasizes the acceptability of program content based on peer review in journals, professional conferences, or venues of independent review that support the relevance and acceptability of program content for the discipline of psychology. As an example, a program focused on a new theoretical development concerning borderline personality disorder might use Criterion 1.3 to satisfy Criteria D 1 by citing peer reviewed publications (t necessarily empirical) or presentations that support this program content. Criterion 1.4 reflects program content that pertains to ethical, professional or regulatory developments relevant to the discipline of psychology. As an example, Criterion 1.4 might be used to satisfy Criterion D 1 in relation to a program that emphasizes the personal or legal risks and risk management associated with working with individuals with borderline personality disorders. Sample Response to D.1. Course Content Requiring Citations The demonstration of program credibility can include citations to relevant peer-reviewed research, and reference to broader, recognized traditions of research and theory, among others:

4 Example D.1. The Use of Expressive Arts in Psychotherapy Insufficient Response The use of expressive arts in psychotherapy has a longstanding tradition. Music, dance and other creative arts are valuable additions to successful psychotherapeutic practice. This program illustrates a range of expressive arts and their potential applications in the treatment of emotional distress. Drawing from their extensive clinical experience, the presenters demonstrate a variety of expressive techniques that help open clients to new forms of mental health, adjustment, and optional functioning by helping them to recognize and experience their internal response. This program is derived from the work of S. Smith, Clinical Applications of the Expressive Arts (New York: Stonewall Publications, 2000). Acceptable Response The use of expressive arts in psychotherapy has a longstanding tradition. Music, dance and other creative arts are valuable additions to successful psychotherapeutic practice. This program illustrates a range of expressive arts and their potential applications in the treatment of emotional distress. Drawing from the fields of art therapy, dance therapy, and other allied fields of recreational and occupational therapy, this program overviews the historical traditions, current research findings, and practice kwledge that inform the application of arts in psychotherapeutic practice. This program is derived from the following works: McNamara and Scott (2000), Historical Research in Music Therapy, 3 rd Edition. Douglas, D.B., (2001). Effectiveness of the Expressive Arts in Psychotherapeutic Practice: Documentation of Research in Clinical Practice. Journal of Arts in Medicine, 3, Stanford, L.M. and Dickson, E.E. (2001). A controlled study of the effects of expressive arts as adjunctive techniques in psychotherapy. Journal of Psychotherapy Research, 33, Note: The insufficient program description draws primarily from presenter experience and only minimal, n peer-reviewed publications. The acceptable response clearly identifies relevant research literature that supports both the application of the expressive arts and their associated outcomes within relevant clinical contexts. Illustrative Learning Objectives Title: Succeeding in an Academic Career At the conclusion of this program, participants will be able to:

5 Insufficient Learning Objectives 1. identify the advantages in advancing one s career of having a systematic research program 2. manage the complexities of scheduling research assistants, supervisees and other helpers 3. negotiate the ins and outs of getting publications and grants 4. discharge advising obligations while still having time to write 5. increase chances for retention, tenure, and promotion through understanding academic policies and the administrative structure Acceptable learning objectives 1. identify the practical applications for teaching effectiveness of building a systematic research program 2. identify relevant ethical codes associated with research, clinical, or academic supervision with students 3. negotiate the regulatory and ethical information regarding publication and grant writing with colleagues or students 4. apply appropriate mentoring skills for maximal student growth 5. use an understanding of academic policies and the administrative structure to create more efficient classrooms and labs Note: Insufficient learning objectives identify the advantages that might accrue to the individual faculty member, but fail to link these to improved services and the broader regulatory, ethical or professional issues that might also serve broader constituents within this context. By contrast, the acceptable learning objectives effectively tie the kwledge gains associated with this program to the effective functioning of the students and the administrative units associated with the faculty s functioning, and highlight the professional and scientific gains that would be expected to accrue as a result of the program.