Adult Learning and Development Course Syllabus Course Number, Name and CRN: AL 5090 Program Design and Evaluation Term and Year: Graduate Winter Term 2013-2014 Instructor: Kathleen Norris Office Location: 2 nd Floor Highland Hall, College of Graduate Studies Office Phone: 603-535-3023 PSU E-mail: knorris@plymouth.edu SKYPE: norriskath Office and/or Online Availability: By appointment, Skype, email and through Moodle. I am available and happy to meet with students whenever and however our schedules and/or technology can be matched up. I expect students to check in with me regularly and to alert me to any issues ASAP. Course Delivery: This is an online course, but students are encouraged to make direct contact with the instructor, meet in person, and email with any questions or concerns throughout the course! Catalog Description This course deals with a broad spectrum of program development ranging from an individual course to a complete program of major learning activities conducted over a period of time. Participants will design programs based on their own special interests, for example, adult higher education, business and industry training, adult basic education, etc. Major emphasis will also be placed on designing program evaluations tailored to meet specific needs. Course Overview All organizations provide some sort of programming for their various stakeholders. However, when the planning is haphazard and appropriate evaluation has not been designed as part of the planning process, the programming falls short of realizing its full potential. Course participants will demonstrate their ability to use Caffarella s interactive model (2002) of program planning as they master the material presented in each learning module. Enduring Understandings: Mindful planning and evaluation techniques are critical to the success of any program. There are many forms of program planning and evaluation from which to choose. Planning for stakeholder development is cyclical and requires constant revisions. Essential Questions: What is program planning and evaluation? What are the benefits of program planning and evaluation? What are some program planning and evaluation models? What are some of the challenges facing program planners and evaluators? AL 5090 1
Upon Satisfactory Course Completion, each participant will be able to: 1. Distinguish between program design and instructional design 2. Engage in program design at the level most appropriate for their stage of experience 3. Demonstrate their understanding of and ability to carry out each of the following key steps in the program design process: Program needs assessment Development of program goals and objectives Analysis of audience characteristics and their implications for program design Provision for transfer of learning Outline of program content and instructional strategies Formative evaluation and the incorporation of helpful feedback into making program revisions 4. Critique their own program designs and those of others 5. Apply the principles of multiple level program evaluation to their own program designs by creating an evaluation plan Textbook List/Bibliography/Recommended Reading/Resources American Psychological Association. (2010). Publication Manual of the American Psychological Association, (6 th ed.) Washington, DC: APA. ISBN: 978-1-4338-0561-5 Caffarella, R. (2002). Planning Programs For Adult Learners: A Practical Guide for Educators, Trainers, and Staff Developers (2 nd Ed.). San Francisco: Jossey-Bass. ISBN: 0-7879-5225-7 For assistance with APA style, see the APA website for rich resources: http://www.apastyle.org/index.aspx We recommend that you have the Publication Manual of the American Psychological Association, 6 th edition, for use in all of your graduate courses. Additional resources may be contributed by students and the instructor during the term and will be posted in Moodle. Professional Standards, Course Goals/Objectives, and Assessment Assignment Graduate Program Standards Assessment Tool Completion of a written proposal for a program that they have designed, using Caffarella s Interactive Model (2002). Know principles, models, and applications of needs assessment, program planning, and program evaluation. Understand program design in sufficient depth to plan and conduct basic investigations and program evaluations for improvement of services. Understand the importance of research in advancing education for adult learners. Graduate Writing Rubric AL 5090 2
Forum Postings Written Analysis and Critique of Program Planning and Evaluation processes Use data to inform decisionmaking and accountability (e.g., learner feedback, goal alignment). Communicate effectively using APA style. Locate, evaluate and synthesize information. Start, continue, and conclude online conversations. Apply best practices in the development of a culture of teaching and learning. Understand data and use it to inform program development and evaluation. Use appropriate strategies to promote an environment for increased learner achievement. Use principles of effective instruction, research methods and other resources. Use ethical and culturally relevant strategies for interpreting and reporting the results of program evaluation studies. Content of Course Which Addresses Technological Standards/Competence Reflective Writing Rubric Graduate Writing Rubric This course is managed completely through Moodle, which requires that students are able to work in an online environment, both for posting information and gathering information. Students in this course must contribute to online discussions, find and use scholarly resources that are available through online databases, and prepare a final project presentation using appropriate software. Standards Met Through This Course Apply best practices in the development of a culture of teaching and learning. Understand data and use it to inform program development and evaluation. Use appropriate research strategies to promote an environment for increased learner achievement. Understand program design and development in sufficient depth to plan and conduct basic investigations and program evaluations for improvement of services. Translate research into evidence-based practice, i.e., applies relevant research findings to inform the practice of program planning and development. Develop measurable outcomes for programs, interventions, activities, interventions, and experiences. Understand ethical and culturally relevant strategies for interpreting and reporting the results of research and/or program evaluation studies. Know current methods for using data to inform decision-making and accountability (e.g., program improvement plan, summative assessment). AL 5090 3
NOTE: All graduate students must be aware of the standards for their particular profession and degree, and be sure to address those standards in their research proposals. If you have any questions about meeting standards related to your program of study, be sure to contact your advisor. Evaluation Plan/Grading Scale Major Assignments and Grading System NOTE: I suggest you test your technology early and often through your processes and make sure that everyone can open any documents you post in PSU s online learning management system and that you know how to work in the Moodle online environment. Course requirements: o o o Written Analysis: up to 30 points possible Discussion Forum Postings: up to 25 points possible Program Design, including planning and evaluation: 45 points possible Grading: 100-93 points = A 92-90 points = A 89-87 points = B+ 86-83 points = B 82-80 points = B- 79-70 points = C 69-0 points = F All assignments must be completed and submitted, in order to pass the course. Policy on Incompletes: An instructor may decide to enter a grade of incomplete (IC) on a student s record if unusual circumstances prevent completion of the course on time, and a minimal portion of the total class work needs to be completed. The course must be completed by the date specified by the instructor which cannot exceed one year beyond the original term of course completion. If the course is not completed by this date, the grade specified by the instructor will be recorded. If no grade is specified, a default grade of F will be recorded. The instructor is responsible for documenting and notifying the student of the work to be completed and the deadline. A student may not graduate with an incomplete on his or her transcript. Course Calendar/Agenda The spring course runs through the winter term, from December 1 through February 28, with a learning module that includes required readings and discussions taking place during each week, ending on February 28. The final project is due February 16. Grades will be submitted to the system between March 1st and the official close of grades during the first week of March. The term ends officially on February 28 and no work can be submitted for grading after that date; all assigned work must be completed on time to earn full credit and by February 28 at the latest to be included in this term. See the schedule of readings and assignments, which is posted in Moodle. AL 5090 4
Assessment Rubrics The Graduate Writing Rubric, and the Graduate Reflective Writing Rubric are available on the Moodle course site. All students should become familiar with the various state, professional association and national standards that are connected to their professional certifications and work. Students who are submitting work from this course to their culminating program portfolios should be sure to refer to all of the relevant standards their work is meeting. Many students use the work they complete in this course as a foundation for their culminating capstone or thesis. Consult with your advisor if you have questions about applicable standards and how to demonstrate your mastery of them. Conceptual Framework Learners are encouraged to be active agents in their graduate programs through dynamic collaboration with our diverse faculty of scholars and practitioners. The graduate programs foster inquiry and critical thinking through a commitment to: Leadership and advocacy Scholarship and action/application Reflection and innovation Professionalism and service Global awareness and social responsibility AL 5090 5
PSU College of Graduate Studies Program Framework As Developed In AL 5090 Leadership and Advocacy Participants examine the skills needed to create effective training and professional development programs and advocate for the mindful, interactive development of programs for adult learners Reflection and Innovation Participants use Caffarella s interactive framework to examine their own program planning and evaluation experiences, to critique program planning and evaluation designs, including their own, and to design innovative programs to meet the needs of their stakeholders. Scholarship and Application Participants develop a knowledge base of the various steps in the program design process, including planning and evaluation, and apply their learning to their own program design project. Professionalism and Service Participants understand their professional roles and responsibilities related to program planning and evaluation, and engage in mindful processes that serve their organizations and program stakeholders. Global Awareness and Social Responsibility Participants design programs for diverse audiences. Students examine their commitment to social responsibility in the area of program planning and evaluation, and demonstrate the ability to create innovative programs that contribute to social justice. AL 5090 6
University Policies and Procedures ADA Policy: Plymouth State University is committed to providing students with documented disabilities equal access to all university programs and facilities. If you think you have a disability requiring accommodations, you should contact the PASS office in Lamson library (535-2270) to determine whether you are eligible for such accommodations. Academic accommodations will only be considered for students who have registered with the PASS Office. If you have a Letter of Academic Accommodation for this course from the PASS office, please provide the instructor with that information privately so that adaptations can be made to meet your needs. Course materials online comply with the Web-based Intranet and Internet Information and Applications Standards in accordance with ADA Section 508. Academic Integrity: Academic integrity is the foundation of the pursuit of knowledge. All members of the academic community are expected to be dedicated to the pursuit of knowledge in an honest, responsible, respectful, and ethical manner. Every violation of academic integrity is an affront to the academic community. Violations of academic integrity make fair evaluation impossible and cast doubt upon the seriousness with which students accept the responsibility of acquiring an education. Members of the academic community are expected to report all instances of those violations of academic integrity that come to their attention. Both faculty and administration consider it their duty, as guardians of academic standards and intellectual honesty, to enforce the academic integrity policy by prosecuting all cases of violation of academic integrity to the fullest extent. Students are urged to consider that it is the toleration of violations of academic integrity, and not the reporting of it, that is dishonorable. Please refer to the Graduate Catalog for more information and the entire policy. Sensitive Materials: Material in this course, in some instances, may be sensitive or emotionally provocative. As you review the syllabus, or at any time during the course, please let your instructor know if you anticipate, or are having, a problem with any assignment or classroom activity. We can then discuss how this assignment or activity is necessary for meeting course competencies and whether an alternative assignment or activity can be considered. We can also discuss campus resources that you may find helpful in dealing with your concerns. Plymouth State University Curtailed Operations Information: Plymouth State University normally remains open through inclement weather. Because most students live within minutes of the campus, every effort is made to avoid an official closing. There may be times, however, when an emergency or extreme weather conditions necessitate a general closing of the University. Please sign up for PSU Alert Emergency Text Messaging at: plymouth.edu/alerts Following are the PSU curtailed operations and/or class cancellation notification procedures: In the event of severe weather or an emergency, the University Administration will do all it can to decide on and post notifications of class/event cancellations and/or facility closures by 6:00 a.m. for classes running during the day. For canceling evening classes, the decision is usually made and communicated no later than 3:00 p.m. Every effort will be made to make the decision as early as possible. If you are wondering, call the storm line (603-535-3535) or check the PSU website. Use your own judgment about travel during inclement weather; the best choice is the one that keeps you safe. Notify your instructor(s) if you have to miss a class. Lamson Library and Learning Commons Access to the IT Help Desk is available at 603-535-2929. Log in to MyPlymouth to access all of the Lamson Library and Learning Common resources and services. The Writing Center and the PASS office are located in the lower level of Lamson; the Help Desk in on the Main Floor. AL 5090 7