Print. Recommendations & Responses. Data Review and Analysis for Enrollment

Transcription

1 Page 1 of 16 Print Annual Unit Update - Recommendations & Responses Recommendations & Responses Commendations No Commendations Have Been Made. Recommendations No Recommendations Have Been Made. Access - Enrollment Respondent(s): David Jordan, DE Coordinator Data Review and Analysis for Enrollment Analyze trends in Enrollment over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to college-wide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning. Response: The high point in online enrollment was in Spring 2009 with 2454 and a low of 1454 in Spring There are two major reasons for the decreasing enrollment. One is the overall decline in class offerings due to budgetary cost cutting over the period. The second reason is the DE Committee and the VPAA agreed to "suspend" the approval of new online classes during the review and approval of the DE Substantive Change from 3/15/10 - until the ACCC approved the substantive change on 6/6/12. In addition, the gap analysis of Dr. Matthew Lee of 9/13/13 and the DE 3 Year Plan (see under attachments) recommend a goal and objective: "systematically evaluate and improve DE Offerings, services, infrastructure and procedures. This will improve the enrollment of online classes. Our online enrollment and number of online classes should probably remain at approximately 10-12% to be competitive with our sister colleges in the LACCD and to provide our students additional pathways to achieve transfer, degrees and certificates through supplementing their on campus classes with high quality online classes. Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted

2 Page 2 of 16 Student Success - Successful Course Completion Respondent(s): David Jordan, DE Coordinator Student Success - Awards Data Review and Analysis for Student Success Analyze trends in Student Success over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to college-wide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning. Response: Successful course completion in DE/Online classes has increased from 63.4% in FAll 2008 to 71.4% in Spring This can be attributed to the strong online faculty teaching at Mission, and the level of students who take our online classes. Student success has increased from 63.1 %, about par with the college average, to 71.4% which exceeds the college average. This is unusual since most colleges see a student success level at lower rates than the college average. Again this is due in part to the level of training our online faculty receive. To teach online, our faculty are required to become certified in Online Pedagogy - (see attachment below) of the Intro to Online Teaching and Learning Course Syllabus which outlines the rigorous training and certification our online faculty are required to receive. In addition, the Curriculum Committee now reviews each online course shell using the annotated Quality Matters Shell Review Rubri (see attached below) which ensures that each new online class is thoroughly reviewed before it is taught. It is surprising also that student retention has increased from 82.6% to 85.6% from 2008 to 2013, a quantitative difference over 5 years. Again the retention rate is most likely due to the above described factors of training, and certification of our online faculty. In addition, during the hiatus for approval of online classes at Mission from March of 2010 to June of 2012 (more than two years), both DE and Curriculum worked assiduously to improve the steps for review and approval of both online faculty, and online course. see below attachment. Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted Data Review and Analysis for Degree/Certificate Awards Respondent(s): David Jordan, DE Coordinator Analyze trends in Degree/Certificate Awards over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to collegewide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning.

3 Page 3 of 16 Response: The DE Program Review, the DE 3 year Plan, and the Unit Assessments of Department Chairs will review and plan for increased online classes to provide both degrees, certificates in an online format. The Department Chairs were surveyed as part of our substantive change - see survey results in the below attachment. To date, the only certificate (or program, degree) online is the Paralegal Studies Program (Paralegal/Legal Assisting Certificate of Achievement) which qualifies as paralegal certification under Calif. Bus. Prof. Code Section 6400/6450. The above data should be revised in the future to include our DE Paralegal Certificates received online. That program graduates approximately 50 graduates every year. (see attachment below) In Spring 2009, the DE Committee reviewed the units of classes online and the certificates or degrees available (Paralegal Program), or nearly available online (Chicano Studies, History, Philosophy, Psychology, Sociology) - see attachment below. Some departments, such as the Physical Sciences, Math, and Speech were inclined to only offer online degrees through a hybrid format (i.e. part on campus and part online), and not entirely online. Such an approach would lend itself to create an on campus "cohort" model, and then Math could use the "Statway" approach to contextualize the coordinator of statistics assignments with the particular degree (i.e. coordinate with online instructors in Sociology, History, Chicano Studies, Psychology, Philosophy, Political Science, etc. to contextualize the statistics assignments with the subjects being taught online with increased math "success rates" to enhance the student success/retention and graduation rates towards transferable CSU/UC degrees, and certificates. see below article on contextualization to support this concept and approach. Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted Learning & Teaching - SLO Update DISTANCE ED Respondent(s): SLO Update Summary: Courses w/all SLOs Assessed: 0/0 (0 %) Courses w/at least one SLO Assessed: 0/0 (0 %)

4 Page 4 of 16 Describe the status of the SLO Assessment in this discipline. Response: Summarize the changes that have been implemented based on SLO and PLO assessments from the past year. Response: Have the outcomes been re-evaluated since the implemented changes, and if so, has there been an improvement in student learning? Are any further changes scheduled? Response: Learning & Teaching - Advisory Board Advisory Board (Occupational Disciplines Only) Exists Minutes Kept Recommendations Made Recommendations Implemented Yes Yes Yes Yes No No No No Meeting Frequency Respondent(s): Describe the status of the Advisory Board for this discipline. Response: We have no Advisory Board. We do participate in a district wide group of Distance Education Coordinators ( LACCD DDEC ) see below attachment to show the flowchart of decisions from an individual college (DE Committee), to the District DE Committee (DDEC), to TPPC - Technology Policy and Procedures Committee, District Academic Senate, AFT, and then to the Chancellor for review and approval. This flowchart outlines the support network for DE and is akin to an Advisory Board for a certificate program. Please list the recommendations from your advisory board and the actions taken or plan developed as a result of advisory board recommendations. Response: Fiscal Responsibility - FTES Semester Last Meeting Date Month / Year

5 Page 5 of 16 Respondent(s): David Jordan, DE Coordinator Data Review and Analysis for FTES Analyze trends in FTES over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to college-wide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning. Response: Total decline in FTES follows the same trend in online enrollments, and percentage of online vs. campus classes. See previous discussions To increase the FTES, the college needs to: 1. Establish a separate DE Cost Center 2. Establish a separate DE Budget 3. Provide financial and technical support resources, including IT development, staff development, and student services support online. See the below DE Resource Request to support an increased "online presence" at Mission and thus increasing numbers for online enrollments, online classes, and increased FTES over the next three to five years. Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted Fiscal Responsibility - FTEF Data Review and Analysis for FTEF R, FTEF H, FTEF Respondent(s): David Jordan, DE Coordinator Analyze trends in FTEF Regular, Hourly & Total over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to collegewide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning. Response: To support our online classes at Mission and to grow, we will need to have more online classes and thus more online faculty. This should occur through careful planning through this DE Program Review and Unit Assessment in consultation, of course, with the VPAA and VPSS, and VPAS for planning purposes, along with alignment with the Educational Master Plan, and Dept Chairs through the Council of Instruction.

6 Page 6 of 16 Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted Fiscal Responsibility - Enrollment Per Section Respondent(s): David Jordan Effective Use of Technology Data Review and Analysis for Average Class Size Analyze trends in Average Class Size over the period for which data were provided, using detailed breakdowns as necessary. Where college-wide data is provided, compare discipline to college-wide trends. Also, discuss college-wide or discipline-department specific factors as they relate to these trends and note the implications on your discipline/department operations or planning. Response: Class size in online from Fall 2008 to Spring 2012 exceeded the College average. This is because online classes are very popular and fill up very quickly. Overall, though, total enrollment, and number of classes have declined steadily from Fall 2008 to Spring Part of this is due to the substantive change and the decision of the DE Committee and the VPAA to suspend the approval of new online classes pending the approval of the substantive change, and development of new online certification and approval process. Was a trend analysis done? Yes Was a comparative analysis done? Yes Was a detailed analysis done? Yes Data Evaluation: Accepted Effective Use of Technology Faculty in this Discipline use the following technologies (check all that apply) PowerPoint/Computer Projector Yes. No. Instructor Website Yes. No. Overhead Projector Yes. No. VHS Yes. No. CD ROM Yes. No. Respondent(s): David Jordan, DE Coordinator

7 Page 7 of 16 Describe the use of technology in this discipline. Response: Our online classes use a robust course management system which is the Etudes (Easy to Use Distance Education Software) program used by most of the LACCD sister colleges. LC participated in the Etudes Summit just held on November 7-8 in San Francisco where etudes faculty met and attended workshops on integrating new technologies of videos, twitter, surveys, and the like into their etudes classes. See attachment below on the substantive new technology introduced at the Etudes Summit to the etudes faculty in attendance. The DE Coordinator from Mission, and one other online faculty member (online Nutrition class) attended, and they will make a presentation of this training to faculty in January to LC faculty during the winter break. Curriculum Status = Expired = OK = About to Expire = Archived / NA The information below is populated from the LACCD ECD System. DISTANCE ED Annual Planning Evaluation Annual Planning Evaluation 1) Provide a summary statement concerning the success of the unit in meeting the objectives identified in the previous year s program review. If budgetary recommendations were made by the Budget & Planning Committee, please include in your summary whether those recommendations have been implemented. This is the first year that DE is submitting its DE Program Review and Unit Assessment. See the DE 3 year Plan supplemental file at the beginning of this program review. In the next cycle of review for , DE will evaluate its 3 year plan. 2) Summarize significant results/outcomes or improvements that have been implemented of any projects or improvement plans identified in the previous year s program review, and discuss if you are going to continue these improvements or change them based on the results/outcomes. You may also discuss projects/plans/accomplishments from your unit over the past year, even if they were not mentioned in your previous program review. This is our first year of program review. Next year (2014) we will fill in this portion of program/unit assessment. 3) Describe the unit's status regarding professional accreditation (if applicable) DE/Online at Mission submitted a Substantive Change Proposal. see below attachment which was approved by ACCJC on We are now authorized to develop online AA degrees and certificates that exceed the 50% mark which triggers a substantive change. The ACCJC did recommend that we work on increasing our student services to our online students.

8 Page 8 of 16 Respondent(s) David Jordan, DE Coordinator Challenges & Opportunities Challenges & Opportunities 1) Program strengths, weaknesses and opportunities for improvement A. Identify unit strengths and recommendations to strengthen existing unit programs 1. The DE Coordinator at Mission is excellent. He is well trained, works well with faculty, updates the college online website - see supplemental file attached herein, and the DE website, maintains the agendas and minutes of DE meetings, runs the DE meetings, prepared and assisted the college in obtaining Substantive Change Proposal, attends the monthly district DE Coordinators meetings, spearheaded the change and transition from moodle to etudes course management system. see supplemental files herein. 2. Another strength is our selection of the etudes course management system, the great etudes support we get from etudes staff, and our online and on campus faculty who were certified in etudes and are currently using it in the classroom and online. Over 100 faculty were trained during the Winter and Spring 2013 semester, and online, hybrid and web enhanced course increased almost 70% from 50 to 60 courses to over 150 courses/sections using etudes to deliver web content to students in the Spring 2013 semester. B. Identify unit weaknesses and recommendations to correct weaknesses 1. The costs of the course management system can get "out of control" fairly easily. We started this last semester at $11,500, which was a very discounted rate for a Level 4 support (actual cost $ 23,500). We would exceed the 6500 seat limit which triggers a cost increase of 100% to a level 5 once we cross the 6500 student threshold. We need to carefully manage the use of this semester. Please see attached recommended strategy we need to adopt to control the costs of our Etudes Course Management system. 2) Describe any significant recent events or activities in the state, surrounding community, college, and/or discipline that may have an impact on your unit in the coming year(s). Gov. Jerry Brown provided $16.5M to support online education in California. Recently Foothill- DeAnza and Butte won approval to start this initiative. This may prove very valuable in providing a standard course management system for all of our online classes at Mission and throughout the District. see below supplemental file. We will need to follow these developments closely. We also need to link up to the new State Wide DE Coordinators group, and we will do that through our participation in the District DE Coordinators Committee (DDEC). We also need to network with the Chancellors Office State Wide DE Coordinators and their monthly meetings which are archived at - see attached supplemental file. Respondent(s) David Jordan, DE Coordinator

9 Page 9 of 16 Supplemental Files Supplemental Materials: FileName Description Uploaded Related Area State Wide DE Coordinators Monthly Meetings.pdf CMS-Cost-Management.pdf California Online Education Initiative.pdf DE websites.pdf Etudes-Pricing-Schedule pdf executive-summary.pdf Chancellor's Office State Wide Monthly DE Coordinators Meetings and Archives - maintained Course Management System (CMS) Cost Management Strategy at Mission (proposed plan for further review and adoption by the college) California Online Education Initiative, recently awarded to Foothill-DeAnza and Butte Community Colleges. This initiative, if successful, will provide a single, low cost CMS throughout the State of California, and thus help Mission, and other colleges throughout the LACCD control the ever increasing costs of delivering online classes. The DE Coordinator maintains and updates the following websites 1.lamission.edu/online 2. DE website 3. Etudes Help Desk Etudes Pricing Scale - We should budget for an increase to include students which will move us from Level 4 to a Level 5 $50,300 Course Management System Analysis - Executive Summary in support of transition from moodle to etudes during Spring and Fall :46:00 3:37:00 3:13:00 2:56:00 2:23:00 2:09:00 Challenges & Opportunities Challenges & Opportunities Challenges & Opportunities Challenges & Opportunities Supplemental Files Challenges & Opportunities

10 Page 10 of 16 DE Coordinator Responsibilities.pdf OnlineTechSupportAsst_June13-1.pdf substantive-change-proposal.pdf sustainability.pdf epc-eval-update.pdf Etudes Summit Workshops.pdf DE Coordinator Duties and Responsibilities which support.6 release time in the yearly DE budget Online Technical Support Assistant for technical support and assistance to students, faculty members and other staff with online courses, learning management systems, and other web-based instruction support at Mission Substantive Change Proposal for Distance Education at Mission. ACCJC approved our substantive change on DE Sustainability All of the online classes were reviewed by DE and Curriculum prior to and as part of the Substantive Change Proposal to the ACCJC which was approved in June See the EPC Eval Update along with the DE "Sustainability" which is required to ensure our online classes are kept up to date, along with implementing needed resources such as online student services, counseling, etc. Etudes Summit workshop where new web technologies were introduced to etudes faculty. LC will incorporate many of these new technologies into its online classes to ensure we keep pace with the "constant" changes in the "technology world" and the world of online classes 2:07:00 1:41:00 1:19:00 1:22:00 1:21:00 1:10:00 DE Resource Request - Challenges & Opportunities Supplemental Files Annual Planning Evaluation Curriculum Status Curriculum Status Effective Use of Technology

11 Page 11 of 16 DE Resource Request.pdf laccd-de-1.pdf Assessing SLOS in an online environment.pdf contextualization.pdf chair-survey.pdf online-degrees-lc.pdf de-forms.pdf Budget Costs to support DE Flowchart of DE decisions from an individual sister college campus to the District DE Committee (DDEC), and District Academic Senate, AFT, and the TPPC (Technology Policy and Planning Committee) and then to the Chancellor. This is the current support network for determining "best practices" in online classes, pedagogy, support, infrastructure, etc. which would otherwise be provided by an Advisory Committee Assessing SLO's in an Online Environment - Rochester Institute of Technology Contextualization of math statistics ("statway") with online degrees in Sociology, History, Chicano Studies, Psychology, Philosophy, and Political Science Chair survey on whether and which departments might support online degrees and certificates (part of the Substantive Change Proposal and rationale for the submission of a Substantive Change Proposal to ACCJC) Certificates or degrees available or nearly available online - DE report of November DE forms, and procedures for approval on online faculty and online courses developed by both DE and Curriculum over a 2 year period ( ) 12:44:00 12:32:00 12:07:00 11:46:00 11:34:00 11:30:00 11:01:00 FTES Advisory Board SLO/Assessment Update Degree/Certificate Awards Degree/Certificate Awards Degree/Certificate Awards Successful Course Completion

12 Page 12 of 16 updated-annotated-rubric.pdf IOTLCourseGuideFall2013.pdf Gap Analysis - Recommendation 4 - DE.pdf DEACT-7.doc DEACT-7.doc DE Resource Request.pdf LACCD-LC- ETUDES_INVOICE.pdf remote-learner-quote-2290.pdf Etudes-Pricing-Schedule pdf proposal-5.pdf Quality Matters annotated course shell review rubric used by Curriculum/DE Tech Review to review and approve each new online course shell before it is Certification - Course Syllabus for Online Pedagogy required of all of our online faculty DE Gap Analysis - ACCJC Recommendation #4 - by Dr. Matthew Lee DE 3 Year Plan DE 3 year Plan - includes goals, objectives, outcomes, deliverables, activities, timeline and person responsible, progress report and costs DE Resource Request & Etudes Invoice $16,750 for 7/1/13-6/30/14 (1 year) - Level 4 services $23,500 discounted price (for Level 4 will be $23,500 with no discount applied) Moodle Archive Contract Etudes transition $2290 Etudes Pricing - LC is at Level 4 (6500 students), but should budget for Level 5 ($50,300 - up to 10,000 students for ) see substantive change proposal of :53:00 10:48:00 10:31:00 10:30:00 9:51:00 9:51:00 7:42:00 7:33:00 7:23:00 10/25/2013 2:18:00 Successful Course Completion Successful Course Completion Enrollment Enrollment Response to Recommendations Response to Recommendations Response to Recommendations Response to Recommendations Response to Recommendations Enrollment Per Section Feedbaack

13 Page 13 of 16 Feedback For continuous improvement, Program Review Oversight Committee takes your suggestions seriously. Please tell us which screen name(s) you would like to improve or change and how to make those changes or improvements. There is no access to a pdf file of the last year unit program review for our paralegal program to be able to better respond to the "annual planning evaluation" part of program review this year. It asks to compare to last year's evaluation. I would suggest including a pdf file in that section which refers back to the previous year unit assessment. (I fortunately had saved a copy on my computer and could refer to it). Also I could not save a pdf of the current program review before submitting it so i could review the entire document to be able to better edit portions of it, rather than clicking and navigating each section, one at a time. It would help enormously to be able to look at a pdf output of the entire program review once complete. I assume that once you submit you cannot go back to review what you have submitted. I know you cannot edit it again, but can you go back to review it? I will check that out once I submit. That would be another suggestion - to provide a URL of the completed program review for later use and review. I would recommend that we be able to link over to various docs at lamission.edu like the strategic master plan, and the other master plans, and the gap analysis of Dr. Lee, ACCJC docs posted under accreditation etc. That will help then to provide the link as a reference to what action was taken on it to improve our programs.. I would also provide some documentation/tutorials within the program review that you can click on while updating the resources/objectives on how to remove or retire or discontinue objectives and attached resources, as I got confused on how to do it, but later figured it out. Other than that, I love the box for attachments in each part of the assessment as it got me to thinking on how to improve our program. great job everyone in improving this assessment tool. thanks Nick, and everyone in IT for your great efforts in improving the program review application this time around. l thanks David Jordan, Esq. Director of the Paralegal Studies Program Respondent(s) David Jordan Active Objectives & Resources Objective Objective: Previous Set Goal: New Related Goal Areas: Individual(s) Responsible: David Jordan Support a Course Management System for online learning ( ) (Priority: High) 1. Expand Access and Prepare Students for Success 3. Improve Quality of Educational Programs and Services to Increase Student Success Period: 7/1/2014-6/1/2015 Activity: Support an online course management system for the delivery of our on campus (web enhanced), hybrid and online classes. Currently our CMS is Etudes. See the attached pricing scale for our online classes. We currently have 6500 students, and so we should budget for moving from a Level 4 to a Level 5 support in Etudes. Expected Outcome and FTES, student success and student retention

14 Page 14 of 16 Measure: Assessment: Status: InProgress Resource Objective Resource Requested: Other ( ) (Quantity: 0 Units ) Anticipated Total Cost: $50,300 Contact Person: Description of Item: Level 5 support for Etudes which supports up to 10,000 students. We currently are on Level 4 which supports 6500 students, and for Spring 2013 we slightly exceeded the 6500 limit and Etudes waived the difference. Type: Ongoing Resource Priority: High Status: PendingFunding Objective: Previous Set Goal: New Related Goal Areas: Individual(s) Responsible: David Jordan Utilize a DE Coordinator to coordinate the online program ( ) (Priority: High) 1. Expand Access and Prepare Students for Success 3. Improve Quality of Educational Programs and Services to Increase Student Success Period: 2/1/2014-6/1/2015 Activity: Expected Outcome and Measure: Assessment: The online/de program and online classes are required to have a DE Coordinator. Each college throughout the LACCD has a DE Coordinator. The DE Coordinator is responsible for a number of activities. see supplemental file herein annual program review and improvement of overall DE program as measured by FTEF, FTES, student success, retention for online students. Status: InProgress Resource Resource Requested: Anticipated Total Cost: $21,062 PersonnelHourly ( ) (Quantity: 12 StandardHours )

15 Page 15 of 16 Objective Contact Person: David Jordan Description of Item: The DE Coordinator at Mission was at.2 release time. The Gap Analysis of Dr. Lee indicated that the college should review the DE Coordinator release time, and increase it, if appropriate. The College President and VPAA reviewed the matter and increased the DE Coordinator position from.2 to.4 immediately in the Fall Semester (thus the.6 release time for the DE Coordinator in Spring 2014.) Compared with other DE programs, the DE release time should remain at.6 and not.4 - see supplemental file herein on the responsibilities of the DE Coordinator Type: Ongoing Resource Priority: High Status: PendingFunding Objective: Increase technical assistance ( ) (Priority: Medium) Previous Set Goal: New Related Goal Areas: Individual(s) Responsible: David Jordan 1. Expand Access and Prepare Students for Success 3. Improve Quality of Educational Programs and Services to Increase Student Success Period: 7/1/2014-6/1/2015 Activity: Expected Outcome and Measure: Assessment: Our online/de classes and faculty at Mission need additional technical assistance improved access to online classes, assignments, improved student success and retention. Status: InProgress Resource Resource Requested: Anticipated Total Cost: $4,638 Contact Person: Description of Item: PersonnelHourly ( ) (Quantity: 300 HoursStudentWorker Student Tutor IV ($15.46)) The online technical support assistant - see job description as a supplemental file attached herein will provide routine technical support and assistance to students, faculty members, and other staff with online courses, learning management

16 Page 16 of Active Resource Summary Category Distance Education Budget Information systems and other web-based instruction support at Mission. Type: Ongoing Resource Priority: Medium Status: PendingFunding FTE On-Going Requests One-Time Requests Total Cost Personnel (Adjunct) $25,700 Personnel (FRg/Classified/Unclassified) $0 Supplies/Printing $0 Equipment $0 Other $50,300 Totals $76,000 Category FTE Total Budget Academic Adjunct (Sp 14) $0 Academic Adjunct (Fa 13) $0 Academic Regular (Fa 13) $0 Department Chair Hourly $0 Personnel (Misc E-E Bnfts/Classified/Unclassified) $0 Supplies/Printing/Postage $0 Equipment $0 Other $0 Totals $0 Unit Assessment Completed By: David 1:29:00 Unit Assessment Submitted By: David 11/25/2013 9:33:00