Overview of 2007 Survey Results St. Johns River Community College

The Community College Survey of Student Engagement (CCSSE) Introduction Overview of 2007 Survey Results St. Johns River Community College The Community College Survey of Student Engagement (CCSSE) provides information about effective educational practice in community colleges and assists institutions in using that information to promote improvements in student learning and persistence. CCSSE s goal is to provide member colleges with results that can be used to inform decision making and target institutional improvements. Student engagement, or the amount of time and energy that students invest in meaningful educational practices, is the underlying foundation for CCSSE s work. CCSSE s survey instrument, the Community College Student Report (CCSR), is designed to capture student engagement as a measure of institutional quality. CCSSE Member Colleges CCSSE will again utilize a 3-year cohort of participating colleges (2005 through 2007) in all of its data analyses, 1 including the computation of benchmark scores. This cohort is referred to as the 2007 CCSSE Cohort. This approach, which was instituted in 2006, increases the total number of institutions and students contributing to the national dataset; this in turn increases the reliability of the overall results. In addition, the 3-year cohort approach minimizes the impact, in any given year, of statewide consortia participation. The 2007 CCSSE Cohort is comprised of a total of 525 institutions across 48 states, plus British Columbia and the Marshall Islands. Two hundred sixty of these member colleges are classified as small (< 4,500), 136 as medium (4,500-7,999), 83 as large (8,000-14,999), and 46 as extra-large institutions (15,000 + credit students). 2 One hundred two of the Cohort member colleges are classified as urban-serving, 113 as suburban-serving and 310 as ruralserving. 3 Our college falls into the medium size category and is classified as being located in a ruralserving area. 1 For returning participants, the college s most recent year of participation is included in data analyses. For example, if a college participated in 2005 and 2007, only the 2007 data would be used in the 3-year cohort. 2 Size classifications are based on the college s enrollment size during their most recent year of CCSSE participation; this may or may not match the college s current size classification. 3 These designations are based on the Carnegie Foundation Classification of Institutions of Higher Education. 1

Student Respondents Credit classes were randomly selected stratified by time of day (morning, afternoon, and evening) from institutional class data files to participate in the survey. Of those sampled at our institution, 717 students submitted usable surveys. The number of completed surveys produced an overall percent of target rate of 90%. Percent of target rate is the ratio of the adjusted number of completed surveys to target sample sizes. (The adjusted survey count is the number of surveys that were filled out properly and did not fall into any of the exclusionary categories. 3 ) 2007 Student Respondent Profile To compare the characteristics of student respondents with the characteristics of the underlying student population for each participating college, CCSSE uses the data reported by the institution in its most recent IPEDS Enrollment Report for the following variables: gender, race and ethnicity, student age, and enrollment status (part- or full-time). The data are aggregated to compare the 2007 CCSSE Cohort survey respondent population to the total student population of the 2007 CCSSE Cohort member colleges. Gender (survey item #30) Of the 704 student respondents at our college who answered this item, 39% are male and 61% are female. This mirrors the full population of the CCSSE Cohort community college students, comprised of 41% males and 59% females. Age (survey item #29) The 2007 CCSSE student respondents at SJRCC range in age from 18 to 64 years old. Approximately 91% are between 18 to 39 years old; 71% are 18 to 24 years old while 20% are 25 to 39 years old. Racial Identification (survey item #34) Seventy-nine percent of student respondents identify themselves as White/non-Hispanic, 5% as Hispanic/Latino/Spanish, 8% as Black or African American, and 2% as Asian. One percent of the student respondents are Native American. Two percent marked other when responding to the question, What is your racial identification? International Students (survey item #33) Three percent of our students responded yes to the question, Are you an international student or foreign national? Enrollment Status (survey item #2) Sixty-six percent of the student respondents report attending college full-time, while 37% of the 2007 CCSSE Cohort colleges total student population attended full-time. Only 34% of surveyed students report being part-time college students, compared to 65% as reported to IPEDS. This inverse representation is a result of the sampling technique and the in-class 3 See exclusionary rules on page 4. 2

administration process. For this reason, survey results are either weighted or disaggregated on the full-time/part-time variable so that reports will accurately reflect the underlying student population. The results for the following student respondent categories are weighted according to the most recent IPEDS population data. Limited English Speaking Students (survey item #32) Students with limited English speaking skills, or those whose native language is not English, comprise a significant proportion of students in community colleges. At our institution, 3% of enrolled students are non-native English speakers. Educational Attainment of Parents (survey item #36) Thirty-six percent of respondents indicate that their mothers highest level of education is a high school diploma (with no college experience), and 32% indicate that level for their fathers. Approximately 12% of students indicate that their mothers highest level of education is an associate degree, with 8% indicating this level of attainment for their fathers. Twelve percent indicate that their mothers hold a bachelor s degree, and 13% indicate the same for their fathers. Only 8% of respondents indicate that their mothers hold an advanced degree, and 9% indicate that their fathers hold the same. Educational Attainment (survey items #1 and #35) Seventy-one percent of the respondents report starting their college careers at this community college. Approximately 75% of students indicate that their highest level of educational attainment is a high school diploma or GED; 65% have completed fewer than 30 credit hours of college-level work; 19% report either a certificate or an associate degree; 2% have earned a bachelor s degree; and 0.4% have earned an advanced degree. Credit Hours Earned (survey item #23) Thirty-one percent of surveyed students have completed fewer than 15 credit hours; 21% have completed 15-29 credit hours; and 35% have completed more than 30 credit hours. Grades (survey item #21) Forty-two percent of students report that they earned grades of B+ or higher, while 2% of students report that they earned grades of C- or lower. External Commitments (survey item #10) Sixty-three percent of students work 21 or more hours per week; 28% of students care for dependents more than 30 hours per week; and 13% of students spend at least 6 hours per week commuting to class. 3

Excluded Respondents The total counts of respondents in an institution s raw data file will differ from the numbers reported in the institutional reports due to intentional exclusion of certain surveys. Exclusion in accord with consistent decision rules serves the purpose of ensuring that all institutional reports are based on the same sampling methods and that results therefore are comparable across institutions. Respondents may be excluded from institutional reports for the following reasons: The respondent did not indicate whether he or she was enrolled part- or fulltime at the institution. Because all results are either weighted or broken down by enrollment status, this is essential information for reporting. The survey is invalid. 4 Students reported their age as under 18. Students indicated that they had taken the survey in a previous class. Over-sampled respondents are not included. These are surveys that individual institutions paid an additional fee to acquire. Because there are no requirements stipulating how these students are sampled, these data are not included in the standard institutional report. Selected Findings Many crucial questions that community colleges need answered What are our students goals? What issues keep our students from persisting? How effectively are we engaging students in the classroom? How satisfied are our students with the support services we offer? can be answered by investigating the percentage of student responses to specific CCSSE survey items. This section on Selected Findings from the 2007 CCSSE data is organized in terms of six key topics: Educational Goals, Academic Experience, Barriers to Persistence, Student Satisfaction, Student and Academic Support Services, and Participation in Selected Activities. Educational Goals Students responding to the survey are given the opportunity to mark Primary Goal, Secondary Goal, or Not A Goal in response to a list of possible goals for attending the College. As a result, many students mark more than one primary goal; therefore, the percentages in the table below do not sum to 100%. As seen in Table 1, students identify various educational goals. Seventy-three percent of the student respondents identify obtaining an associate degree as a primary goal. Fifty-four percent are interested in transferring to a 4-year college or university, while 35% are primarily interested in obtaining or updating job-related skills. Thirty-one percent of respondents seek to change careers, and 24% aspire to complete a certification program. Table 1: Educational Goals 4 If a student does not answer any of the 21 sub-items on item 4, answers "Very Often" to all 21 items, or answers "Never" to all, the survey is excluded. 4

Primary Goal Secondary Goal Not a Goal Educational Goal Complete a certification program 24% 19% 57% Obtain an associate degree 73% 18% 9% Transfer to a 4-year college or university 54% 27% 20% Obtain or update job-related skills 35% 28% 38% Self-improvement/personal enjoyment 36% 35% 29% Change careers 31% 15% 54% Academic Experience The CCSR asks students to respond to seven survey items in order to gauge how actively they are involved in their education. Students were given the opportunity to mark Very Often, Often, Sometimes, or Never in response to items such as the following: Asked questions in class or contributed to class discussions Made a class presentation Worked with other students on projects during class Worked with classmates outside of class to prepare assignments While some students are highly involved in their academic experience (those who marked Often or Very Often), others are less engaged, as illustrated by their responses of Never, as displayed in Figure 1. Student Learning 5

Students were asked to indicate how much their coursework emphasizes intellectual processes such as memorization, the application of theories and concepts to practical problems, analysis, synthesis and organization, making value judgments, and using learned information to perform new skills. Figure 2, illustrates students perceptions of the extent to which the College promotes these cognitive activities. Barriers to Persistence CCSSE also asks students to indicate the issues that would require them to withdraw from college. The percentage of students who report that the various factors would result in their withdrawing from class or from college is highlighted in Figure 3. Again, students could mark more than one factor; therefore, percentages will not sum to 100%. Other barriers to persistence include lack of peer or familial support. Nineteen percent of students report that their friends are Somewhat or Not Very supportive of your attending this college while only 9% respond similarly about support from their immediate families. Student and Academic Support Services 6

Often surveys ask a combination of questions relating to satisfaction, use, or importance levels of services, but rarely are surveys designed in a way that asks students to link all three, as does CCSSE. Table 2 displays use, satisfaction, and importance of a number of key academic and student support services. The first column reports the percentage of students who say that they used the service either Sometimes or Often; the second column shows the percentage of students who report they are Somewhat or Very Satisfied with the service; and the third column reports the percentage of students who rate the service as Somewhat or Very Important. Accordingly, students are most likely to use, express satisfaction with, and rate as important the following services: academic advising and planning and computer labs. While 60% of students report student organizations as important, only 13% participate in student organizations and only 28% are satisfied with this service. Similarly, 61% of respondents rate job placement assistance as important, but only 5% use this service and only 18% are satisfied with it. Table 2: Student Services by Use, Satisfaction, and Importance Use Satisfaction Importance Academic Advising/Planning 56% 73% 91% Career Counseling 31% 50% 79% Job Placement Assistance 5% 18% 61% Peer or Other Tutoring 14% 30% 69% Skills Labs (writing, math, etc.) 33% 43% 74% Financial Aid Advising 47% 52% 80% Computer Lab 63% 73% 85% Student Organizations 13% 28% 60% Transfer Credit Assistance 22% 31% 72% Services to Students with Disabilities 6% 15% 61% Note: The services highlighted in bright blue in each column are the three highest ratings in that area while the services highlighted in red are among the lowest rated in each area. Participation in Selected Activities The first 21 engagement items on the CCSR ask students to indicate how often they have engaged in particular activities during the current academic year. For purposes of analysis, the response categories for Often and Very Often were collapsed to report substantial levels of engagement. This information is highlighted in Table 3. 7

Table 3: Percentage of Students Who Reported Participating Often or Very Often in Selected Activities by Enrollment Status Most Frequent Student Activity Items All Part-time Full-time Asked questions in class or contributed to class discussions 66% 66% 64% Used the Internet or instant messaging to work on an assignment 62% 58% 70% Received prompt feedback (written or oral) from instructors on your performance 62% 63% 60% Worked on a paper or project that required integrating ideas or information from various sources 55% 51% 61% In comparison, it is also important to note what students are not doing in college as frequently as one might expect. To report the least frequent activities, the never response category was used. Table 4 highlights this data. Part-time students are more likely than are their full-time peers to report never when responding to student activity items. Table 4: Percentage of Students Who Reported Never Participating in Selected Activities by Enrollment Status Least Frequent Student Activity Items All Part-time Full-time Participated in a community-based project as a part of a regular course 86% 86% 86% Tutored or taught other students (paid or voluntary) 77% 79% 72% Worked with instructors on activities other than coursework 76% 79% 70% Skipped class 57% 61% 48% Discussed ideas from your reading or classes with instructors outside of class 49% 52% 44% Worked with classmates outside of class to prepare class assignments 46% 50% 37% Made a class presentation 45% 48% 36% Came to class without completing readings or assignments 35% 38% 29% Talked about career plans with an instructor or advisor 33% 34% 31% 8

2007 Special Focus Questions: The Entering Student Experience Students were asked to respond to five special focus questions. Table 5 illustrates their responses to these five questions. Fifty-five percent of all students report having met with an advisor in the first four weeks at the College to discuss their educational goals, and over half of all students report completing an initial assessment test. Twenty-nine percent of fulltime students indicate they did not attend an orientation course, while 31% of part-time students report never having done so. Overall, students indicate that they are satisfied with the College s processes for working with new students. Table 5: Selected Special Focus Questions Frequencies Question Part-time Full-time All By the end of my FIRST FOUR WEEKS at this college, I had met with an advisor to discuss my educational goals. Yes 55% 55% 55% No, I met with an advisor by the end of my first four weeks at this college, but we did not discuss my educational goals. 7% 6% 7% No, I did not meet with an advisor by the end of my first four weeks at this college. 22% 20% 21% No, I have discussed educational goals with an advisor, but it did not happen by the end of my first four weeks at this college. 9% 11% 10% I do not recall. 6% 9% 7% By the end of my FIRST FOUR WEEKS at this college, I had completed an initial assessment test to determine which reading, writing, and math courses I should enroll in. Yes 59% 56% 58% No 33% 38% 35% I do not recall 8% 6% 7% By the end of my FIRST FOUR WEEKS at this college, my instructors had used teaching techniques that encouraged me to become actively involved in the classroom. Very often 33% 26% 31% Often 28% 33% 29% Sometimes 30% 31% 30% Never 4% 7% 5% I do not recall 4% 4% 4% 9

Question Part-time Full-time All How satisfied were you with the quality of your college's orientation course or program for new students? Very satisfied 26% 22% 25% Somewhat satisfied 36% 41% 37% Not at all satisfied 7% 8% 7% Have not attended an orientation course or program 31% 29% 30% Rate your overall satisfaction with this college's processes for working with new students - including the admissions process, the financial aid office, new student assessment, your first class registration experience, etc. Very satisfied 35% 34% 35% Somewhat satisfied 47% 50% 48% Somewhat dissatisfied 12% 12% 12% Very dissatisfied 6% 4% 5% 2007 St. Johns River Community College: Florida Supplemental Questions Students were asked to respond to five additional Florida Supplemental questions. The majority of students responding report that they are satisfied with the library services offered at SJRCC. Fifty-nine percent of full-time students and 55% of part-time students indicate they have developed an educational plan, but did not use a degree audit system to do so. Approximately 39% of all students indicate that their best source of academic advising is friends, family, or other students. Additionally, 10% of part-time and 7% of full-time students report they have not received any academic advising. Over half of all students responding indicate that they seldom or never use academic support services, such as, tutoring and academic assistance. Table 6: Florida Supplemental Questions Frequencies Question Part-time Full-time All How satisfied are you with the library resources at your college? Very satisfied 41% 53% 45% Somewhat satisfied 34% 32% 34% Somewhat dissatisfied 7% 6% 7% Very dissatisfied 1% 1% 1% Have not used library resources 17% 7% 14% Have you developed an educational plan? Yes, and I have used a degree audit system such as FACTS.org 21% 19% 20% Yes, but I have not used a degree audit system 55% 59% 56% No, I do not have an educational plan at this time 24% 22% 23% 10

What has been your best source of academic advising? Academic advisor (not faculty) 10% 8% 10% Academic advisor (faculty) 33% 36% 34% Friends, family, or other students 37% 44% 39% Online college registration and/or computerized degree advising system 10% 4% 8% Have not received any academic advising 10% 7% 9% How often do you use the academic support services, e.g., tutoring and academic assistance, at your school? Very often 5% 4% 4% Often 9% 6% 8% Occasionally 18% 15% 18% Seldom 18% 28% 21% Never 50% 47% 49% How often do you use the college's Website to find information? Very often 37% 27% 34% Often 26% 28% 27% Occasionally 21% 30% 24% Seldom 9% 12% 10% Never 6% 4% 5% Benchmark Data CCSSE utilizes a set of five benchmarks of effective educational practice in community colleges. These benchmarks encompass 38 engagement items from the survey that reflect many of the most important aspects of the student experience. The benchmarks are described briefly below: Active and collaborative learning measured by seven survey questions, such as whether the student asked questions or contributed to class discussions, made a class presentation, or worked with other student on projects during class. Student effort gauged by eight questions, such as how often have you prepared two or more drafts of a paper, come to class without completing assignments, or used the computer lab. Academic challenge ten questions relate to this benchmark, such as how often have you worked harder than you thought you could, how much does your coursework emphasize synthesizing and organizing ideas in new ways, or how many papers or reports did you write during the school year. Student faculty interaction assessed using six questions including how often have you used email to communicate with an instructor, talked about career plans with an instructor or advisor, or received prompt feedback. Support for learners measured by seven by seven survey questions which include how much does the college emphasize providing the support you need to help you succeed, help you cope with non-academic responsibilities, or how often have you used academic advising/planning services. 11

The benchmark scores are standardized around the mean of the 3-year cohort so that respondents scores have a mean of 50, weighted by full- and part-time attendance status, and a standard deviation of 25. Benchmark scores are then computed by averaging the scores on the associated items. This allows for immediate observation of whether or not SJRCC s scores are above or below those of other participating schools. Thus, the data may be used both to identify relative strengths and to zero in on areas in which the College may need to improve. The overall results for 2007 reveal that SJRCC ranks slightly below average when compared to other state and national colleges. However, SJRCC ranks slightly above average in academic challenge when compared to state or national averages. These results are detailed in the Table 7 below: Table 7: 2007 Benchmark Data for All Students Benchmark SJRCC Florida Consortium National Results Active & Collaborative Learning 45.8 50.0 50.0 Difference -4.2-4.2 Student Effort 49.3 50.3 50 Difference -1.0-0.7 Academic Challenge 51.0 50.4 50.0 Difference +0.6 +1.0 Student-Faculty Interaction 49.6 51.5 50.0 Difference -1.9-0.4 Support for Learners 48.1 49.6 50.0 Difference -1.5-1.9 The results further demonstrate significant differences between full-time vs. part-time students. Part-time students rank lower in each benchmark category when compared with full-time students. Table 8: 2007 Benchmark Data Full-time vs. Part-time Students Benchmark Full-time Part-time Active & Collaborative Learning 50.7 43.2 Student Effort 50.8 47.6 Academic Challenge 55.5 48.6 Student-Faculty Interaction 55.2 46.7 Support for Learners 52.7 45.4 12

A comparison between 2007 and 2004 benchmark results for SJRCC reveals general improvement in student engagement. Table 9: Comparison of 2004 & 2007 Benchmark Data 2004 Overall 2007 Overall 2004 Full-time 2007 Full-time 2004 Part-time 2007 Part-time Benchmark Active & Collaborative Learning 46.1 45.8 54.2 50.7 42.6 43.2 Student Effort 46.6 49.3 54.8 50.8 43.1 47.6 Academic Challenge 49.4 51.0 54.9 55.5 47.0 48.6 Student-Faculty Interaction 46.5 49.6 52.5 55.2 43.9 46.7 Support for Learners 46.6 48.1 49.5 52.7 45.4 45.4 13