ABET 415 North Charles Street Baltimore, MD Phone: Fax: Website:

Transcription

1 This document is an example of a self-study for a fictitious institution, Upper State University. Any similarities in the self-study descriptions with existing institutions or programs are coincidental. Program evaluator training participants and other readers should recognize that, as abbreviated learning documents, the Pre-Work self-study and student transcripts do NOT contain the following: Institutional catalog information and promotional brochures and literature Complete faculty qualification and workload information (Tables 6-1 and 6-2) All appendix information. The required number of student transcripts; only three samples are provided Additional transcript analysis aides that may be provided by the institution Program evaluators should refer to the ASAC self-study guidelines ( to learn what is to be included in the full complement of required pre-visit materials. Note: Based on the degree title, Applied Science, there is no applicable program specific criterion. This program is only evaluated under the General Criteria and the Accreditation Policy and Procedure Manual. ABET 415 North Charles Street Baltimore, MD Phone: Fax: training@abet.org Website: TR-R-01 USU ASAC Self Study 1 January, 2015

2 ABET Self-Study Report for the Applied Science Program at Upper State University Upper State, Anystate July 1, 2015 CONFIDENTIAL The information supplied in this Self-Study Report is for the confidential use of ABET and its authorized agents, and will not be disclosed without authorization of the institution concerned, except for summary data not identifiable to a specific institution. TR-R-01 USU ASAC Self Study 2 January, 2015

3 Table of Contents BACKGROUND INFORMATION... 4 CRITERION 1. STUDENTS... 6 CRITERION 2. PROGRAM EDUCATIONAL OBJECTIVES CRITERION 3. STUDENT OUTCOMES CRITERION 4. CONTINUOUS IMPROVEMENT CRITERION 5. CURRICULUM A. Program Curriculum B. Course Syllabi CRITERION 6. FACULTY CRITERION 7. FACILITIES CRITERION 8. INSTITUTIONAL SUPPORT CRITERION 9. PROGRAM CRITERIA 86 Appendix A Course Syllabi Appendix B Faculty Vitae Appendix C Equipment Appendix D Institutional Summary Signature Attesting to Compliance TR-R-01 USU ASAC Self Study 3 January 2015

4 BACKGROUND INFORMATION A. Contact Information Dr. Mark T. Begone Department of Applied Science College of Natural Science and Engineering Upper State University Upper State, Anystate Phone: (999) Fax: (999) B. Program History The Applied Science program at Upper State University is a general Applied Science program that serves the regional economy of Northern Upper State, Anystate, USA. Accreditation was first sought in the accreditation cycle. The program was first established as a collaboration between engineering and business faculty, but in 1994 came to entirely reside within the College of Natural Science and Engineering. The program is unique because of the interdisciplinary curriculum and the skills of the graduates. The Applied Science program endeavors to develop graduates with a broad understanding of science and its methods, engineering and its applications, and the use of these methods in solving problems in industry, business, and government. The B.S. degree in Applied Science at Upper State University is considered a professional degree, but also prepares students for unique fields of graduate study. The last general review was held October 11-13, Significant changes to the program include the offering of an additional option as of Fall, 2011 Environment/Energy. This has been added to the existing Manufacturing Option (Fall, 2009) bringing the total number of options offered to two highly relevant, contemporary fields of study. Changes in response to a shortcoming identified in the previous visit are described in Section F below. In addition, since the last ABET visit, the number of faculty members in applied science has grown with the hiring of one new faculty member with a full time appointment in the Applied Science program. C. Options The degree conferred is the B.S. in Applied Science with two options, Manufacturing and Environment/Energy. The option is noted on the student transcript, but is not indicated on the degree conferred. Options are not required. D. Program Delivery Modes The Applied Science program is offered in the day mode with courses offered in traditional lecture/laboratory style. Occasionally a course is offered in the evening. There is no significant distance education or web-based component in the program. Students are TR-R-01 USU ASAC Self Study 4 January, 2015

5 encouraged to spend a minimum of one semester in a cooperative education or internship position. E. Program Locations All elements of the program are offered on the Upper State University campus. No portion of the program is offered elsewhere. F. Public Disclosure The program educational objectives, student outcomes, and enrollment and graduation data are published in our on-line undergraduate catalog (Hwww.usu.edu/ugcatalogH), in college brochures, in recruiting literature, and are posted in our building in various display cases. G. Deficiencies, Weaknesses or Concerns from Previous Evaluation(s) and the Actions Taken to Address Them In the accreditation visit, the Final Statement cited a Concern in Criterion 6 Faculty The relevant section of the Final Statement is quoted below and the actions taken are described: Criterion 6. Faculty In the area of program faculty, Criterion 6 requires sufficient faculty to accommodate adequate levels of professional development. While the program presently appears to have sufficient faculty, there is evidence that the opportunity to engage in faculty development programs either within or outside of the university is decreasing. The Applied Science program budget was expanded to include additional funds for faculty travel for the purposes of professional enhancement and development. All applied science faculty members receive an annual stipend of at least $1,500 to support travel to professional meetings. As much as possible, the travel is intended to be associated with the presentation of a poster or paper. In the semester following the campus visit, all applied science faculty participated in several campus workshops including Technology in the Classroom and Problem-Based Learning. Several attended brown bag luncheon seminars sponsored by the USU Teaching and Learning Center. This practice continues to date. Two of our faculty members have leadership roles in regional sections of their professional societies. TR-R-01 USU ASAC Self Study 5 January, 2015

6 GENERAL CRITERIA CRITERION 1. STUDENTS A. Student Admissions All Upper-State University (USU) freshman Applied Science students are admitted and dually enrolled in the Undergraduate University Division (UUD) and the College of Natural Science and Engineering (CNSE). The following requirements must be met for admission: 1. Cumulative high school grade point average of 2.5 or higher on a 4.0 point scale 2. Ranked in the top half of high school graduating class 3. SAT composite score of at least 950 or ACT composite of 20 or above. Exceptions to these standards may be made on an individual basis and are reviewed by the Admissions Office. Those who are admitted on an exception basis may be required to take remedial work during their first year at Upper State University. Credits in remedial courses are not applied to graduation requirements. B. Evaluating Student Performance Two files are maintained for each upper-level student, one in the Associate Dean s office and one in the advisor s office. The files contain all grade sheets, transfer credit evaluations, course schedule planning sheets, records of advisor conferences, etc. The files are used mainly as a documents repository, as most of the actual student and course information is located in electronic sources. Databases. Both advisors and students are able to assess their progress toward the degree using a web-based Degree Auditing System (DAS). DAS is also able to produce an unofficial transcript or technical grade point average calculation report for students. For advisors, support staff, and administrators, DAS allows queries of student data using a variety of parameters and data reporting and sorting choices. DAS obtains its data from the university s mainframe-based Student Information Report System (SIRS) which houses all course- and student-related data for all USU students and courses (up to 30 years back). All academic advisors, authorized staff, and administrators have access to all SIRS information. The course registration system interfaces with SIRS and DAS to ensure that prerequisites are met. A student is not permitted to register for a course unless all prerequisites identified in SIRS are met or the instructor teaching the course approves an override of the system. Academic advisors work closely with faculty and the Department of Cooperative Education for those students participating in internships and study abroad. These experiential learning opportunities are recommended to each student. Because these activities require special scheduling the academic advisors help each participating student devise a plan to complete the degree requirements in a timely manner. TR-R-01 USU ASAC Self Study 6 January, 2015

7 Warning Systems. There are several layers of academic warning systems functioning at USU and in the College of Natural Science and Engineering: 1) Freshman Early Warning System Freshmen who are earning less than a 2.0 grade in certain common freshman courses are sent Early Warning messages from the Registrar s Office. The academic advisor then follows up with phone calls, messages, and individual appointments to discuss strategies for improvement. 2) Academic Standing of Undergraduate Students (ASUS) Students who have less than a 2.00 cumulative grade point average are placed on probation. After several terms on probation, students may be recessed or dismissed, depending on their specific combination of grades and probationary terms. Also, students who earn a 1.0 in one term, with six or more credits, are recessed regardless of prior GPA. 3) College of Natural Science and Engineering Academic Actions Complementing the ASUS, the CNSE takes additional measures for academic warning before students become eligible for university probation and warns students when their term grade point average falls below Students who have a term GPA below 2.00 are notified that they must have a term average above 2.00 in the next term, or be removed from the college. Students with two consecutive terms below 2.00, but who are still in good standing with the university (cumulative GPA > 2.00) are notified that they are no longer eligible to continue in Applied Science, but may change to another major. Students who are recessed, dismissed, or declared not eligible to continue may appeal those actions to the college s Office of the Associate Dean for Undergraduate Studies. C. Transfer Students and Transfer Courses Junior-level transfers are limited to very high-achieving applicants. Transfer admissions are limited to about 50 students per year for the Applied Science program (about 10% of enrollment). Potential transfer students apply via the regular USU admissions process. Requirements for direct transfer admission to the USU CNSE as a junior are 1) Completion of at least 56 semester credits. 2) Completion of Applied Calculus, Applied Physics, College Chemistry, and Chemistry Lab. 3) A minimum grade point average of 3.00 is required for consideration. International students must have a 3.50 minimum grade point average. 4) A maximum of 5 external transfer students per year may be admitted. There are no formal articulation agreements with other institutions, with the exception of the Minority Advancement Program participants at Upper State Community College. Qualified students (10 per year maximum) continuing to meet the established requirements of this program are granted admission and scholarships to USU. TR-R-01 USU ASAC Self Study 7 January, 2015

8 The evidence that the procedures for admitting transfer students are working lies in the fact that transfer admission is very limited and competitive, and that (after an initial adjustment for some) transfer students generally proceed through to their degree with the same success as those who start as freshmen. Students presenting courses for transfer credit include not only transfer students but also USU students who take courses at other institutions in the summer. To ensure integrity, students who take transfer courses are required to have an official transcript sent directly from the other institution to USU s Transfer Credit Evaluation Office. The Transfer Credit Evaluation Office in the Admissions Office evaluates all courses taken at other institutions and posts equivalent USU courses to the student s record. For courses and institutions where transfers are common and recurring, the equivalencies are determined by review in the program offering the equivalent course. Where equivalencies are uncertain, the credit evaluation office may post general credit under the program code, and the student may request review by presenting the course description and syllabus to the program to change the general credit to specific course credit. Only those credits earned at institutions accredited by one of the regional accrediting agencies will be considered for transfer. Course work assigned a passing grade below 2.00 ( ) on a 4.00 scale may be recognized in transfer if the overall grade point average from the institution at which a set of grades was earned is 2.00 or higher. Students transferring from two-year institutions such as community or junior colleges may present a maximum of one-half the number of credits required for the bachelor's degree. Usually 60 semester credits are the maximum allowed. International students who have attended officially recognized tertiary institutions may receive transfer credit for work completed. D. Advising and Career Guidance Student advising is conducted through the Office of the Associate Dean for Undergraduate Studies in the College of Natural Sciences and Engineering (CNSE). In addition to its importance in career counseling, advising helps assure that B.S. graduates have completed the curriculum of the applied science program. The core applied science curriculum and the electives are the key elements in meeting program educational objectives since UallU of the educational objectives are addressed and student outcomes are achieved through the curriculum. Specifically, the curriculum provides a thorough base of mathematics, physical science, computing foundations, laboratory experience, and applications experience which prepares students to apply applied science problem-solving principles to a variety of contemporary problems. In addition, the curriculum provides the general education necessary to identify the effect of design and implementation decisions in the broader societal context. The rigorous curriculum is the foundation to the graduate s ability to function as a practicing professional or graduate student. TR-R-01 USU ASAC Self Study 8 January, 2015

9 The CNSE employs a professional full-time academic advisor for the Applied Science program. The advisor has a Master s degree and is a member of a professional advising association. Applied Science advising is done separately from the other CNSE students, but the applied science advisor works closely with the 10 academic advisors for the other CNSE students. The CNSE Advising Coordinator and other CNSE advisors also assist with routine advising when needed. All students first meet their advisor at the required Freshman Orientation Program before starting classes. Further advising is available upon request, but not mandatory, and students are ultimately responsible for planning their academic programs and meeting degree requirements. In addition to helping undergraduates plan their academic program, the academic advisor maintains student records, certifies seniors for graduation, and uses to communicate important academic and professional information to students. The advisor is a member of the Applied Science Curriculum Committee and participates in curriculum planning and in various assessment and evaluation processes. Several feedback tools used in the program (year-end surveys, Senior Exit Interview, and Alumni Survey) have indicated a very high level of student satisfaction with the advising process. The CNSE applied science advisor provides some basic career guidance, referring students to faculty members when appropriate. Faculty members are available to students for career guidance when requested. Students have several options for receiving special academic or personal assistance. The Learning Center offers several sessions throughout the academic year on topics including study skills, test-taking, reading for comprehension, time management, and stress control. First-year students, in particular, are encouraged to take advantage of these opportunities. The college s Office of Student Placement supports students in their professional development and internship placement. The service offers seminars and assistance in resume writing, interview skills, job searches, and career information. The office maintains job postings for cooperative education and internships and sponsors and coordinates the annual Career Fair. E. Work in Lieu of Courses Upper State University Applied Science students are encouraged to spend a minimum of one semester in a cooperative education or internship position. The work experience is listed on the student transcript, but no credit or grade is assigned. F. Graduation Requirements A senior audit is conducted in the semester after a CNSE student attains 100 credits. At that time, the student s record is reviewed for progress toward the B.S. in Applied Science degree, any transfer credits that still need to be evaluated, documentation of waivers (substitutions), and completion of electives. Students are not required to meet with the advisors, but are strongly encouraged by and phone messages, when necessary. When a student applies for graduation, the student record is reviewed by staff at several layers. The TR-R-01 USU ASAC Self Study 9 January, 2015

10 record is finally submitted for certification by the Associate Dean. Any degree deficiencies are reported to the Registrar s Office. G. Transcripts of Recent Graduates Transcripts from three May 2015 graduates are submitted along with this self-study report. Additional information concerning transfer credit evaluation is attached to the transcript. The degree, degree status, major, and minor are specified in the transcript header on the first page. TR-R-01 USU ASAC Self Study 10 January, 2015

11 CRITERION 2. PROGRAM EDUCATIONAL OBJECTIVES The Applied Science program at Upper State University has accepted and implemented the use of the term objectives as described in the ABET Applied Science Criteria for Hence, the program educational objectives are broad statements that describe what the faculty of the Applied Science program at Upper State University are preparing graduates to attain within a few years of graduation. A. Mission Statement Institutional Mission In its one hundred-year history, Upper State University has been a leader in educating the people of this state. In continuation of this rich tradition, Upper State University maintains its commitment to advancing knowledge and serving a worldwide society. Upper State University is committed to providing access to quality education and expert knowledge, to promoting scholarship and problem solving to address the needs of a global society, to advancing diversity both on our campus and within the community, and to making people matter. College of Natural Science and Engineering (CNSE) Mission Statement The CNSE will produce applied science, engineering, engineering technology, and computing graduates who are able to integrate theoretical knowledge and practical application as productive citizens in an ever-changing technological world. The CNSE graduate will have the skills to be a productive member of the community, to work in an interdisciplinary framework, and will have an appreciation of the effect of their work on the global society. The university mission statement is published in the on-line undergraduate catalog ( in university brochures, in recruiting literature, and is posted in various display cases around campus. The college mission statement is likewise published in the on-line undergraduate catalog ( in college brochures, in recruiting literature, and is posted in the college s buildings in various display cases. B. Program Educational Objectives The program educational objectives (PEOs) support the missions of the institution and of the college. The program educational objectives are published in our on-line undergraduate catalog (Hwww.usu.edu/ugcatalogH), in college brochures, in recruiting literature, and are posted in our building in various display cases. The PEOs for the Upper State University Applied Science Program are as follows: The Applied Science Program at USU expects the graduates within a few years of graduation to attain the following 1. be effective in the design of applied science solutions and the practical application of applied science principles 2. effectively lead, work and communicate in cross functional teams 3. conduct themselves with high standards of ethics TR-R-01 USU ASAC Self Study 11 January, 2015

12 4. be successfully employed in an applied science or related field, or accepted into graduate programs 5. expand their knowledge and capabilities through continuing education or other lifelong learning experiences 6. serve their communities, whether locally, nationally, or globally. C. Consistency of the Program Educational Objectives with the Mission of the Institution If the program educational objectives are achieved then the program will produce graduates who are successful professionals and also good citizens. That is, the program will provide a quality education based on expert knowledge that enables its graduates to be successful problem solvers in a global society. D. Program Constituencies The principal constituencies of the Applied Science program are the Applied Science faculty, current Applied Science students, alumni, major donors, and employers. Each of these constituencies is a stakeholder in the educational processes in the Applied Science program. The Applied Science faculty has the academic responsibility for the curriculum and for education of the students. The program and curricula they administer is a major means of accomplishing all of the program s objectives. The Applied Science students are included as a program constituency because their input is valuable feedback for program improvement and because they are the direct beneficiaries of an effective educational process. Alumni are the products and strong supporters of the academic program. Their careers demonstrate the accomplishment of the PEOs. Alumni often become the major donors who play advisory roles and provide financial support for scholarships and endowments that directly affect students in their education. Employers are attracted to welleducated undergraduate applied science students, and graduates who accomplish all of the PEOs are a clear benefit to their employers. In summary, each of these constituencies has vested interest in the success and continued improvement of the Applied Science program at Upper State University and the proper direction of the program through its educational objectives. E. Process for Revision of the Program Educational Objectives The overall process to determine and approve the current version of the program educational objectives (PEOs) began in the summer of A first draft of the PEOs was presented in early fall by the Applied Science Curriculum Committee a representative body of faculty, advisors, and students. All Applied Science faculty members were invited to edit the proposed PEOs; about 50 percent of the faculty responded, which is a good response level for the survey approach used in this exercise. The second draft was presented to the Applied Science Advisory Council (industrial and alumni advisory board) for comments. While on campus for the fall semester Career Fair (November, 2010), ten representatives of major employers participated in a lunchtime focus group during which the PEOs were evaluated TR-R-01 USU ASAC Self Study 12 January, 2015

13 and discussed. Copies of the PEOs were distributed to the employer representatives about two weeks in advance of the focus group meeting. Given the input from all of these sources, the final version of the PEOs was approved by a unanimous vote of the Applied Science faculty in April, Since the initial development of our PEOs, they have been evaluated again each time the alumni survey is administered, during the annual Applied Science Advisory Council meetings, in the last Applied Science Curriculum Committee meeting of the academic year, as part of the senior exit interview, and biannually in employer focus groups. Whether the evaluation of PEOs suggests a need for their revision or not, Table 2-1 summarizes the scheduling of constituent input to PEOs Table 2-1 Summary of Constituent Input to PEOs Input Method Schedule Constituent Alumni survey Every three years Alumni 2-5 years out Employer focus group Every two years during Career Fair Employers (and recruiters); some are alumni Senior exit interview Annually Students; retrospective discussion of PEOs and their intended career paths Advisory Council discussions As needed available Industrial representatives, Curriculum Committee meetings annually Available as frequently as needed employers, alumni Faculty and students PEOs are documented as part of the assessment process in a web-based database. The program s ABET coordinator also maintains assessment records on the program s server. The coordinator, the chairperson, and the chair of the Curriculum Committee have direct access to these files. Since the original 2008 version of the program educational objectives, the changes in Table 2-2 have been proposed, discussed, and approved: Table 2-2 Summary of Recent Changes to PEOs Modification Proposing Constituency Approval Date Expand first PEO to include practical Alumni; strongly Spring, 2009 application of applied science principles; add PEO on leadership and ability to function in cross-functional teams supported by the Advisory Council Add global to the list of communities Employers Spring, 2011 in which our graduates will serve Various grammatical and stylistic modifications Curriculum Committee Various TR-R-01 USU ASAC Self Study 13 January, 2015

14 CRITERION 3. STUDENT OUTCOMES A. Student Outcomes The twelve student outcomes for the Applied Science program at Upper State University are listed below. They encompass all of the ABET ASAC Criterion 3 outcomes. As recommended by our faculty, they have been reorganized slightly into a logical grouping of knowledge and skills. In addition, we have added an outcome related to leadership. We have also adopted the Applied Science Criteria definition of outcomes as narrower statements that describe what students are expected to know or be able to do by the time of graduation from our program. 1. an ability to identify, formulate, and solve applied science problems 2. an ability to apply knowledge of mathematics and science (applied science) 3. an ability to use the techniques, skills, and modern tools necessary for applied science practice. 4. an ability to design and conduct experiments, as well as to analyze and interpret data 5. an ability to formulate or design a system, process, or program to meet desired needs 6. an ability to function on multi-disciplinary teams 7. an understanding of professional and ethical responsibility 8. an ability to communicate effectively, both orally and in writing 9. the broad education necessary to understand the impact of Applied Science solutions in a global, economic, environmental, and societal context 10. a recognition of the need for and an ability to engage in life-long learning 11. a knowledge of contemporary issues 12. a willingness to assume leadership roles and responsibilities B. Relationship of Student Outcomes to Program Educational Objectives The manner in which the student outcomes support the program educational objectives is shown in Table 3.1 below. In this table, each outcome is associated with those program educational objectives it supports. TR-R-01 USU ASAC Self Study 14 January, 2015

15 Table 3.1. Program educational objectives and supporting student outcomes PEO 1 design of PEO 2 applied PEO 4 lead, work science employed and PEO 3 Program solutions/ applied communicate ethical Outcomes practical science in cross standards application /graduate functional of applied programs teams science principles 1. an ability to identify, formulate, and solve applied science problems 2. an ability to apply knowledge of mathematics and science (applied science) X X X X PEO 5 lifelong learning experiences PEO 6 serve community 3. an ability to use the techniques, skills, and modern tools necessary for applied science practice. 4. an ability to design and conduct experiments, as well as to analyze and interpret data 5. an ability to formulate or design a system, process, or X X X X X X TR-R-01 USU ASAC Self Study 15 January, 2015

16 Program Outcomes program to meet desired needs 6. an ability to function on multidisciplinary teams 7. an understanding of professional and ethical responsibility 8. an ability to communicate effectively, both orally and in writing 9. the broad education necessary to understand the impact of applied science solutions in a global, economic, environmental, and societal context 10. a recognition of the need for, and an ability to engage in PEO 1 design of applied science solutions/ practical application of applied science principles PEO 2 lead, work and communicate in cross functional teams PEO 3 ethical standards PEO 4 employed applied science /graduate programs X X X PEO 5 lifelong learning experiences PEO 6 serve community X X X X X X X X X X X X TR-R-01 USU ASAC Self Study 16 January, 2015

17 Program Outcomes life-long learning 11. a knowledge of contemporary issues 12. a willingness to assume leadership roles and responsibilities PEO 1 design of applied science solutions/ practical application of applied science principles PEO 2 lead, work and communicate in cross functional teams PEO 3 ethical standards PEO 4 employed applied science /graduate programs PEO 5 lifelong learning experiences X PEO 6 serve community X X X X X Each of the student outcomes mentioned above has been defined by a few high level indicators so that they can be communicated to students, integrated into the curriculum and measured in a consistent and reliable manner. Table 3.2 shows performance indicators for each outcome for the Applied Science program. Since applied science faculty members only have a direct influence on the courses taught within our program, the integration of student outcomes is guaranteed in the APS courses alone. Student study in math and basic sciences enhances achievement of outcomes, but applied science faculty members have no consistent ability to influence change in courses taught outside of our program. Table 3.2 Student outcomes and performance indicators Student Outcome Performance Indicators Problem statement shows understanding of the problem 1. an ability to identify, formulate, and solve applied science problems Solution procedure and methods are defined. Problem solution is appropriate and within reasonable constraints Chooses a mathematical model of a system or process appropriate for required accuracy 2. an ability to apply knowledge of mathematics and science (applied science) TR-R-01 USU ASAC Self Study 17 January, 2015 Applies mathematical principles to achieve analytical or numerical solution to model equations

18 Student Outcome 3. an ability to use the techniques, skills, and modern tools necessary for applied science practice. 4. an ability to design and conduct experiments, as well as to analyze and interpret data 5. an ability to formulate or design a system, process, or program to meet desired needs 6. an ability to function on multidisciplinary teams 7. an understanding of professional and ethical responsibility Performance Indicators Examines approaches to solving an applied science problem in order to choose the more effective approach Selects appropriate techniques and tools for a specific applied science task and compares results with results from alternative tools or techniques Uses computer-based and other resources effectively in assignments and projects Observes good lab practice and operates instrumentation with ease Determines data that are appropriate to collect and selects appropriate equipment, protocols, etc. for measuring the appropriate variables to get required data Uses appropriate tools to analyze data and verifies and validates experimental results including the use of statistics to account for possible experimental error Produces a clear and unambiguous needs statement in a project Identifies constraints on the problem, and establishes criteria for acceptability and desirability of solutions Carries solution through to the most economic/desirable solution and justifies the approach Recognizes participant roles in a team setting and fulfills appropriate roles to assure team success Integrates input from all team members and makes decisions in relation to objective criteria Improves communication among teammates and asks for feedback and uses suggestions Knows code of ethics for the discipline TR-R-01 USU ASAC Self Study 18 January, 2015

19 Student Outcome 8. an ability to communicate effectively, both orally and in writing 9. the broad education necessary to understand the impact of applied science solutions in a global, economic, environmental, and societal context 10. a recognition of the need for, and an ability to engage in life-long learning 11. a knowledge of contemporary issues 12. a willingness to assume leadership roles and responsibilities Performance Indicators Able to evaluate the ethical dimensions of a problem in the discipline Writing conforms to appropriate technical style format appropriate to the audience Appropriate use of graphics Mechanics and grammar are appropriate Oral: Body language and clarity of speech enhances communication Evaluates conflicting/competing social values in order to make informed decisions about an applied science solution. Evaluates and analyzes the economics of an applied science problem solution Identifies the environmental and social issues involved in an applied science solution and incorporates that sensitivity into the solution process Expresses an awareness that education is continuous after graduation Able to find information relevant to problem solution without guidance Identifies the current critical issues confronting the discipline Evaluates alternative applied science solutions or scenarios taking into consideration current issues Expresses a willingness to take on leadership responsibility Demonstrates the ability to monitor team progress and make suggestions when needed Engages team members in problem solution TR-R-01 USU ASAC Self Study 19 January, 2015

20 CRITERION 4. CONTINUOUS IMPROVEMENT The continuous improvement process for the Applied Science program involves assessing the degree of attainment of the student outcomes: evaluating the assessment results; identifying improvement needs and opportunities; and implementing the indicated program improvements. Coordination and leadership for this process is assigned to the Applied Science Curriculum and Accreditation committee. Reports and recommended action by this committee are reviewed and must be approved by the entire faculty. This process and a summary of the results follows first for the program educational objectives and secondly for the student outcomes. A. Student Outcomes The assessment of student outcomes is done on a six year cycle. The cycle that was used for the current ABET cycle is illustrated in Table 4.1. Table 4.1. Data collection cycle for Student Outcome an ability to identify, formulate, and solve applied science problems X X 2. an ability to apply knowledge of mathematics and science (applied science) X X 3. an ability to use the techniques, skills, and modern tools necessary for applied science X X practice. 4. an ability to design and conduct experiments, as well as to analyze and interpret data X X 5. an ability to formulate or design a system, process, or program to meet desired needs X X 6. an ability to function on multi-disciplinary teams X X 7. an understanding of professional and ethical responsibility X X 8. an ability to communicate effectively, both orally and in writing X X 9. the broad education necessary to understand the impact of applied science solutions in a global, X X economic, environmental, and societal context 10. a recognition of the need for, and an ability to engage in life-long learning X X 11. a knowledge of contemporary issues X X 12. a willingness to assume leadership roles and responsibilities X X TR-R-01 USU ASAC Self Study 20 January, 2015

21 Although data is only collected every three years, there is activity which is taking place on each outcome each year. The cycle of activity is shown in Table 4.2. Table 4.2. Cycle of activity for each student outcome over 6 year period Activity for each Student Outcome Yr 1 Yr 2 Yr 3 Yr 4 Yr 5 Yr 6 Review of performance indicators that define the outcome X X Review the map of educational strategies related to performance indicators X X Review mapping and identify where data will be collected X X Develop and/or review assessment methods used to assess performance X X indicators Collect data X X Evaluate assessment data including processes X Report findings X Take action where necessary X Each outcome has been mapped to the applied science courses as depicted in Table 4.8. This map was used to make decisions about where the summative data would be collected. TR-R-01 USU ASAC Self Study 21 January, 2015

22 Table 4.3 Outcomes Mapping for APS Courses Outcome /2 1. App Sci problem solving 2. Math and science knowledge X X X X X X X X X X X X X X X X X X X X X X X X X 3. Tools X X X X X X X X X X X X X X 4. Expt s & data X X X X 5. Design X X X X X X X X X X X 6. Teams (xdisc) X X X X X X X 7. Prof and Ethics X X X X X X X X X 8. Comm Skills Oral & written Oral & written Written Oral & written Oral & written Written Oral & written Written Oral & written 9. Global and X X X X X X X X X X X X societal contxt. 10. Lifelong X X X X X X X learning 11. Contemp. Issues X X X X X X X X X X 12. Leadership X X X X X X X Results for each student outcome are reported separately in the following tables and all supporting documentation will be available in the ABET resource room at the time of the visit. Each table represents the activity for the current ABET accreditation cycle. Each outcome table includes performance indicators, courses and/or co-curricular activities (educational strategies) that provide TR-R-01 USU ASAC Self Study 22 January, 2015

23 students an opportunity to demonstrate the indicator, where summative data are collected, timetable, method of assessment and the performance target. Each table is followed by a graph showing the results with a three cycle trend line. TR-R-01 USU ASAC Self Study 23 January, 2015

24 Student Outcome #1: ability to identify, formulate, and solve applied science problems Where data Educational Method(s) of Performance Indicators are collected Strategies Assessment (summative) 1. Problem statement shows understanding of the problem 2. Research methods are defined. 3. Problem solution is appropriate and within reasonable constraints APS111, APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS456, APS491, APS492 APS111, APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS456, APS491, APS492 APS111, APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS456, APS491, APS492 Faculty assessment of problem statement Senior Survey Faculty assessment of senior project plan Senior Survey Faculty assessment of senior design solution Senior Survey APS 4090 On-line survey APS 4090 On-line survey APS 4092 On-line survey Length of assessment cycle (yrs) Year(s)/semester of data collection Target for Performance 3 years 2011, % 3 years 2011, % 3 years 2011, % Assessment Results (direct measures) 2011: For summative assessment (end of program), the decision was made to focus on the direct assessment for all indicators. Summative data for Indicators #1 and #2 were collected in the Senior Thesis course (APS491) where students are asked to develop their statement of the problem and their research plan documentation. For Indicator #3 the assessment was completed in the second semester Senior Thesis course (APS492) as a part of the final assessment of the theses. The percent of students who demonstrated each of the criteria were as follows: Indicator #1-80%; Indicator #2-80%; and Indicator #3-84%. TR-R-01 USU ASAC Self Study 24 January, 2015

25 Evaluation and Actions 2012: The assessment results were reviewed by the faculty who are responsible for the Senior Thesis sequence. A presentation was made at the faculty retreat which was held in August of Although the students are making progress from the previous assessment in 2008 on Indicator #1 (up from 74%) there was still concern that their problem statements did not reflect an adequate understanding of what was expected. The decision was made to provide them some examples of both poor and well-written problem statements and require them to do an analysis of the difference. They would then be asked to do a self-assessment of how well their problem statements reflected what they identified in the well-written statements and submit their analysis with their problem statement. In a review of the results of Indicator #2 it was determined that the students were performing significantly better than the previous assessment (68%) and that the faculty would continue to monitor the students progress in the following year ( ). This improvement was attributed to the fact that the faculty had implemented a twosession sequence in APS491 on research planning with direct feedback to students in the planning process using the rubric used to assess Indicator #2. Faculty members are satisfied that students are meeting the expectations for Indicator #3. The use of faculty mentors has improved the performance of students in the quality of their solutions and their ability to recognize the constraints that affect their solutions. Second-Cycle Results (direct measures) 2014: This cycle of summative data was taken in the same sequence as the 2010 cycle. Based on the actions taken as a result of the 2011 evaluation process, the following results were found: Indicator #1 up 14% (94%); Indicator #2 up 4% (84%); and Indicator #3 was the same (84%). Faculty will discuss their findings at the August 2015 faculty retreat and report the findings at the time of the ABET site visit. TR-R-01 USU ASAC Self Study 25 January, 2015

26 Figure 4.1. Trend line for Student Outcome #1: ability to identify, formulate, and solve applied science problems Target = 90% 100% 94% 80% 60% 74% Target = 85% % 80% Target 80% 84% 84% 40% 20% 0% 1. Problem statement 2. Research methods are 3. Problem solution is shows understanding of appropriate and within the problem reasonable constraints Display materials available at time of visit in the ABET resource room: Rubrics used by faculty to assess the indicators Indicator #1 sample problem statements documentation Indicator #2 research planning guide Senior survey questions with results and faculty evaluation of results Minutes of faculty retreat where actions were taken in 2012 and 2015 TR-R-01 USU ASAC Self Study 26 January, 2015

27 Student Outcome #2: ability to apply knowledge of mathematics and science (applied science) Where data Length of Educational Method(s) of Performance Indicators are collected assessment Strategies Assessment (summative) cycle (yrs) 1. Chooses a mathematical model of a system or process appropriate for required accuracy APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS358, APS491, APS492 APS131, APS211, APS212, APS222, Course project Senior surveys Faculty 2. Applies mathematical developed principles to achieve APS253, APS301, examination analytical or numerical APS302, APS310, solution to model APS330, APS341, Senior equations APS358, APS491, surveys APS492 APS131, APS211, Thesis report 3. Examines approaches to APS212, APS222, analysis solving an applied APS253, APS301, using rubric science problem in order APS302, APS310, to choose the more APS330, APS341, Senior effective approach APS358, APS491, surveys APS492 APS341 On-line survey APS341 On-line survey APS492 On-line survey Year(s)/semester of data collection Target for Performance 3 years 2011, % 3 years 2011, % 3 years 2011, % Assessment Results (direct measures) 2011: For the summative assessment (end of program), the decision was made to focus on the faculty s direct assessment for all indicators. Summative data for Indicator #1 were collected in the Modeling & Simulation (APS341) course. In this course students are given a project which requires them to choose the mathematical models which are appropriate for a specific problem. For Indicator #2 faculty created an examination which required students to apply mathematical principles to model equations to achieve solutions. Faculty recorded student performance on the exam. For Indicator #3, faculty used a project report rubric to analyze the thesis project report for evidence of consideration of multiple approaches. The percent of students that demonstrated each criterion were as follows: Indicator #1-76%; Indicator #2-82%; and Indicator #3-86%. TR-R-01 USU ASAC Self Study 27 January, 2015

28 Evaluation and Actions 2012: The assessment results were evaluated by the faculty at a retreat held in August of Based on the analysis of the results, the faculty recommended additional formative assessment, asking faculty members teaching APS253 and APS302 to provide the students specific feedback on Indicators #1 & #2 and document specific areas of strength and weakness related to the indicators. In 2010 this information will be used to strengthen the delivery of content and the development of assignments. Faculty did not take any action on Indicator #3 as the target was met. Second-Cycle Results (direct measures) 2014: The second cycle summative data was again taken in the APS341 for Indicators # 1 & #2 and APS492 for Indicator #3. Based on actions taken as a result of the 2012 evaluation process, the following improvements were seen in 2014: Indicator #1 up 8% (84%); Indicator #2 up 6% (88%), Indicator #3 down 4% (82%). TR-R-01 USU ASAC Self Study 28 January, 2015

29 Figure 4.2. Trend line for Student Outcome #2: ability to apply knowledge of mathematics and science (applied science) 80% Target = 90% 80% 84% 76% Target = 90% 80% % Target 85% 86% 1. Chooses a mathematical 2. Applies mathematical 3. Examines approaches to model of a system or process principles to achieve analytical solving an applied science appropriate for required or numerical solution to model problem in order to choose the more effective approach Display materials available at time of visit in the ABET resource room: Indicator #1, course assignment and samples of student work Indicator #2, copy of examination and samples of graded student work Indicator #3, thesis project guidelines, rubric, and samples of student project reports Senior survey questions and results with faculty evaluation Results of 2012 formative assessment project and report to faculty Minutes of faculty retreat where actions were taken in 2012 TR-R-01 USU ASAC Self Study 29 January, 2015

30 Student Outcome #3: an ability to use the techniques, skills, and modern tools necessary for applied science practice. Where data Length of Year(s)/semester Method(s) of Performance Indicators Educational Strategies are collected assessment of data Assessment (summative) cycle (yrs) collection 1. Selects appropriate techniques and tools for a specific applied science task and compares results with results from alternative tools or techniques 2. Uses computer-based and other resources effectively in assignments and projects APS101, APS111, APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS358, APS491, APS492 APS101, APS111, APS131, APS211, APS212, APS222, APS253, APS301, APS302, APS310, APS330, APS341, APS358, APS491, APS492 Project report analysis using rubric Senior surveys Project report analysis using rubric Senior surveys APS492 On-line survey APS492 On-line survey Target for Performance 3 years 2011, % 3 years 2011, % Assessment Results (direct measures) 2011: Summative data were collected in the Senior Thesis II Course (APS492). For the summative assessment (end of program), the decision was made to focus on the faculty s direct assessment of student performance on the senior project report using rubrics for both indicators. Faculty analyzed the thesis report for evidence of achievement on each indicator. The percent of the students that demonstrated each criterion were as follows: Indicator #1-85%; Indicator #2-90%. Evaluation and Actions 2012: The assessment results were evaluated by the faculty at a retreat held in August of Indicator #1: Based on the analysis of the results, the faculty decided not to take further action but to monitor student progress through the next cycle of data collection. Indicator #2: Faculty members were satisfied that the program was achieving the desired outcome and it was recommended not to make any changes at this time. TR-R-01 USU ASAC Self Study 30 January, 2015