Michigan Technological University School of Technology. Construction Management Assessment Report Academic Year

Transcription

1 Michigan Technological University School of Technology Construction Management Assessment Report Academic Year 1

2 Table of Contents Construction Management Continuous Improvement Plan. 3 Program Quality and Outcome Assessment for Mission and Goals Statement. 4 Program Educational Objectives 10 Program Outcomes 10 PEO/PO Relationships.. 11 Assessment Tools 12 Program Educational Objectives Assessment Process 15 Program Outcomes Assessment Process Appendix A: Program Education Objectives Assessment Results 33 Table A.1 Job Placement Results Tables A.2, A.3, A.4 Alumni Survey Results Tables A.5, A.6 Employer Survey Results Table A.7 IAB Discussion and Recommendations Appendix B: Program Outcomes Assessment Results.. 39 Table B.1 Student Rating of Instruction Table B.2, B.3 Graduate Exit Interviews Appendix C: University Assessment Results. 42 Appendix D: List of Continuous Improvement Activities 46 Appendix E: MTU Rating of Instruction Instrument 48 Appendix F: MTU Preliminary Course/Instructor Evaluation Instrument 50 2

3 Construction Management Program Continuous Improvement Plan The purpose of the CMG Continuous Improvement Plan is to have a well-documented process for assessing and evaluating the extent to which program and curriculum improvement is being achieved. Improvement is measured using Goals and Objectives that have been established according to the Mission Statement for the Construction Management Program. The Mission Statement, Goals, and Objectives are similar for all programs within the School of Technology as these were established according to the Michigan Tech University Strategic Plan. The Continuous Improvement Plan requires evaluation of performance for specific goals and objectives that are outlined in the Mission and Goals statement (see next page). Included in the plan is an Outcomes Assessment Program to measure the performance of students and graduates with regard to specific Program Educational Objectives (PEOs) and Program Outcomes (POs). The PEOs describe the attributes that we aspire for our graduates to attain within the first several years following graduation from Michigan Tech. The assessment tools used to measure achievement of these attributes include survey results conducted by the University Career Center, alumni surveys, employer surveys, and input from our Industrial Advisory Board. The POs describe the student outcomes that we expect our CMG students to achieve by the time they graduate from Michigan Tech. These outcomes are evaluated using course assessment, student evaluations, senior exit surveys, and senior project evaluations. The process and the most recent results ( ) are described in detail in this report. 3

4 Michigan Technological University School of Technology, Construction Management Mission Statement: The mission of the MTU Construction Management program is to provide a quality and current education that will prepare students for professional careers in the construction industry. Students will be employable upon graduation and be prepared to grow professionally and be productive citizens in a global society. Goals: (Update for Academic year) 1. Attract and support world-class and diverse faculty, staff, and students Provide an outstanding work environment and support for faculty and staff. Metric: Benchmark salary and compensation package Attract a bright, motivated, and diverse student body. Metrics: - Target average GPA of 2.75 and ACT of 22 for incoming students. - Percent ethnicity and gender of students Provide exceptional facilities and an aesthetically pleasing environment. Metric: Optimize use of resources, labs, and equipment Enhance learning, discovery, and engagement by continually upgrading the faculty and staff. Metric: Add one additional FTE faculty member by Fall Deliver a distinctive and rigorous learning experience to prepare graduates for careers in the construction field and professional growth. 2.1 Provide dynamic experiential learning that integrates instruction, teamwork, and projects in undergraduate courses. Metric: Outcomes Assessment Program Promote and encourage student engagement, learning, and civic responsibility. Metric: Extracurricular opportunities and organizations such as NAHB, ASC, ETEC, and others Achieve ACCE accreditation by July Metric: ACCE accreditation. 3. Maintain and expand the program to enhance the CMG faculty performance in learning, discovery, and engagement Encourage and support faculty engagement in industry and/or other professional development activities annually. Metric: Industrial activities, research involvement, publications and other Promote technological education, economic development, and innovations regionally and nationally. Metric: Industry relations, committee participation, speaking engagements, and other outreach efforts. 4

5 Michigan Technological University School of Technology, Construction Management Goal 1: Attract and support world-class and diverse faculty, staff, and students. Objective 1.1: Provide an outstanding work environment and support for faculty and staff. Measurement: Benchmark salary and compensation package for construction management positions at other universities (Michigan State University, Ferris State University, Eastern Michigan University, etc.). Outcome from Analysis: This has not been done yet. Action Taken or To Be Taken: Conduct survey of other universities. Disposition: Carry forward to Objective 1.2: Attract a bright, motivated, and diverse student body. Measurement: Determine average GPA (target 2.75) and ACT (target 22) scores of incoming freshmen students. Also, determine gender and ethnicity information (targets not established). Outcome from Analysis: Data for incoming CMG freshmen for was not available due to the low numbers. Action Taken or To Be Taken: 1. The CMG program needs to improve total enrollment while maintaining the above standards. Disposition: Carry forward to

6 Michigan Technological University School of Technology, Construction Management Goal 1: Attract and support world-class and diverse faculty, staff, and students. Objective 1.3: Provide exceptional facilities and an aesthetically pleasing environment. Measurement: Optimize use of resources, labs, and equipment. Outcome from Analysis: 1. Computer labs in the School of Technology have all been upgraded to state of the art with equipment and software. The rooms all have new furniture and carpeting. 2. Most classrooms have computers and technology for classroom presentations. 3. The materials testing labs are shared with the Civil Engineering department and all have current testing equipment and adequate facilities. This is a recurring objective and the goal was achieved as much as possible for this year. Action Taken or To Be Taken: 1. Continue to upgrade classrooms and computer labs as needed. 2. Continue to replace and upgrade lab testing equipment as needed. 3. Long term goal is to have a Construction Management Laboratory to consolidate the lab needs for materials testing, construction methods, and building utility systems. Disposition: Carry forward to Objective 1.4: Enhance learning, discovery, and engagement by continually upgrading the faculty and staff. Measurement: Add one additional FTE faculty member by Fall Outcome from Analysis: This has been done. Action Taken or To Be Taken: None required at this time. Disposition: Continue to monitor student enrollment and expand the curriculum opportunities as much as possible. 6

7 Michigan Technological University School of Technology, Construction Management Goal 2: Deliver a distinctive and rigorous learning experience to prepare graduates for careers in the construction field and professional growth. Objective 2.1: Provide dynamic experiential learning that integrates instruction, teamwork, and projects in undergraduate courses. Measurement: Continue implementation of our Outcomes Assessment Program with specific Program Educational Objectives and student Program Outcomes. The assessment program shall include evaluation of specific course objectives, graduate exit surveys, alumni surveys, and input from an Industrial Advisory Board. Outcome from Analysis: The Outcomes Assessment Program has been set up and specific Program Educational Objectives (PEOs) and Program Outcomes (POs) have been established. An initial Assessment Report was completed. The assessment included course evaluation by the instructor using specific measurements of student performance, student evaluations, graduate surveys, alumni surveys (first time), employer surveys (first time), and input from the Industrial Advisory Board (IAB). ETEC Continue work on current, practical projects related to construction management. This is a recurring objective and the goal was achieved for this year. Action Taken or To Be Taken: Continue to implement the Outcomes Assessment Program and complete the assessment for every course used to measure the PEOs and the POs. There will likely be some revisions to the POs pending final action by the ACCE regarding specified learning outcomes. Disposition: Carry forward to Objective 2.2: Promote and encourage student engagement, learning, and civic responsibility. Measurement: Encourage extracurricular activities and student participation in organizations such as National Home Builders (NAHB), Associated Schools of Construction (ASC) bid competition, engineering enterprise (ETEC), and others. Outcome from Analysis: 12 Students involved in NAHB (transitioned to the Husky Design and Construction Association in Spring 2014). 6 Students participated in the regional ASC bid competition. 14 Students participated in the ETEC enterprise. 38 Students enrolled in the CMG program during the academic year. 15 Students attended the AGC Student Contractor Awareness (SCAN) night. ETEC students participated in four weatherization projects with local non-profit organizations and at-risk high school students. This is a recurring objective and we consider this to be a moderately successful year. Action Taken or To Be Taken: Continue to promote these extracurricular activities for CMG students. Disposition: Carry forward to

8 Michigan Technological University School of Technology, Construction Management Goal 2: Deliver a distinctive and rigorous learning experience to prepare graduates for careers in the construction field and professional growth. Objective 2.3: Maintain ACCE accreditation. Measurement: Achieve ACCE accreditation. Outcome from Analysis: The CMG program received ACCE accreditation in Feb The Year #1 Progress Report was submitted and accepted by the ACCE in Dec Action Taken or To Be Taken: Prepare progress reports as required by the ACCE and maintain a current, accredited program. Disposition: This is a recurring objective and will be carried forward to

9 Michigan Technological University School of Technology, Construction Management Goal 3: Maintain and expand the program to enhance the CMG faculty performance in learning, discovery, and engagement. Objective 3.1: Encourage and support faculty engagement in industry and/or other professional development activities annually. Measurement: Assess faculty engagement, research, and professional development activities. Outcome from Analysis: Faculty engaged in various professional activities including: Completed Primavera P6 Training for Release 8.2, Application Administration and Advanced Web Application. Completed Prolog Training Completed AIA Green Technologies and Design Methods for Historic Buildings Participated in API Leadership training in Minneapolis along with two students. Participated in annual ACCE meetings. Workplace Safety & First Aid Training (MIOSHA and American Heart Association) Construction Industry related webinars (through CMAA, AGC, JJ Keller Online, Industrial Training International) This is a recurring objective and the goal is considered to be achieved for this academic year. Action Taken or To Be Taken: Continue to encourage and support faculty development activities. Disposition: Carry forward to Objective 3.2: Promote technological education, economic development, and innovations regionally and nationally. Measurement: Faculty relations with industry, professional organizations, speaking engagements, and other outreach efforts. Outcome from Analysis: This is a recurring objective and is considered to be moderately successful for this academic year. Two ETEC Senior Design Projects were the foundation of a successful $350K NSF Grant for capital improvements at Ford Center. Faculty participated in Construction Career Days in several venues during the past academic year. Action Taken or To Be Taken: Continue outreach efforts to promote technological education. Disposition: Carry forward to

10 Construction Management, MTU Program Educational Objectives Construction is a very diversified industry and among the leaders in this vast enterprise is the professional constructor or construction manager. A construction manager has the skills and knowledge, acquired through education and experience, to participate in the planning, design, and construction of a project from inception to completion for the purpose of controlling time, cost, and quality. The Program Educational Objectives (PEOs) listed below describe the attributes that we aspire for our graduates to possess during the first several years following graduation: PEO 1 PEO 2 PEO 3 PEO 4 PEO 5 Graduates will be well prepared for their first position in the construction management field. Graduates will have an understanding of construction science topics as needed for their position. Graduates will have an understanding of project management tasks including estimating, planning and scheduling, construction law, project safety, and other administrative procedures. Graduates will have the communication skills to work effectively as part of a team. Graduates will show a commitment to continuous improvement and life long learning by participating in professional societies, pursuing professional certifications, attending seminars or graduate studies. Program Outcomes In order to achieve the above educational objectives, we expect our students to obtain the following Program Outcomes (POs) by the time that they graduate with their baccalaureate degree: PO 1 An understanding of basic structural design theory for structural steel, timber, reinforced concrete, and masonry. PO 2 An awareness of the basic civil, structural, mechanical, and electrical systems that are incorporated in a building project. PO 3 An awareness of building codes and standards. PO 4 Ability to use computer applications and construction graphics. PO 5 An understanding of construction methods and materials including standards, testing, and acceptance procedures. PO 6 An understanding of quantity take-off and cost estimating procedures. PO 7 An understanding of project planning and scheduling. PO 8 An understanding of construction accounting and finance and bidding procedures. PO 9 An understanding of project management, construction contracts, ethical and legal considerations. PO 10 An awareness of project safety requirements. PO 11 An ability to communicate effectively, both orally and written. PO 12 An ability to function effectively as part of a project team. Sept JPD 10

11 Relationship between CMG Program Education Objectives (PEOs) and Program Outcomes (POs): Table 1: Relationship Between Program Outcomes and Program Educational Objectives 1 Program Outcomes POs An understanding of basic structural design theory for structural steel, timber, reinforced concrete, and masonry. Program Educational Objectives X 2 An awareness of the basic civil, structural, mechanical, and electrical systems that are incorporated in a building project. X 3 An awareness of building codes and standards. X 4 An ability to use computer applications and construction graphics. X 5 An understanding of construction methods and materials including standards, testing, and acceptance procedures. X 6 An understanding of quantity take-off and cost estimating procedures. X X 7 An understanding of project planning and scheduling. X X 8 An understanding of construction accounting and finance and bidding procedures. X X 9 An understanding of project management, construction contracts, ethical and legal considerations. X X X 10 An awareness of project safety requirements. X X 11 An ability to communicate effectively, both orally and written. X 12 An ability to function effectively as part of a project team. X 11

12 Assessment Tools The following table shows a summary of the various tools used to collect data in order to assess our Program Outcomes and program Educational Objectives. The table also identifies the items that are assessed by each tool and the frequency of assessment. A brief description of each tool is provided below. Table 2: Summary of Assessment Tools Assessment Tool Responsible for Data Collection/Analysis Frequency Course Assessment Faculty Semester PO Student Rating of Instruction Center for Teaching, Learning, and Faculty Development Semester (All Courses) Senior Exit Survey SOT Staff Semester Senior Project Evaluation Faculty Annually Job Placement University Career Center Semester PEO Alumni Survey SOT Staff Triennially Employer Survey SOT Staff Triennially Input from Industrial Advisory Board Faculty Annually Program Outcome Assessment Tools: Course Assessment All faculty members are required to conduct individual course assessments during each semester. Data gathered during this process is used to make adjustments and improve the student learning experience. The course improvements are summarized each year in a Summary of Program Improvements document. The achievement standard is that 70% of the students perform at a level of 70% or better for each of the course competencies, which are linked to the program outcomes. Examples of assessment methods used are: homework assignments, labs, lab reports, quizzes, exams, performance projects, and the fourth week Preliminary Evaluation Form that is completed by the students. Student Rating of Instruction A standard university instrument administered by the Center for Teaching, Learning, and Faculty Development is used to obtain student feedback regarding instructor performance in the classroom. A sample form is attached as Appendix D. 12

13 Senior Project Evaluation This comprises the student performance (student teams) on the senior capstone project (Project Simulation) as measured by various examiners. The examiners attended the project presentations at the end of the semester and assessed the team performance using a level ranking. The examiners may include CMG faculty members and/or construction industry professionals. Senior Exit Survey Each semester, the graduating students complete a Senior Exit Survey, which is a written questionnaire concerning the Program Outcomes and other pertinent information about their educational experience. The student feedback data is used to identify trends in either the positive or negative direction. The table below shows the relationship between the Program Outcomes and the construction management course(s) that are used to assess achievement of these outcomes. Table 3: Program Outcomes and Course Assessment Program Outcome CMG Course PO 1 CMG 2120, CMG 3250 PO 2 CMG 2110, CMG 2140 PO 3 CMG 3250, CMG 4900 PO 4 CMG 1000, CMG 3200, CMG 3265, CMG 4120, CMG 4900 PO 5 CMG 1140, CMG 2140 PO 6 CMG 2265, CMG 3265 PO 7 CMG 4120 PO 8 CMG 4300 PO 9 CMG 4200, CMG 4210 PO 10 CMG 4400 PO 11 PO 12 All CMG courses All CMG courses 13

14 Program Educational Objectives Assessment Tools: The target outcomes impact the CMG program curriculum in areas related to basic and advanced Construction Management skills. Table 2 shows all the assessment tools that were used for the PEOs. Job Placement Data Data from the Career Office on our graduates job placement reflects the success of our graduates in securing a job in a related field. Alumni Survey This is a written questionnaire which our alumni are asked to complete. Data will be collected every three years. The data will be analyzed and used in continuous improvement. A sample copy of the survey is in Appendix E. The next survey will take place during the academic year. Employer Survey The Employer Survey is a written questionnaire which is sent to employers of our CMG graduates. Data will be collected every three years. Results of data analysis will be used to enhance and strengthen our program. A sample copy of the survey is in Appendix E. The next survey will take place during the academic year. Input from Industrial Advisory Board (IAB) The CMG Industrial Advisory Board assists the CMG program in keeping our program current and relevant. Input from the IAB is collected every year and is considered in making continuous improvements to the program. Program Educational Objectives Assessment Process Table 4 shows the assessment tools used and the recent achievement standard (Academic Year ) for each of the Program Educational Objectives (PEOs). These results will be updated with another Alumni Survey and Employer Survey during

15 Table 4: Assessed Program Educational Objectives PROGRAM EDUCATIONAL OBJECTIVE 1. PEO1: Graduates will be well prepared for their first position in the construction management field. ASSESSMENT CRITERIA 1a. 70% of CMG graduates are currently employed in a degree related job as reported by the university job placement data. 1b. 70% of the CMG Alumni responding to the Alumni Survey will indicate they rate the overall quality of their CMG educational experience as good or better. (Survey Question #1) 1c. 70% of CMG Alumni responding to the Alumni Survey will indicate they are: 1) currently employed in a position directly related to their education, 2) have accepted a job offer for a position directly related to their education, 3) have at one time worked in a position directly related to their education since graduation, or 4) are currently pursuing an additional college degree. 1d. 70% of Employers responding to the Employer Survey will indicate they rate the overall quality of their CMG employees educational preparation from MTU as good or better. (Survey Question #1) RESULTS 1a. 100% reporting had a job. 82% of total had a job. 1b. 70% of the CMG Alumni responding rated the quality as good or better (Avg rating = 4.1/5.0) 1c. 90% of the CMG Alumni responding indicate they are currently employed, and 10% indicate they are pursuing a graduate degree. 1d. 100% of Employers responding rated the quality as good or better (Avg rating = 4.5/5.0) Only 4 responses received (3% response rate). Also, 1 Employer indicated that they also hire Civil Engr. Graduates, so they based their responses on both CMG and CE USE OF RESULTS 1a. The goal was met. 1b. The goal was met. Continue to monitor and strive for improvement. 1c. The goal was met. Continue to monitor on future surveys. 1d. The goal was met. However, we must: a) significantly improve the response rate and b) gather feedback on only CMG graduates. This is true for all of the Employer feedback received, nevertheless, we will consider the results. 1e. The CMG Industrial Advisory Board will meet at least annually to review and provide feedback to improve the quality of the program and preparation of our graduates. 1e. The CMG IAB met this academic year on 10/12/ 2011 and 4/19/ e. See the IAB meeting minutes and Appendix A, Table A.7. 15

16 2. PEO2: Graduates will have an understanding of construction science topics as needed for their position. 2a. On the Alumni and Employer Surveys, one or more abilities are listed which reflect this objective. Alumni are asked to rate their ability and understanding as gained from their MTU education. The scale is: 5 Very Satisfied 4 Satisfied 3 Neutral 2 Dissatisfied 1 Very Dissatisfied For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #2: An understanding of basic structural design theory for steel, timber, concrete and masonry as needed in your work (Alumni) 4.50 (Employer) Survey Question #4: Ability to utilize computer applications and computer graphics as needed in your work (Alumni) 4.80 (Employer) 2a. The goal was met. Continue to monitor and strive for improvement. Also, we must improve the Employer response rate and emphasize only CMG graduates. Survey Question #5: Ability to understand materials standards and testing and acceptance procedures in your work (Alumni) 4.50 (Employer) Alumni Survey 10 responses (54) 19% response rate. Employer Survey 4 Responses (138) 3% response rate. 16

17 3. PEO3: Graduates will have an understanding of project management tasks including estimating, planning and scheduling, construction law, project safety, and other administrative procedures. 3a. On the Alumni and Employer Surveys, one or more abilities are listed which reflect this objective. Alumni are asked to rate their ability and understanding as gained from their MTU education. The scale is: 5 Very Satisfied 4 Satisfied 3 Neutral 2 Dissatisfied 1 Very Dissatisfied For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #6 Ability to perform quantity take-off and cost estimating tasks in your work (Alumni) 4.80 (Employer) Survey Question #7 Ability to perform project planning and scheduling tasks in your work (Alumni) 4.80 (Employer) 3a. The goal was met, except for a slightly lower rating for Survey Question #8 (with regard to construction contracts, accounting, and bid procedures). Need to emphasize more in some courses (CMG 3265, 4200, and 4300). One recent action taken was to make CMG 4200 a Required course, rather than an Elective. Survey Question #8 An understanding of construction contracts, accounting, and bid procedures in your work (Alumni) 4.00 (Employer) Survey Question #9 An understanding of project management, contracts, and legal obligations in your work (Alumni) 4.00 (Employer) Survey Question #10 An awareness of project safety req ts in your work (Alumni) 4.50 (Employer) 17

18 4. PEO4: Graduates will have the communication skills to work effectively as part of a team. 4a. On the Alumni and Employer Surveys, one or more abilities are listed which reflect this objective. Alumni are asked to rate their ability and understanding as gained from their MTU education. The scale is: 5 Very Satisfied 4 Satisfied 3 Neutral 2 Dissatisfied 1 Very Dissatisfied For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #11 Ability to assume positions of leadership within your respective organization (Alumni) Weighted Averaga = 4.03 (Employer) Survey Question #12 Ability to work effectively as a member of a multidiscipline project team (Alumni) 4.80 (Employer) 4a. The goal was met. Continue to monitor and strive for improvement. Survey Question #13 Ability to effectively articulate ideas in both written and oral communications (Alumni) 4.80 (Employer) 5. PEO5: Graduates will show a commitment to continuous improvement and lifelong learning by participating in professional societies, pursuing professional certifications, attending seminars or graduate studies. 5a. On the Alumni and Employer Surveys, one or more abilities are listed which reflect this objective. Alumni are asked to rate their ability and understanding as gained from their MTU education. The scale is: 5 Very Satisfied 4 Satisfied 3 Neutral 2 Dissatisfied 1 Very Dissatisfied For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #14 Ability to understand and exhibit professional, ethical, and social responsibility in your pursuit of a career in the construction industry (Alumni) 4.80 (Employer) 5a. The goal was met. Continue to monitor and strive for improvement. 18

19 5a. Survey Question #15 Awareness of the value of continuous improvement, with a focus on quality and a commitment to lifelong learning (Alumni) 4.50 (Employer) Program Outcomes (PO) Assessment Process Table 5 shows the assessment tools that were used and the achievement standard for each of the program outcomes. Table 5: Assessed Program Outcomes PROGRAM OBJECTIVE PO1: An understanding of basic structural design theory for structural steel, timber, and reinforced concrete. ASSESSMENT CRITERIA 1a. Course Assessment (CMG2120, CMG3250) CMG 2120: Have 70% of the students score above 70% on the 3 Exams and the Final Exam. Student rating on Question #12 above a 3.50 average. RESULTS 1a. CMG 2120: Exam #1 40% >70 Exam #2 80% >70 Exam #3 100% >70 Final Exam 60% >70 Average student rating on Question #12 = USE OF RESULTS 1a. The goal was not met. ( only 5 students.) CMG2120: Student ratings were acceptable. The performance level was not met for Exam #1 or the Final, but improved from Continue to spend more of the lab time on topic review and problem solving. Also, need to find a way to encourage students to do all of the homework. (Implemented in Spring 2013, so continue). 19

20 CMG 3250: Have 70% of the students score above 70% on the 3 Exams. Have 70% of the students score above 70% on the graded homework assignments. Have 70% of the students score above 70% on the Design Project. 1b. Student Rating of Instruction. Rating above a 3.50 average for Q #1 20. Added optional questions to the student evaluation forms for this Program Outcome. 1c. Senior Exit Survey. On the Senior Exit Survey, one or more abilities are listed which reflect this objective. Graduates are asked to rate their ability and understanding as gained from their MTU education. The scale is: 4 Outstanding 3 Good, No weaknesses 2 Fair, Minor weaknesses 1 Poor, Major weaknesses 0 Completely unprepared For each ability relevant to this Objective, the weighted average of responses will be at least CMG 3250: Exam #1 20% >70 Exam #2 60% >70 Exam #3 100% >70 HW 20% >70 Project 100% >70 1b. CMG 2120: Avg. Rating = CMG 3250: Avg. Rating Q#20 = Avg. Rating Q#21 = Avg. Rating Q#22 = c. Survey Question #7 Understand the principles underlying the design of building structures (F 13, S 14) CMG 3250: The results are improved from Fall 2012, but not quite met. Performance on the Exams #2 & 3 improved, and the greater emphasis on homework and the Design Project improved student performance in these areas. (Continue methods for Fall 2014.) 1b. The goal was met. 1c. The goal was met. 20

21 PO2: An awareness of the basic civil, structural, mechanical, and electrical systems that are incorporated in a building project. 2a. Course Assessment (CMG 2110, CMG 2140) CMG 2110: Have 70% of the students score above 70% on the 4 Exams. Have 70% of the students score above 70% on the graded homework assignments. Have 70% of the students score above 70% on the 3 Design Projects 2a. CMG 2110: Exam #1 87% >70 Exam #2 93% >70 Exam #3 87% > 70 Exam #4 87% > 70 HW 100% >70 Project 1-87% >70 Project 2-100%>70 Project 3-100%>70 Final Grade - 100%>73 2a. CMG 2110: The goal was met. CMG 2140: Have 70% of the students score above 70% on the 4 Exams. Have 70% of the students score above 70% on the graded homework assignments. Have 70% of the students score above 70% on the Design Projects. CMG 2140: Exam #1 71% >70 Exam #2 57% >70 Exam #3 86% > 70 Exam #4 86% > 70 HW 100% >75 Project 1-100% >75 Final Grade -86%>75 CMG 2140: The goal was met. A few difficulties with exam 2 material & HW will be addressed in next year s class. 2b. Student Rating of Instruction. Rating above a 3.50 average for Q # b. Avg. Rating: CMG 2110 = 4.27 CMG 2140 = b. The goal was met. 2c. Senior Exit Survey. For each ability relevant to this Objective, the weighted average of responses will be at least c. Survey Question #8 Compare and choose proper building systems, materials and methods (F 13, S 14) 2c. The goal was met. Plan to continue to emphasize building systems more in the CMG 2110 class, along with the CMG 3265 class so that students are better prepared for Senior Design. 21

22 PO #3: An awareness of building codes and standards. 3a. Course Assessment (CMG 3250, CMG 4900, ENT XXX) CMG 3250: Added an optional question to the Student Evaluation form to directly assess this outcome (Question #23 I am aware of the use of building codes and the standard Code manuals for structural design in steel, timber, reinforced concrete and masonry) Achieve a rating above a 3.50 average for Question #23. 3a. CMG 3250: CMG 4900 & ENT XXX: There was no tangible way to assess this objective. Students used the 2009 IBC during the Design-Build portion of this class. 3a. The goal was met. CMG 3250: Continue to use appropriate Code manuals. CMG 4900 & ENT XXX: Students did use and were required to reference building codes as part of their senior project. 3b. Senior Exit Survey. For each ability relevant to this Objective, the weighted average of responses will be at least b. Survey Question #7 Understand the principles underlying the design of building structures (F 13, S 14) 3b. The goal was met. PO 4: An ability to use computer applications and construction graphics. 4a. Course Assessment (CMG 1000, CMG 3200, CMG 3265, CMG 4120, CMG 4300, CMG 4900, ENT XXX) CMG 1000: Assign, collect and evaluate (i.e., grade) lab exercises (Excel, AutoCAD, Revit Architecture). Class average on each exercise to be >70% (based on submitted exercises) 4a. CMG1000: Twelve lab assignments utilizing computer applications / construction graphics were assigned and evaluated (i.e., graded in detail). Lab #1 dealt with Excel, Labs #2 to #4 dealt with AutoCAD, Labs #5-#12 dealt with Revit Architecture. Class averages as follows: 4a. This goal was not met for all cases and remains a recurring goal. CMG 1000: In all cases, this goal was met. 22

23 CMG 3200: Assign, collect and evaluate (i.e., grade) CAD-based (i.e., AutoCAD / Carlson Civil Suite) Lab Exercises. Class average score to be above 70% on each one. CMG 3265: Evaluate student s ability to use Excel as a requirement for the Project work. Consider the student s initiative in using free on-line software for cost estimating. 23 Lab #1: 90.6% Lab #2: 91.5% Lab #3: 94.7% Lab #4: 85.5 % Lab #5: 84.4% Lab #6: 82.8% Lab #7: 84.1% Lab #8: 89.7% Lab #9: 86.7% Lab #10: 82.5% Lab #11: 95.7% Lab #12: 90.0% CMG 3200: Eight CAD-based Lab Exercises assigned and evaluated (i.e., graded in detail). Class averages as follows: Lab #1: 96.0% Lab #2: 94.4% Lab #3: 92.7% Lab #4: 80.9% Lab #5: 89.2% Lab #6: 88.1% Lab #7: 84.3% Lab #8: 85.1% CMG 3265: 100% of the students can use Excel. 33% of the Project teams used take-off and estimating software for the second project. CMG 3200: In all cases, this goal was met. CMG 3265 Emphasized use of Excel in setting up Project Estimates. On Center software for Quantity Take-off and Bidding finally available at the end of the semester. Continue to encourage use of this software. (Implement in Fall 2013)

24 CMG 4120: Evaluate student s ability to use Scheduling software programs. CMG 4300: Evaluate the student s ability to use MS Excel. CMG 4900: Evaluate student s ability to use Excel as a requirement for the Project work. Also, assess the student s initiative in using free on-line take-off software for cost estimating on the Senior Project. CMG 4120: 100% of the students can set up a project, create tasks, and develop logic in P6. >70% can create a WBS, milestones and load resources. Project: 85% > 70% on the project (Avg. = 83%). CMG 4300: >75% of the assignments and the final project require that you use Excel to complete. Only 57% of the students scored >70% on these assignments. CMG 4900: 100% of the students can use Excel. 100% of the project teams used on-line take-off software. CMG 4120: This goal was met. CMG 4300: This goal was not met. Plan to flip the classroom for this course and hold the course in a computer lab. (Implement Fall 2015.) CMG 4900: This goal was met. 4b. Student Rating of Instruction. CMG1000: Fall 2013 Added an additional question to the Student Evaluation form: Q#21 - My ability to use CAD (AutoCAD and Revit Architecture) has increased substantially due to the lab portion of this course. Achieve a rating above 3.50 (out of 5) for this question. Achieve a rating above 3.50 (out of 5) for this question. 4b. CMG1000: Response to Q#21: Average rating: b. The goal was met.. 24

25 CMG 3265: Fall 2011 added an optional question to the Student Evaluation form: Q#22 I have the ability to use cost estimating spreadsheets and software. Achieve a Rating above 3.50 for this Question #22. CMG 4900: Rating above a 3.50 average for Q #1 20. CMG 3265: Response to Q#22: CMG 4900: Average rating = c. Senior Exit Survey. For each ability relevant to this Objective, the weighted average of responses will be at least c. The goal was not met. Fundamentals are OK, but need to improve use of professional software. The survey form will be revised to determine specific areas of concern. (Implement in Fall 2014). 25

26 PO5: An understanding of construction methods and materials including standards, testing, and acceptance procedures. 5a. Course Assessment (CMG 1140, CMG 2140) CMG 1140: Have 70% of the students score above 70% on the 2 Exams and have the Overall Class Average be above 70%. Student rating on 3 Optional Questions (per the Course Objectives) above a 3.50 average. 5a. CMG 1140: Exam #1 = 86% Exam #2 = 100% Overall Avg. = 79% Average student rating on the 3 optional questions = a. The goal was met. CMG 1140: The students understand the fundamentals of materials, testing, and acceptance. CMG 2140: Have 70% of the students score above 70% on the 4 exams. 5b. Student Rating of Instruction. Rating above a 3.50 average for Q #1 20. (CMG 1140, CMG 2140) CMG 2140: Exam #1 71% >70 Exam #2 57% >70 Exam #3 86% > 70 Exam #4 86% > 70 5b. CMG 1140: Average rating = 4.24 CMG 2140: Avg. rating = CMG 2140: The goal was met. A few difficulties with exam 2 material will be addressed in next year s class. 5b. The goal was met. CMG 1140: Average rating is acceptable. CMG 2140: Average rating is acceptable. 5c. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least c. Survey Question #8 Compare and choose proper building systems, materials and methods (F 13, S 14) 5c. The goal was met. 26

27 PO6: An understanding of quantity take-off and cost estimating procedures. 6a. Course Assessment (CMG 2265, CMG 3265) CMG 2265: Have 70% of the students score above 70% on the Exam. Have 70% of the students score above 80% on the Homework assignments. Have 100% of the Project Teams score above 80% on the Project. Have the Overall Class Average be above 70%. Student rating on Optional Questions I and II (per the Course Objectives) be above a 3.50 average. CMG 3265: Have 70% of the students score above 70% on the Exam. Have 70% of the students score above 80 % on the Homework assignments. Have 100% of the Project Teams score above 80% on the Projects (2 each). 6b. Student Rating of Instruction. Rating above a 3.50 average for Q # 12. 6a. CMG 2265: 83% of the students scored above 70% on the examination. 83% of the students scored above 80% on their homework assignments. 100% of the Project Teams scored above 80% on the project. The average rating on optional questions I and II was CMG 3265: 83% of the students scored above 70% on the examination. 83% of the students scored above 80% on their homework assignments. 50% of the Project Teams scored above 80% on the Project 1, 50% of the Teams scored above 80% on Project 2. 6b. CMG 2265 (S 14): Q #12: Avg. Rating =4.75. CMG 3265 (F 13): Q#1-20: Avg. Rating = Q#21: Avg. Rating = (I understand the construction process, cost estimating) 6a. The goal was met. CMG 2265: The goal was met for the exams, the homework, the project, and the student evaluation questions. Need to continue to prepare students for the examination. (Plan to continue in Spring 2015.) CMG 3265: The students did very well on the Exam and spent the time needed on the homework and the Estimating projects. Continue to make this class projectoriented. Need to emphasize timely, correct project submissions in Fall b. The goal was met. 27

28 6c. Senior Exit Survey. For each ability relevant to this Objective, the weighted average of responses will be at least c. Survey Question #10 Perform major project management functions: estimating, scheduling, accounting, and financing ( ) 6c. The goal was met. Need to revise Question #10 to match the revised Program Outcomes (per ACCE). To be implemented in PO7: An understanding of project planning and scheduling. 7a. Course Assessment (CMG 4120) CMG 4120: Have 70% of the students score above 70% on the Exams. Have 70% of the students score above 70% on the Final Project. 7a. CMG 4120: Midterm 57 % scored > 70% on this exam (Avg = 66 %). Final 71% > 70% on this exam (Avg = 74%). Project - 71% (3ea.) scored > 70% on this project (Avg = 83%). 7a. CMG 4120: Because the final was comprehensive, I would say that our objectives were met. However, I plan to re-work the lab to better teach the scheduling concepts. (Implement Fall 2015.)) 7b. Student Rating of Instruction. Rating above a 3.50 average for Q # b. CMG 4120 (S 13): Q#1-20: Avg. Rating = 3.8 LAB 7b. The goal was met. 7c. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least c. Survey Question #10 Perform major project management functions: estimating, scheduling, accounting, and financing (F 13, S 14) 7c. The goal was met. Need to revise questions to determine the specific area for improvement. To be implemented in Fall

29 PO8: An understanding of construction accounting and finance and bidding procedures. 8a. Course Assessment (CMG 4210, CMG 4300) CMG 4210: Have 70% of the students score above 70% on the 2 Exams and the Final exam. 8a. CMG 4210: Exam #1 100% > 70% on this exam (Average = 84 %). Exam #2 100% > 70% on this exam (Average = 83%). Final Exam 100% > 70% (Avg = 71%). 8a. The goal was met. CMG 4300: Have 70% > 70% on the 2 exams. Have 70% > 70% on the Final Project. CMG 4300: Exam #1-100% > 70% (Avg = 84%). Exam #2 100% > 70% (Avg = 89%). Final Project 90% > 70% (Avg = 73%). 8b. Student Rating of Instruction. Rating above a 3.50 average for Q # b. Q#1-20: Avg. Rating = 4.0 8b. The goal was met. 8c. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least c. Survey Question #10 Perform major project management functions: estimating, scheduling, accounting, and financing c. The goal was met. Need to revise questions (see above). 29

30 PO9: An understanding of project management, construction contracts, ethical and legal considerations. 9a. Course Assessment (CMG 4200, CMG 4210) CMG 4200: Have 70% of the students score above 70% on the three projects and the Final exam. 9a. CMG 4200: Project #1 86% > 70% (Avg = 84 %). Project #2 86% > 70% (Avg = 75%). Project #3 71% > 70% (Avg = 75%) Final 86%> 70% (Avg = 78%). 9a. CMG4200: The goal was met. CMG 4210: Have 70% of the students score above 70% on the 2 Exams and the Final exam. 9b. Student Rating of Instruction. Rating above a 3.50 average for Q # c. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least CMG4210: Exam #1 100% > 70% (Avg = 84%). Exam #2 100% > 70% (Avg = 83%). Final 100% > 70% (Avg = 71%). 9b. CMG 4200 (S 13): Q#1-20: Avg. Rating = 4.29 CMG 4210 (F 12): Q#1-20: Avg. Rating = c. Survey Question #4 Respond to a professional ethical dilemma in accordance with current professional standards (F 13, S 14) Survey Question #11 Understand construction contracts and the administrative procedures CMG 4210: The goal was met. 9b CMG 4200 (S 13): The goal was met. CMG 4210 (F 12): The goal was met. 9c. The goal was not quite met. Continue to emphasize contract obligations in all CMG classes. 30

31 PO10: An awareness of project safety requirements. 10a. Course Assessment (CMG 4400) The average score on Test #2, Test #3, six quizzes and the course s Final Exam. Class average to be at least 70% on each item noted above. 10a. CMG4400: Average scores: Test #2 = 82.2% Test #3 = 94.2% GHS Quiz = 84.1% Jobsite Safety Quiz = 80.0% Elec. Safety Quiz = 85.0% Scaffold Quiz = 81.2% Fall Protect. Quiz 1 = 97.5% Fall Protect. Quiz 2 = 86.7% Final Exam = 83.6% 10a. In all cases, average > 70%; hence, goal was met. 10b. Student Rating of Instruction. Rating above a 3.50 average for Q # Fall 2013 Added an additional question to the Student Evaluation: Q#21 I have become significantly more familiar with OSHA s Safety requirements for the Construction Industry (i.e., Subparts of 29 CFR 1926: OSHA Construction Industry Safety Standards) due to this course. Achieve a rating above 3.50 for this question. 10b. CMG4400: Avg. rating when combining all 20 questions = 4.17; however, two individual questions had and avg. rating of < Q#1: I wanted to take this course, avg. rating of 3.33 Q#13: The instructional resources (textbook, handouts, etc.) furthered my learning, avg. rating of b. CMG4400: The goal was met for overall average of all 20 questions; however, address issue of 3.33 on Q#1 and 3.00 on Q #13. Response to Q#21: Average rating = 4.33 Response to Q#26: Average rating =

32 PO11: An ability to communicate effectively, both orally and written. 11a. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #2 Write clearly and concisely about technical and managerial matters (F 13, S 14) Survey Question #3 Communicate effectively in business settings and on the jobsite (F 13, S 14) 11a. This goal was met. Evaluation of reports and presentations in several classes support the exit survey results that our graduates have the ability to communicate. PO12: An ability to function effectively as part of a project team. 12a. Senior Exit Survey For each ability relevant to this Objective, the weighted average of responses will be at least a. Survey Question #5 Function effectively on teams a. This goal was met. Team projects in several classes support the exit survey results that our graduates can function effectively as part of a project team. 32

33 Appendix A: Program Educational Objectives (PEO) Assessment Results: Table A.1: Job Placement Data Result University Career Center Data Fall 2013 Graduates Spring 2014 Graduates Number of Graduates 3 7 Number of offers reported 4 8 Salaries $40,000 to $60,000 $40,000 to $60,000 Placement 33% 86% Alumni Survey Results The most recent Construction Management Alumni Survey was conducted in the Summer of It was mailed to 54 alumni and 10 valid surveys were returned, for a response rate of 18.5%. The results to the initial general questions are summarized in Table A.2 below and the other survey results are summarized in Table A.3 below. Another survey is planned for the academic year. Table A.2: Alumni Survey Results General Questions Survey Question Alumni Responses General Question: What is your position within your organization? General Question: Is this a leadership position within your organization? Survey Question #1: Based on your work experience since obtaining your undergraduate degree in CMG from Michigan Tech, what is your impression of the overall quality of your educational experience in the CMG program? Project Manager (3 each) Field/Const. Coordinator, Lab Manager (4 each) Scheduler (1 each) Yes (70 %) No (30%) Excellent (50%) Good (20%) Satisfactory (20%) CAD Operator (1 each) Fair (10%) Graduate Student (1 each) Marginal (0%) 33

34 Table A.3: Alumni Survey Results Survey Questions Listed below are several statements about the skills and knowledge you may have had to use for your employer. On a Scale of 5 = Very Satisfied to 1 = Very Dissatisfied, please rate your satisfaction level on how well the CMG program at Michigan Tech prepared you to apply these skills at your work place. Choose one box per row. #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 Very Satisfied Satisfied Neutral Dissatisfied Very Dissatisfied Average Rating An understanding of basic structural design theory for steel, timber, concrete, and masonry as needed in your work An understanding of building codes and standards as needed in your work Ability to utilize computer applications and computer graphics as needed in your work. Ability to understand materials standards and testing and acceptance procedures in your work. Ability to perform quantity take-off and cost estimating tasks in your work. Ability to perform project planning and scheduling tasks in your work An understanding of construction contracts, accounting, and bid procedures in your work. An understanding of project management, contracts, and legal obligations in your work. An awareness of project safety requirements in your work Ability to assume positions of leadership within your organization Ability to work effectively as a member of a multi-discipline project team. Ability to effectively articulate ideas in both written and oral communications. Ability to understand and exhibit professional, ethical, and social responsibility in your pursuit of a career in the construction industry. Awareness of the value of continuous improvement, with a focus on quality and a commitment to life-long learning. Overall Average Rating

35 Table A. 4: Alumni Survey Results Additional Questions Please indicate a Yes or No response to the following statements: Yes No No Response I participate in one (or more) professional societies I have taken the AIC exam for certification as an Associate Constructor (AC) I have successfully passed the AIC Certification exam I have pursued other professional certification(s) I have attended professional seminars as a commitment to life-long learning Alumni Survey Results Summary of Additional Comments 1. The AC certification was mentioned, but more guidance/encouragement should be provided. 2. Overall, I think I was better prepared than my peers from other universities, which allowed me to advance faster. 3. Improve on communication, which is a deficiency amongst most of my peers also. 4. Improve on Contracts discussion more than just the one Business Law class. 5. A component to add to the CMG program would be to get the students certified in different professional programs. Safety certifications like OSHA are a huge advantage for graduates and should be required, not just optional. 6. I work for a General Contractor and we subcontract about 90% of our work. It is very important to clarify the scope of the work and this should be covered better in the classes. 7. The thing I hated most when I was at school was the lack of feedback you do semester-long projects and at the end you never get any feedback about whether you did a good or a bad job. 8. Many teachers have great experience, but some have none and are weak team members. Share your stories and mistakes. 9. My final issue is building codes. I know nothing about ADA regulations and building codes. 10. The program focuses heavily on residential and commercial (I graduated in 2008). Industrial construction involves a lot of topics that were never covered, primarily piping systems. 11. My job now is just like Senior Design, but with more projects, real dollars, and a client that expects it to be done yesterday. I would say that the program needs more real life simulation projects, not just for one semester. 12. The best learning experience that I had at MTU was the Co-op and internship experience. I would emphasize to all students that it s super important to have this type of experience before looking for your full time job. I always wondered why local construction management companies don t come to the Career Fair? Could the program contact these companies and ask them to come? Do companies like Bacco, Gundlach, AE COM, Trimedia, UP Engineering, and others even know that MTU has a good CMG program? 13. College doesn t really prepare you for the real world. I would say I got about 40% of my knowledge of the construction field from Tech and 60% from working. 35

36 Employer Survey Results The most recent Construction Management Employer Survey was conducted in the Summer of It was mailed to 138 employers of CMG graduates, 8 were bounced back (and not included in the total count), and 4 responses were returned. This is a very low response rate of 3.1 %. The high number of employers includes several surveys sent to a different person at the same company (such as 9 surveys sent to Bechtel, Inc.). We are uncertain about the reasons for such a low response, but plan to investigate and try for significant improvement on the return rate next time. In any case, the results to the Employer Survey are summarized in Tables A.5 and A.6 below: Table A.5: Employer Survey Results General Questions Survey Question General Question: What is the name of your company? General Question: What is your position/title in your company? General Question: Total Number of CMG graduates that you currently supervise or have supervised. General Question: Based upon your professional experience and opportunities to observe CMG graduates from Michigan Technological University and other institutions, what is your impression about the overall quality of the CMG-Michigan Tech graduates? Employer Response Bonestroo, CN, Skanska, Black & Veatch Human Resources Associate, Operations Manager, Client Service Manager, Title not given Responses ranged from 0 to 4. Excellent (2 each) Good (2 each) Satisfactory (0) Fair (0) Marginal (0) 36

37 Table A.6: Employer Survey Results Survey Questions Listed below are several statements about the skills and knowledge expected of our CMG graduates. On a Scale of 5 = Very Satisfied to 1 = Very Dissatisfied, please rate your satisfaction level with regard to the performance of our CMG graduates that you have supervised. Please choose one box per row. #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 Very Satisfied Satisfied Neutral Dissatisfied Very Dissatisfied Average Rating An understanding of basic structural design theory for steel, timber, concrete, and masonry as needed in your work An understanding of building codes and standards as needed in your work Ability to utilize computer applications and computer graphics as needed in your work. Ability to understand materials standards and testing and acceptance procedures in your work. Ability to perform quantity take-off and cost estimating tasks in your work. Ability to perform project planning and scheduling tasks in your work An understanding of construction contracts, accounting, and bid procedures in your work. An understanding of project management, contracts, and legal obligations in your work. An awareness of project safety requirements in your work Ability to assume positions of leadership within your organization Ability to work effectively as a member of a multi-discipline project team. Ability to effectively articulate ideas in both written and oral communications. Ability to understand and exhibit professional, ethical, and social responsibility in your pursuit of a career in the construction industry. Awareness of the value of continuous improvement, with a focus on quality and a commitment to life-long learning. Overall Average Rating

38 Table A.7: List of Recent IAB Discussions and Recommendations ( meetings) Classification Discussion Items and Recommendation Owner Status CMG Curriculum Issues Continue to incorporate Revit and BIM in CMG1000, and use in other classes. CMG faculty This has been done. Continue to include certifications in CMG1140, especially the ACI Concrete Testing certification. CMG faculty This has been done. Software applications are important in Estimating (CMG3265) and Scheduling (CMG4120), but fundamentals are important. CMG faculty Continue to use Excel. Incorporate new Estimating software in Fall CMG Program Issues Student Activities Board Business Safety considerations are important, incorporate MIOSHA Certification in CMG4400. Incorporate jobsite visits and guest speakers as part of the course work. Major focus of our recent meetings (Oct and April 2014) was a brainstorming session regarding marketing and recruiting for the CMG program. The IAB again recommended that the CMG faculty and the IAB members take an active role to promote the program and recruit students. The IAB also recommended that we continue to develop more relationships and articulation agreements with community colleges, especially regional colleges in Michigan and Northern Wisconsin. Discussed the possibility of initiating a dedicated CMG scholarship for incoming students. Encourage internships, co-ops, and/or summer jobs in the construction field. Encourage students to become involved in the Michigan Tech student chapter of the Associated General Contractors (AGC). The Board added two new members Ron Doolittle (GE Johnson) and Brady Frederick (Edgerton Contractors). Continue to meet twice annually (Fall and Spring). If possible, incorporate the AGC-SCAN event or Career Day at the Fall Meeting and Senior Project presentations at the Spring Meeting. CMG faculty CMG faculty School of Technology administration, CMG faculty, IAB members. IAB members. CMG faculty CMG faculty CMG faculty and School of Tech. Administration. CMG faculty and IAB members Continue to offer the 10-hr. MIOSHA Cert. in CMG4400. This is ongoing. This is ongoing. Faculty and IAB member(s) plan to attend Construction Career Day events as much as possible. New and improved website was completed in This effort is underway. This is ongoing. This is ongoing. Plan to discuss joint involvement with Civil Engr. Search is completed. This was implemented in Fall

39 Appendix B: Program Outcomes (PO) Assessment Results: Course Assessment Tool For continuous improvement, faculty are required to conduct Course Assessment at the end of each semester. For many years, faculty conducted course assessment on an informal basis to assist them in evaluation and continuous improvement of their courses. Now, effective Fall 2010, we have established a more formal method to evaluate performance and assess student outcomes. Course assessments are summarized in the previous Table 4 for each Program Outcome. Student Rating of Instruction Faculty are required to conduct student evaluations during the 4 th or 5 th week of each semester ( Preliminary Course/Instructor Evaluation ) and at the end of each semester. The comments received in the Preliminary Evaluation are considered and incorporated as needed to improve instruction. The Student Rating of Instruction is more detailed feedback and utilized to improve the course delivery for future semesters. The results for the student evaluations are included in the previous Table 4. 39

40 Table B.1: Graduate Exit Interview Results Survey Questions ( ) Please rate the quality of education and training you received from the Construction Management program in the following aspects: Outstanding = 4; Good, no weaknesses = 3; Fair, minor weaknesses = 2; Poor, major weaknesses = 1; Completely unprepared = Survey Question: Fall 2013 Spring 2014 Avg. for Yr. #1 Apply basic mathematical and physical knowledge to engineering and construction problems #2 Write clearly and concisely about technical and managerial matters #3 Communicate effectively in business settings and on the jobsite #4 Respond to a professional ethical delimma in accordance with current professional standards #5 Function effectively on teams #6 Print reading and drafting #7 Understand the principles underlying the design of building structures #8 Compare and choose proper building systems, materials and methods #9 Perform survey and site layout tasks #10 Perform major project management functions: estimating, scheduling, accounting, and financing #11 Understand construction contracts and the administration procedures #12 Utilize common productivity software, e.g. Word, Excel #13 Utilize professional engineering and construction software #14 Identify technical and managerial problems in construction projects #15 Solve problems creatively #16 Independently pursue additional knowledge or skills #17 Overall, I think the program is: Average Rating for Q # 1 to Number of Respondents Number of Graduates

41 Table B.2: Graduate Exit Interview Results General Questions ( Academic Year) Please respond to the following General Questions: #2 When did you begin your job searching? #3 How many job applications have you submitted so far? #4 How many offers have you received so far? Fall 2013 Spring 2014 (3 respondents / 3 graduates) (7 respondents / 7 graduates) Freshman year to junior year Fall to 40 (estimated avg. = 27) 6 offers 0 offers Varies from 0 to offers 0 offers 2 offer 1 offers Yes (3 each) Pending (1 each) No (3 each) #5 Have you already accepted a job offer? Yes (1 each) No (2 each) #6 Please provide your starting salary $50,000 to 60,000 $50,000 to 60,000 (optional). #7 What knowledge/skills/abilities learned in this program have helped you the most in obtaining a job? #8 What knowledge/skills/abilities do you think can help you find a more satisfying job but have not been adequately developed in this program? #9 As a college student, did you ever take a co-op or intern position related to you major or work in a position related to your major (full or part-time)? #10 If you answered Yes to Question #9, for which firm(s) have you worked and for how many months? #11 Other than the Senior Project course, did you participate in any Enterprise or similar programs while in college? #12 If you answered to Question #11, please list which Enterprise or other program(s). #13 While you were a student at MTU, were you a member of any student or professional organization? Note the organization and your level of participation in each. The ability to solve real problems as learned in all classes. A little bit of everything from all classes. A specific course in Revit modeling. Yes (3 each) A developing company in China, Loram Maintenance (3 mos.), Harmon (3 mos) Yes (3 each) ETEC Enterprise, NAHB Yes (3 each) KSI, MTU 4-wheelers club Project courses, estimating experience(s), scheduling. Communication skills. CAD experience in surveying and site planning. More opportunities for on the job experience and more exposure to industry. More capstone projects. Yes (7 each) MDOT (1); Spicer; Baker Concrete (4) ; Lithco Contracting (3) Yes (4 each) No (3 each) ETEC, NAHB, ASC Competition #14 Do you plan to go to graduate school? Yes (1 each), No (2 each) Yes (4 each) No (3 each) #15 Do you expect to take continuing education courses, seminars, etc. Yes (3 each) Yes (7 each) Yes (5 each) ETEC NAHB (Secretary) REAC MTU Paintball Engineers Without Borders 41

42 throughout your career? #16 What recommendations would you make to the faculty for ways to improve students experiences in this program? A large final project in each class to relate to actual work. Provide more hands-on learning opportunities and more access to industry. Incorporate more use of professional software (AutoCAD, Carlson, scheduling, Quantity take-off, BIM). Recruit more students. Continue field trips to project sites as much as possible. Appendix C: University Learning Goals 42

43 Construction Management LEARNING GOALS ASSESSMENT ACTIVITY WHEN? RESULTS 1 ACTION PLANNED FOR IMPROVEMENT. WHEN? RESULTS 2 1. An understanding of basic structural design theory for structural steel, timber, reinforced concrete, and masonry. (PO#1) Type: _x_ Course Direct Other Direct _x_ Indirect Brief description: Course Direct: Measure student performance on graded assignments and exams. Indirect: Evaluate student responses to Evaluation questions and Senior Exit Survey Target: Course Direct: CMG 2120 and CMG 3250: Have 70% of the students score above 70% on the Exams, Homework, Design Project and the Final Exam. Indirect: Fall 2012 and Spring 2013 Date: December 2012 Course Direct: CMG 2120 (Spring 2013) Exam #1-50% > 70 Exam #2-50% > 70 Exam #3-75% > 70 Final - 25% > 70 Indirect: Q# Avg = 4.36 Optional Avg = 3.60 Date: April 2013 Course Direct: CMG 3250 (Fall 2012) Exam #1-53% > 70 Exam #2-67% > 70 Exam #3-73% > 70 HW/Proj. - 73% > 70 Indirect: Q#1-20 Avg = 4.42 Optional Avg = 4.06 The goal was not met. Student ratings were acceptable, but the performance level (especially on exams) needs to improve. (The results are improved from the year.) Continue to spend more lab time on topic review and problem solving. Spend more 3250 class time on discussion of the design project. Will be implemented in Date: Evaluations - 43

44 Student rating above 3.50 average for Q#1-20 and optional questions. Senior Exit Survey Weighted Avg = 3.13 Senior Exit Survey - Weighted average of relevant responses at least 2.80/4.00. University Goal: DISC. 2. An understanding of quantity takeoff and cost estimating procedures. (PO#6) Type: _x_ Course Direct Other Direct _x_ Indirect Brief description: Course Direct: Measure student performance on exams, graded homework, and estimating projects. Indirect: Evaluate student responses to Evaluation questions and Senior Exit Survey. Fall 2012 and Spring 2013 Date: December 2012 Course Direct: CMG 2265 (Spring 2013) Exam - 83% > 70% HW - 83% > 80% Project - 100% > 80% Indirect: Q# Avg = 4.53 Optional Avg = 4.42 The goals were met (except for the Senior Exit Survey). Continue to emphasize fundamentals on homework (in 2265) and to make the 3265 class projectoriented. Need to revise the Senior Exit Survey questions to identify the specific areas that need improvement Date: 44

45 Target: Course Direct: CMG 2265 and CMG 3265: Have 70% of the students score above 70% on the Exams; have 70% of the students score above 80% on the homework assignments and the estimating projects. Indirect: Evaluations student rating above 3.50 for Q#1-20 and optional questions. Senior Exit Survey weighted average of relevant responses at least 2.80/4.00. Date: April 2013 Course Direct: CMG 3265 (Fall 2012) Exam - 82% > 70% HW - 73% > 80% Projects - 67% > 80% Indirect: Q#1-20 Avg = 4.32 Optional Avg = 4.14 Senior Exit Survey: Weighted Avg. = 2.57 (Question #10 will be revised to match revised Program Outcomes per ACCE). To be implemented in University Goal: DISC 45

46 Appendix D: List of Continuous Improvement Actions for CMG Courses Table D.1: Recently completed and Planned Actions for Course Improvement Course Course Improvement Actions (Status) CMG 1000 Update the CAD software utilized for the lab portion of the course (from 2012 to 2014 version of AutoCAD and Revit). Change / update textbook used for the lab. CMG 1140 Incorporate ACI Concrete Testing Certification in the class and lab (was implemented in Spring 2012). CMG 2110 Incorporate construction plan reading Fall Include 2 field trips to see mechanical and electrical equipment. CMG 2120 Change to a better textbook, more focused on Statics and Strength of Materials with more variety and more example problems (was implemented in Spg 2012). CMG 2140 Incorporate construction plan reading Spring Include 5 field trips to different types of building construction. CMG 2265 Less focus on print reading (done in CMG1000) and more time spent on Quantity Take-off, including a Team Project (was implemented in Spring 2010). CMG 3200 Update the CAD software utilized for the lab portion of the course to Carlson Civil Suite Look into addressing a few additional topics and eliminating and/or scaling back on others that are currently on the course outline. CMG 3250 Need to spend more time on review of Statics and Strength of Materials (done in CMG 2120) (was implemented in Fall 2011). Need to reference and use the Code books (AISC, ACI, AFPA) in class (was implemented in Fall 2011). CMG 3265 Less time spent on Quantity Take-off review (increased in CMG 2265) and more focus on Team Projects incorporate 2 projects as part of the class (was implemented in Spring 2010). CMG 4000 CMG 4100 Incorporate individual presentations on a piece of construction equipment as part of the course grade (implemented in Fall 2008). CMG 4120 This class is being team taught with Civil Engineering. Groups are integrated for project related work. CMG 4200 This now a required CMG course, rather than a Technical Elective. This will ensure coverage of Construction Law in the curriculum. (implemented in Fall 2010). CMG 4210 Develop more project based labs for group assignments. CMG 4300 Put lectures on line and use classroom time for problems and discussion. CMG 4400 Drop the course textbook (Powerpoint slides cover the material). Incorporate a baseline measurement (i.e., set of questions and compare results at beginning vs. end of the semester). Continue to acquire instructional aids (safety equipment, safety videos,..etc.). 46

47 Although opportunities limited due to class size and location of Michigan Tech, promote / provide students additional opportunities to obtain safety training beyond this course (MIOSHA training, UPBA courses ) CMG 4800 CMG 4900 Continue recent revision to include two projects in this class (Commercial Building Bid and Design-Build) along with a major presentation (to area professionals, the CMG-IAB members, CMG faculty, and others). CMG 4999 Continue to provide a various course activities/events (webinars, videos, guest speakers, tours, ) related to professional development Incorporate BIM (Revit) into the course (assuming enrolled students lacking expertise in this area). Other Restrict the Business Electives to require at least one Business Management Elective. This will ensure coverage of principles of management in a Business course (implemented in Fall 2010). Replace the Free Elective with a Science Elective (geology). This will fulfill the ACCE requirement for the Math/Science credits (implemented in Fall 2010). 47

48 Appendix E: MTU Student Rating of Instruction Instrument Instructor Name: Course Number: Section Number: Day(s) Class Meets: Time Class Meets: INSTRUCTIONS: As you respond to the following items, remember that an effective teaching/learning environment is interactive and requires the cooperative efforts of the students and the instructor. For a course to foster student learning, students must have mastered the appropriate prerequisite knowledge and skills, purchase and read textbooks, complete course assignments, and actively contribute to the learning environment of the class. To be fair to your instructor, please consider these important factors as you complete this form. Strongly Disagree Disagree Neutral Agree USE A NO. 2 PENCIL ONLY Strongly Agree 1. I wanted to take this course. O O O O O 2. The pace of this course was consistent with my ability to learn the material. O O O O O 3. Class sessions were thought provoking. O O O O O 4. The organization of the course helped me to learn. O O O O O 5. The instructor s grading policies were fair. O O O O O 6. The instructor make students aware of his/her scheduled office hours. O O O O O 7. The instructor encouraged students to seek additional help outside of class. O O O O O 8. The instructor communicated the course material clearly. O O O O O 9. The instructor made students aware of the specific goals of the course. O O O O O 10. The instructor explained the importance of what we were learning. O O O O O 11. The instructor welcomed student questions in class. O O O O O 12. The instructor made connections between new material and material previously O O O O O covered in class. 13. The instructional resources (textbooks, handouts, etc.) furthered my learning. O O O O O 14. The instructor was enthusiastic about teaching the subject matter of the course. O O O O O 15. The instructor used class time effectively. O O O O O 16. The instructor provided timely feedback on my work (homework, assignments, O O O O O exams, etc.). 17. I am more interested in the subject now than I was before I took this class. O O O O O 18. The classroom and equipment (if applicable) were adequate to support effective O O O O O learning. 19. Given the opportunity, I would take another course from this instructor. O O O O O 20. Taking everything into account, I consider this instructor to be an excellent O O O O O teacher. 21. Optional Question I O O O O O 22. Optional Question II O O O O O 23. Optional Question III O O O O O 24. Optional Question IV O O O O O 25. Optional Question V O O O O O 26. Optional Question VI O O O O O 27. Optional Question VII O O O O O 28. Optional Question VIII O O O O O 29. Optional Question IX O O O O O 30. Optional Question X O O O O O 48

49 PLEASE COMPLETE OTHER SIDE COMMENTS TO YOUR INSTRUCTOR Your written comments will be forwarded directly to your instructor after the final grades have been submitted for this course. Please use this opportunity to assist your instructor in improving this class by providing constructive, helpful comments. 1. As I, the instructor, prepare to teach this class again, what aspect(s) of this course (teaching methods, assignments, areas of emphasis, etc.) should I preserve that effectively furthered your learning? 2. What aspect(s) of this course should I change to improve student learning? Specifically, what would you suggest? 3. Optional Question: 49

50 Appendix F: Preliminary Course/Instructor Evaluation Instrument (administer during the 4 th or 5 th week) Preliminary Course/Instructor Evaluation Course Number: Course Name: Instructor: Date: Please respond to the two questions listed below. Your brief, specific responses will provide important feedback to help me continuously improve this course. 1. What about this course, or my teaching, is helping you to learn? What could I change about this course, or my teaching, that would improve your learning? 50