Summaries of Assessment Activities and Results For Degree Programs B.B.A.; M.B.A. Academic Year

Transcription

1 B.B.A. Degree Program Summaries Summaries of Activities and Results For Degree Programs B.B.A.; M.B.A. Academic Year Learning Goal 1: Professional Proficiency Graduates have the knowledge and communication skills to succeed in the business profession. Objective 1: Students demonstrate that they are knowledgeable about current business theory, concepts, methodology, terminology and practices. Semester Reviewed: Fall 2010, Spring 2011 Strategic Management (MANA 4395) Number of Students Reviewed: 214 Tool: Major Field Test Exam 50% of students score above the national median on the overall MFT Score Analysis 52% of students met the criterion. Areas of concern are Economics (49%), Quantitative Analysis (47%) and Finance (49%). Accounting: Adopt a new textbook with an enhanced online homework manager which will increase the rigor of Principles of Financial Accounting (ACCT 2301). Incorporate a hybrid-model Principles of Managerial Accounting (ACCT 2302) course using video-enhanced modules beginning in the fall of Finance: Adopt a common syllabus with common learning objectives. Adopt a common textbook to facilitate implementation of common learning objectives. Marketing: Adopt a standardized textbook in all Principles of Marketing (MARK 3311) courses. Require students to complete a written marketing plan in all Principles of Marketing (MARK 3311) courses. Quantitative Analysis: Change Operations Management (MANA 3305) to increase focus on quantitative techniques. Other: Review MFT topics to be sure appropriate material is covered in MANA Move MFT Test date to later in the semester in Strategic Management (MANA 4395). THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 1

2 Accounting faculty has adopted a new textbook beginning in the fall of Hybrid course in Managerial Accounting is being piloted in the fall of Finance syllabus and textbook were adopted for spring of Changes to Operations Management and Strategic Management will take place in the spring of Marketing faculty adopted a standardized textbook in all Principles of Marketing (MARK 3311) courses starting Fall Marketing faculty also required students to complete a written marketing plan in all Principles of Marketing (MARK 3311) courses starting Fall Objective 2: Students can prepare a business document that is focused, well-organized, and mechanically correct. Semester Reviewed: Fall 2010, Spring 2011 Business Writing and Oral Presentations (MANA 3370) Number of Students Reviewed: 92 Tool: Written Assignment 70% of students meet or exceed expectations Analysis 86% of students met or exceeded the expectation of clear, original and focused writing to demonstrate knowledge of the subject. 92% structured sentences to communicate ideas clearly. 89% used appropriate tone and style to keep readers interested. 70% followed normal conventions of spelling and grammar with few mistakes. A confirmatory factor analysis indicated that our rubric appropriately measured the construct. The analysis was based upon a single faculty member s assessment; going forward a panel will be used to get more input into appropriate remediation. A cross-disciplinary faculty panel comprising four faculty members was created to review writing skills in MANA 3370 and TECH 4372 in the fall of THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 2

3 Objective 3: Students create a compendium of evidence (skills and behaviors) to market themselves as professionals. Semester Reviewed: Spring 2011 How to Get a Job (MANA 3170) Number of Students Reviewed: 138 Tool: Resume & Mock Interview 100% of students meet or exceed expectations Analysis 100% of students met or exceeded all expectations of preparing a resume. At least 95% dressed appropriately, used vocal variety, maintained eye contact, controlled body movement, allowed few vocal pauses and listened attentively. At least 82% communicated unique value, answered questions clearly and asked appropriate closing questions. Results of a confirmatory factor analysis indicated that this measure did not contribute to the measurement of the professional proficiency construct. This assessment will be eliminated from future analysis. Objective 4: Students are able to deliver a presentation that is focused, well-organized, and includes appropriate verbal and non-verbal behaviors. Semester Reviewed: Fall 2010, Spring 2011 Business Writing and Oral Presentations (MANA 3370) Number of Students Reviewed: 106 Tool: Oral Presentation 70% of students meet or exceed expectations Analysis At least 92% of students met or exceeded all expectations of the oral presentation rubric. Instructor should be provided with the results of the assessment and encouraged to focus on improving student ability in weaker areas (introduction, conclusion and appropriate use of fillers). Instructor focused on weak areas during spring of THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 3

4 Learning Goal 2: Technological Competence Graduates use the information sources and tools associated with their chosen profession. Objective 1: Students demonstrate an understanding of information systems and their role in business enterprises. Semester Reviewed: Fall 2010, Spring 2011 Strategic Management (MANA 4395) Number of Students Reviewed: 214 Tool: Major Field Test Exam 50% of students score above the national median of Section VIII (Info Systems) of the MFT Exam Analysis 65% of students scored above the national median in section VIII (Information Systems) of the MFT Exam. The criterion should be increased from 50% to 70% since our students consistently exceed the current expectation. Beginning in the fall of 2011, our college will strive for 70% of students to exceed the national mean score of Section VIII (Info Systems) of the MFT Exam. Objective 2: Students are able to use business software, data sources, and tools. Semester Reviewed: Fall 2010 Intro to Computer Applications (TECH 2323) Number of Students Reviewed: 28 Tool: Oral Presentation 70% of students meet or exceed expectations Analysis At least 96% of students met or exceeded expectations in all presentation criteria. Recommend that a less structured, more complex, assessment is used in an upper level course. The revised assessment was implemented in TECH 2323 during Spring THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 4

5 Learning Goal 3: Global Awareness Graduates incorporate global considerations in business activities. Objective 1: Students demonstrate awareness of global issues and perspectives. Semester Reviewed: Fall 2010, Spring 2011 Managing People in Organizations (MANA 3311) Number of Students Reviewed: 151 Tool: Global Awareness Profile Students score above the global average in all categories Analysis Students scored below the global average in 12 of 14 categories. Sections in which they scored above the global average were Global context and region. Increase global content across the college curriculum. College of Business and Technology has purchased a subscription for every student to Bloomberg Businessweek. The faculty voted unanimously that the following courses will require readings that incorporate global contexts: Principles of Finance (FINA 3311), Managing People in Organizations (MANA 3311), Principles of Marketing (MARK 3311), Cost Accounting (ACCT 3311), International Finance (FINA 4350), International Management (4310), International Marketing (4360) and Strategic Management (4395). Faculty employed quizzes, in-class discussions, article summaries, blogs, discussion boards and other means of incorporating global/international content. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 5

6 Objective 2: Students are knowledgeable of global issues and perspectives that may impact business activities. Semester Reviewed: Spring 2011, Summer 2011 Human Resource Management (MANA 3320) Number of Students Reviewed: 77 Tool: Case Analysis 70% of students meet or exceed expectations Analysis Students met or exceeded expectations in demonstrating an understanding of the assignment s purpose (84%) and defining the issue at hand (82%). Students did not meet expectations in evaluating relevant points of view (69%), gathering sufficient, credible and relevant information (43%), identifying, explaining and using key concepts (44%), making valid assumptions (52%), following evidence to logical conclusions (55%) and identifying significant implications or consequences (51%). Increase global content across the college curriculum and modify the assessment tool in future semesters. See Businessweek initiative above under Objective One. The assessment tool will become MFT Section IX (International) beginning Fall THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 6

7 Learning Goal 4: Social Responsibility Graduates evaluate the social consequences of alternative outcomes when making business decisions. Objective 1: Students demonstrate good citizenship as leaders and participants of peer teams. Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Introduction to Marketing (MARK 3311) Number of Students Reviewed: 234 Tool: Peer Review 70% of students meet or exceed expectations Analysis At least 98% of students met or exceeded expectations in all criteria. The Committee is not satisfied that peer assessment of participation in course-based teams is a good measure of learning about social responsibility. The Committee will recommend to the faculty that the goal be revised to reflect the attributes graduates should possess, and the learning objective rewritten to ensure that the activities measured are appropriate. The Strategic Management faculty should develop a Corporate Social Responsibility module and assessment for inclusion in the Strategic Management (MANA 4395) beginning in the spring of The CSR module was embedded in Strategic Management (MANA 4395) in spring A random block multiple choice test was created and embedded in BlackBoard for administration by strategic management faculty. The module was created to be suitable for adaption by other programs (e.g. HRD, MBA, MSHRD). THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 7

8 Learning Goal 5: Ethical Courage Graduates understand ethical considerations and their impacts. Objective 1: Students understand legal and ethical concepts. Semester Reviewed: Fall 2010, Spring 2011 Strategic Management (MANA 4395) Number of Students Reviewed: 214 Tool: Major Field Test 50% of students score above the national median of Section VII (Law) of the MFT Exam Analysis 52% of students exceeded the national median score of Section VII (Law). Accounting faculty will consider making BLAW 4340 an Accounting degree plan requirement. In other disciplines, students will be encouraged to include business ethics in their degree plans. There are no plans to require the course at this time for other majors. BLAW 4340 will be a required course for all Accounting majors beginning Spring To facilitate both Accounting and other major students taking this course as an elective, the course was offered during evening hours and enrollment limits were increased. Objective 2: Students make ethical decisions. Semester Reviewed: Fall 2010, Spring 2011 Business and Professional Ethics (BLAW 4340) Number of Students Reviewed: 63 Tool: Course Embedded 80% of students make the best ethical decision on the second of two case analyses Analysis 87% of students made the best decisions on the second of two case analyses. Because BLAW 4340 is not a required class for BBA students, the distribution is heavily skewed toward accounting majors, who take this course to qualify for the CPA exam. The ethics game should be embedded in several other courses to ensure that we have good program representation. Accounting faculty will consider making Business Ethics (BLAW 4340) an Accounting degree plan requirement. The ethics game was embedded in TECH 4310 effective fall BLAW 4340 is now a required course for all Accounting majors beginning in Fall THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 8

9 THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 9

10 M.B.A. Degree Program Summaries Learning Goal 1: Professional Proficiency Graduates are leadership ready and have an understanding of the business discipline that is both broad and deep. Objective 1: Students demonstrate both breadth and depth in their comprehension of current business theory, concepts, methodology, terminology, and practices. Semester Reviewed: Spring 2011 Formulating and Implementing Strategy (MANA 5395) Number of Students Reviewed: 50 Tool: Major Field Test Exam 50% of students score above MBA MFT exam national mean Analysis 72% of students scored above the overall MFT MBA exam national mean. Criterion was met in all five sections individually: Marketing (66%), Management (70%), Finance (62%), Accounting (66%) and Strategic Integration (68%). Criterion will be raised from 50% to 70% at the meeting on 10/11/2011. Content area criterion was raised. Objective 2: Students analyze and critique their personal change leadership styles. Semester Reviewed: Spring 2011, Summer 2011 Strategic Human Resources Management (MANA 5350) Number of Students Reviewed: 108 Tool: Self- Survey Results form a normal distribution Analysis 20% of students self-identified as change leaders. 37% of students self-identified as change agents. 29% of students self-identified as average change managers. 14% of students self-identified as average managers. Expand the assessment by having students acquire external assessor to complement their self-assessment. The committee will determine criteria for an outside party. The next assessment in the spring of 2012 will include responses both from students and their elected outside individual. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 10

11 Learning Goal 2: Technological Competence Graduates possess the technical, research, and quantitative skills to solve business problems. Objective 1: Students comprehend tools such as decision models, statistical analyses, forecasting, and supply chain logistics. Semester Reviewed: Number of Students Reviewed: Tool: Analysis Outcome not yet assessed. scheduled for fall of Objective 2: Students apply these tools and research skills effectively when resolving business decision problems. Semester Reviewed: Number of Students Reviewed: Tool: Analysis Outcome not yet assessed. scheduled for fall of THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 11

12 Learning Goal 3: Global Awareness Graduates think critically and can analyze business decisions with awareness of global considerations that may impact decisions. Objective 1: Students demonstrate awareness of global issues and perspectives. Semester Reviewed: Spring 2011 Strategic Human Resource Management (MANA 5350) Number of Students Reviewed: 73 Tool: Global Awareness Profile Students exceed the global average in all categories Analysis Students scored above the global average in all 14 of 14 categories. Although students met the criterion, the CBT faculty decided to increase global content across the college curriculum. College of Business and Technology has purchased a subscription for every student to Bloomberg Businessweek. The faculty voted unanimously that the following courses will require readings that incorporate global contexts: Accounting for Management Control (ACCT 5320), Advanced Financial Management (FINA 5320), Leading and Managing People (MANA 5320), Advanced Marketing Fundamentals (MARK 5320) and Formulating and Implementing Strategy (MANA 5395). Faculty employed quizzes, inclass discussions, article summaries, blogs, discussion boards and other means of incorporating global/international content. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 12

13 Objective 2: Students can assess and critique alternative sets of actions in a global context. Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Leading and Managing People (MANA 5320) Number of Students Reviewed: 87 Tool: Case Study Analysis 70% of students meet or exceed expectations Analysis Students failed to meet expectations in six out of eight areas. o 92% of students met or exceeded expectations in demonstrating an understanding of the assignment s purpose. o 78% of students met or exceeded expectations in defining the issue. o 69% of students evaluated relevant points of view. o 52% of students gathered sufficient, credible and relevant information. o 59% of students accurately explained and used key concepts and made valid assumptions. o 62% of students followed evidence to logical conclusions. o 56% of students identified significant implications or consequences. Increase global content across the CBT curriculum. In their search to fill two vacant positions, the management faculty will attempt to hire someone with global/international experience. See Businessweek initiative above under Objective One. Search was completed during fall of Two international faculty were hired, one in Human Resource Management and one in Operations Management. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 13

14 Learning Goal 4: Social Responsibility Graduates have a fully-developed philosophy of social responsibility and are prepared to be good citizens. Objective 1: Students demonstrate knowledge of and can apply various Corporate Social Responsibility concepts. Semester Reviewed: Fall 2010, Spring 2011, Summer 2011 Strategic Human Resources Management (MANA 5350) Number of Students Reviewed: 88 Tool: Course Embedded Students answer at least 80% of questions correctly in each subject area Analysis Students answered 74% of questions regarding the Pyramid Scheme correctly. Students answered 59% of questions regarding the Case against Corporate Social Responsibility correctly. Students answered 82% of questions regarding Wikipedia correctly. Students answered 57% of questions regarding Rethinking the Social Responsibility of Business correctly. Students answered 76% of questions regarding Formulating and Implementing Strategy correctly. Students answered 91% of questions regarding the Socially Responsible Business Quiz correctly. The Strategy and Policy faculty should develop a Corporate Social Responsibility module and assessment for inclusion in a graduate level course beginning in the spring of The CSR module was used in Strategic Human Resource Management (MANA 5350) in the spring of A random block multiple choice test was created and embedded in BlackBoard for administration by Strategy and Policy faculty. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 14

15 Objective 2: Students demonstrate good citizenship by engaging in a service activity. Semester Reviewed: Academic Year N/A Number of Students Reviewed: 16 Tool: Survey 100% of students participated in Community Service during their master s study Analysis 75% of students participated in Community Service during their master s study. Because this is the first year of measurement and catalog changes to implement this Learning Objective are not yet in print, we will strive to increase student awareness and participation through verbal and web-enhanced communications. Efforts will commence immediately beginning in the fall of Catalog copy outlining this requirement was included in the catalog. THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 15

16 Learning Goal 5: Ethical Courage Graduates make ethical decisions. Objective 1: Students analyze and critique ethical behavior. Semester Reviewed: Spring 2011 Accounting for Management Control (ACCT 5320) Number of Students Reviewed: 50 Tool: Case Analysis 70% of students meet or exceed expectations Analysis 100% of students met or exceeded expectations in clearly stating the ethical dilemma, identifying the stakeholders involved, and using adequate reasoning to defend their position. 86% of students evaluated the ethical issues from multiple perspectives. 90% of students identified the ramifications of various solutions. 74% of students used proper spelling and grammar. Case used for measurement was deficient. Suggest instructor find a new case for analysis. A new case and rubric will be used beginning in the fall of Objective 2: Students compare ethical codes and make ethical decisions. Semester Reviewed: Spring 2011 Accounting for Management Control (ACCT 5320) Number of Students Reviewed: 50 Tool: Case Analysis 70% of students meet or exceed expectations Analysis 100% of students met or exceeded expectations in clearly stating the ethical dilemma, identifying the stakeholders involved, and using adequate reasoning to defend their position. 86% of students evaluated the ethical issues from multiple perspectives. 90% of students identified the ramifications of various solutions. 74% of students used proper spelling and grammar. Case used for measurement was deficient. Suggest instructor find a new case for analysis. A new case and rubric will be used beginning in the fall of THE UNIVERSITY OF TEXAS AT TYLER College of Business & Technology 16