10/17/2014 3:42 PM. BBA Management Information Systems FY14. Closing the Loop: Previous FY Assessment Summary

Transcription

1 BBA Management Information Systems FY14 Closing the Loop: Previous FY Assessment Summary Annual Assessment Summary Providing Department: BBA Management Information Systems Responsible Roles: In the text box below, please complete your annual assessment summary in which you close the loop on each outcome from the previous years' SMART. Please see the information tab ("i") for additional details. For last year s assessment report we reported all the findings for our different outcomes. This is the first year we are going to create a report that is forward thinking. This year we had five program goals assessed by 20 different outcomes. Of which we assessed 13 of the outcomes this year. During assessment training we recognized that we were over assessing and it was recommended that we go to three program goals and assessed by 6 outcomes. Furthermore, upon review of the assessment we evaluated the current curriculum and completed a major revision of the overall program. In doing so, we hope to make our students more competitive in the marketplace and increase their marketable skills by staying current in the field of computing. Here are the findings and recommendations from the FY2013 report which we worked on this year. 1. Modified exam questions to better reflect assessment requirements (CBIS 3218) 2. Shortened hands on exam to fit better into allotted time (CBIS 3217) 3. Added content on Web Accessibility (CBIS 3218) 4. Added content on Web Design principles (CBIS 3219) 5. Adopted nationally standardized test for assessment (CBIS 3213, CBIS 4225) Although we implemented the recommendations from the FY2013 report, we did not assess the same courses this year due to the number of outcomes we have to assess for outcomes 1-4. However, we did assess the last outcome #5. However the instructor did not implement the new standardized testing, instead he assessed the students on a final project. The instructor did not remember the recommendation, but will now move forward with the standardized testing for the assessment of the CBIS 3213 course. The CBIS 4225 will no longer be required and will not be assessed anymore. All of the courses #1-4 are no longer going to be assessed, and have been removed from the MIS program. Here is a list of the program goals and course outcomes assessed this year. Page 1 of 21

2 FY BBA MIS Mission 1 MIS students will be able to determine requirements and design an information system design information systems using information modeling techniques design, develop, debug, and implement a functional Web-based application. 2 MIS students will be able to design and create a well-designed, validated web site integrate scripting languages and multimedia into a website. 3 MIS students will be able to design, manipulate, use, and manage databases design and implement a logical database by using data modeling techniques and CASE tools use structured query language to retrieve information from the database create an application that connects to and stores information into a database setup and manage a database. 4 MIS students will be able to design, code, debug, and use business applications demonstrate the fundamentals of decision structures demonstrate the fundamentals of iteration structures design and build business applications. 5 MIS students will be able to design, implement, and maintain information technology infrastructure demonstrate a working knowledge of networking media and hardware demonstrate a working knowledge of network topologies and protocols manage users and files on a server. Here is the new list of program goals and course outcomes that will be assessed next year FY15. FY15 1 MIS students will be able to determine requirements a business information system analyze business processes and procedures and develop solutions using modeling techniques. 2 MIS students will be able to design and create a well-designed, database driven web site design, develop, debug, and implement a functional, Web-based application using scripting languages and multimedia use structured query language to retrieve, edit and store information to a database demonstrate the fundamentals of programming structures. 3 MIS students will be able to design, implement, and maintain information technology infrastructure demonstrate a working knowledge of networking media, protocols and hardware. Page 2 of 21

3 New Sources Field No items to display. Page 3 of 21

4 Program Missions BBA MIS Mission To develop in-depth hands-on knowledge and skills in the application of information technology to problems and opportunities in business and society. Responsible Roles: Page 4 of 21

5 Program Goals 1: MIS students will be able to determine requirements and design an information system. Responsible Roles: Program Coordinator (Marshall, Bryan) Course(s) or Other Activities Addressing the Goal CBIS Introduction to Programming CBIS Advanced Programming CBIS Business Analysis CBIS Deployment 2: MIS students will be able to design and create a well-designed, validated web site. Responsible Roles: Course(s) or Other Activities Addressing the Goal CBIS Web Development CBIS Advanced Programming 3: MIS students will be able to design, manipulate, use, and manage databases. Responsible Roles: Course(s) or Other Activities Addressing the Goal CBIS Database Management CBIS Advanced Programming CBIS Deployment CBIS System Administration 4: MIS students will be able to design, code, debug, and use business applications. Responsible Roles: Course(s) or Other Activities Addressing the Goal CBIS Introduction to Programming CBIS Database Management Page 5 of 21

6 CBIS Advanced Programming CBIS Deployment 5: MIS students will be able to design, implement, and maintain information technology infrastructure. Responsible Roles: Course(s) or Other Activities Addressing the Goal CBIS Introduction to Networking CBIS System Administration Page 6 of 21

7 Student Learning Outcomes : design an application using the Program Development Life Cycle (PDLC). Is this outcome assessed this year?: No FY : design, develop, debug, and implement a functional desktop-based application Is this outcome assessed this year?: No FY : design information systems using information modeling techniques. Completed Page 7 of 21

8 Students will complete a series of 12 assignments designing information systems and using information modeling including: Data Flow Diagrams, Entity Relationship Diagrams, Data Normalization, and Web Usability User Interface Design. Students should have an average score on the assignments exceeding 80 % to meet the standard, and each assignment should have an average score of 80% or more to meet the expectations. 24 out of 26 students or 92.3 % had above an 80 % average on all these assignments for the term. Two students did not meet the standard for 7.7 %. Each assignment also had an 80% or above average score. Yes Results show that students in the CBIS 4212 class when individually assigned to perform information systems design techniques perform at an above average level. Each type of design technique was also shown to be completed at an above average level. Students in this senior level course have been able to apply their previous knowledge of information systems concepts to the design of information systems, which they are doing for the first time in this course, at an above average level. Although the students are meeting, or actually exceeding the expectations for this outcome, instructors of the course need to make sure that the few (in this case 2 out of 26) who do not meet the expectation are getting help from their classmates on the team project that also measures this outcome. The team projects all exceeded the 80% threshold; thus, the students who did not meet this specific measurement did exceed another team based measure. Faculty in the course and program need to ensure they work as much as possible with the bottom of the curve students to make sure they stay with the class. In this course the bottom was just below the 80 percent threshold and therefore it actually exceeded expectations : use the various system design tools and techniques; including traditional, agile, and object-oriented development techniques. 80% of the students will meet expectations : design, develop, debug, and implement a functional Web-based application. Page 8 of 21

9 Final project 80% of the students will meet expectations. 80% is appropriate because not all majors are programmers and 80% is a good competency level. 1&3& : design and implement a logical database by using data modeling techniques and CASE tools. Completed FY2014 Students will be assessed through the design and creation of a database using Visio and SQL Server. 80% of students will meet expectations be able to design and implement a logical database by using data modeling techniques (ERD) and CASE tools (Visio). 90% of students were able to design and implement a database using Visio and MS SQL Serve. Zoom p Custom Links Page 9 of 21

10 Yes Students designed and created databases for an organization using Visio and SQL Server : create a basic valid web page. This course was assessed by Caroline Collier. Faculty (Collier, Caroline) Students will be asked to build a web site. 80% of students will meet expectations in creating a basic web page. Members of the faculty will evaluate the student s web design and implementation abilities using the scale Exceeds expectations, meets expectations, needs improvement Description Exceeds Meets NI 1. Creation of a basic web page. 26 (78.79%) 6 (18.18%) 1 (3.03%) Yes 96.97% of the CBIS 3219 students met or exceeded the expectations. The assessment was based on two exams at different stages of the semester. All students but one were able to create basic valid web pages. The only student who didn't at least meet the objective didn't work regularly and gave up on homework and the class early on in the semester. In the future, the instructor should identify these students early on and find out the reasons behind their failure to follow the class pace. If the failure is due to a lack of understanding instead of a lack of work, the instructor should help the students by providing additional explanation, examples, and practices outside of the classroom : apply the principles of good design to a website. Is this outcome assessed this year?: No Page 10 of 21

11 FY15 Students will build a website using the basic principles of good design : integrate scripting languages and multimedia into a website. Completed Student websites will be assessed for the proper use of scripting languages (like javascript) and multimedia. 80% of the students will meet expectations. Members of the faculty evaluated the student s web design and implementation abilities using the scale Exceeds expectations, meets expectations, needs improvement Description Exceeds Meets NI 4. Integrate scripting languages and multimedia into a website. 5 (16.13%) 21 (67.74%) 5 (16.13%%) Yes 83.87% of the CBIS 3219 students (MIS majors and minors) met of exceed the expectations.the learning outcome was met. The assessment was based on one student project. One of the project requirements is the integration of scripting languages. In general, students integrated multimedia in their projects and did it well. The Javascript integration was more problematic. The five students who needed improvement for this learning outcome didn't integrate any Javascript in their projects. Some of these students started the projects too late and rushed by the deadline, they decided to skip this part of the project that is seen as complex and time-consuming. In the future, the instructor will include a JavaScript question in one of the exams to get a more accurate assessment of this learning outcome. Additional practices will also be available for students who may struggle with the Javascript syntax and logic : design, develop, debug, and implement a functional Web-based application. Page 11 of 21

12 Is this outcome assessed this year?: No FY : design and implement a logical database by using data modeling techniques and CASE tools. Is this outcome assessed this year?: Students will be assessed through examination : normalize a database during the logical design phase. Is this outcome assessed this year?: No FY 2015 Students will be required to normalize a database. Page 12 of 21

13 : use structured query language to retrieve information from the database. Start: 7/1/2012 Completed FY2014 Students will be given questions in an exam that asks them to write SQL code. 80% of students will meet expectations in accessing the information queried from the database through the use of Structured Query language (SQL). 82% of students met this expectation of using SQL to retrieve information from a database. Yes Students demonstrated the ability to write SQL code to retrieve information from a database in a discussion style exam format. 82% of the students demonstrated accurate results on the exam. Students will continue to create databases and use SQL to query information from the database in both in-class activities and homework : use the structured query language to retrieve information from the database. Is this outcome assessed this year?: Students will be given questions in an exam that asks them to write SQL code. Page 13 of 21

14 : create an application that connects to and stores information into a database. Completed Database connection project: Students are asked to create three SQL server database tables and develop a Visual Basic application that connects to the database and allows the end user to add, update and delete records from the table. A rubric will be used to assess this outcome. 80% of students will be able to create an application that connects to the database and stores information into a database. This is an essential skill to this course and future courses. 89% of the students either met or exceeded expectation. Description Exceeds Meets NI 1. Connected to database 25 (89%) 0 (0%) 3 (11%) 2. Stored data to the database 25 (89%) 0 (0%) 3 (11%) - While it is good that 89% of the students either met or exceeded expectation and the goal was 80%, there is room for improvement. In the future, the instructor will mentor students to make sure that they complete the project. Three of the students did not complete the project at all due to illness and other issues. Of the ones who completed the project, 100% of learning outcomes were met : design and build a web application that connects to and stores information in a database. Completed Page 14 of 21

15 Final project that connects to a database and retrieves and stores data. 80% of students will successfully do this. 80% is a reasonable target because not all majors go into programming, but all majors should achieve this basic level of competency. 100% met expectations of being able to store data in the database from the web application. Yes All were able to put information into the database. 12% of the student were only able to meet this minimum requirement of storing data in the database while 24% did an exceptional job. Next year the entire functioning web application will be reviewed rather than just storing information in the database to get a better understanding of the big picture : setup and manage a database. Completed Students will install a database on their server. They will then create users and add specific databases for each user. Students will understand how to edit and delete users. 80% of the students will meet or exceed the expectations 77% of the students were able to sucessfully set up the database and add and edit users. No The average score for this assessment was 71%. 17 students completed this assessment without any problems. 3 students were able to do most of this assessment, and 6 students either did not attempt or felt the assessment was too difficult. This assessment is given weeks before graduation and is especially difficult. Students are required to figure out how to install, setup, and maintain a database with almost no help from the instructor. Students are given minimal resources and guidance on how to accomplish the tasks required. However, students are given a clear picture of what the final outcome should be. The purpose of this exercise is twofold. Obviously to get students to understand how databases are managed, but more importantly how to approach a complex business problem, come up with a solution and implement it. This assessment shows that most of our graduating students have some degree of business systems thinking, while others are still lacking the confidence and methods needed to find these types of solutions. I will focus more in the beginning of the course to help students get a better understanding of the methods needed for problem solving. Page 15 of 21

16 : understand and demonstrate the fundamentals of decision structures. Ongoing Students will be given a question on their final exam that pertains specifically to decision structures. 80% of students will correctly complete the code for a decision structure on the final exam question. 80% is an appropriate level because this is the first programming class and some students taking the course are not majors. As stated last year, a more challenging decision structure question was given on this year's final exam. It required students to use nested ifs or compound ifs % of students met or exceeded expectations on the exam question. Results 3212 fall 13 No Overall, the class was not as good in programming as last year's class. The grades for the course were much lower than last year. The question was more difficult: This is the question from last year- (15 pts) Part A Part B Qty: 1-5 Price =$2.00 Price =$2.25 Qty: more than 5 Price =$1.75 Price=$1.95 Write the code to calculate the correct price and put it in dblprice (no need to display it). Assume that the quantity is entered into a textbox called txtqty and the part type is a radio button for A or B on the input form. This is the question from this year - (10 pts) Monthly Sales Region Commission Rate% Bonus Rate% 0-34, A ,000-and up A , B ,000-up B Write the statements needed to calculate the total amount earned ((decsales*dec ComRate) + (decsales *decbonusrate)) for Page 16 of 21

17 a salesman. Assume the user has input the monthly sales amount and region into the user interface. The sales amount has already been parsed and stored in the variable decsales and the region has been stored in strregion. You will display the total amount earned in lbltotearned. The result of 37.04% needing improvement was not unexpected. The students remaining in the major will continue to work on decision structures in the CBIS 4210 class. This same question will be on the final next year to see what longitudinal results will be : understand and demonstrate the fundamentals of iteration structures. Ongoing Students will be given a question on their final exam that pertains specifically to iteration structures. 80% of students will meet expectations. 80% is a stretch because this is the first programming class, some students are not majors and this concept come relatively late in the semester so the students do not have much time to practice and absorb it. Only 48.14% of students met or exceeded expectations % of students need improvement. results 3212 fall 13 No This was a drop from last year. A different question was used on the exam this time so it is more difficult for the results to be compared directly. In general, this group of students were not as good with programming as last year's group. The overall class grades were much lower. This same assessment will be repeated next year. The students who remain as majors will continue to work on loops in CBIS : design databases that can be used to store information obtained from business applications. Is this outcome assessed this year?: No FY 2015 Page 17 of 21

18 : design and build business applications. Faculty evaluations of CBIS 4210 will be from the students performance on a project where they create an application for a business and connect to a SQL database. The students will create 3 tables and 3 forms in the business application. Completed Application development project: Students are instructed to create a database driven application for a business. The application has the following minimum requirements: 3 tables in SQL database, 3 forms, 1 function, 1 subprocedure, 1 structure. A rubric will be used to assess this outcome. 80% of the students will meet expectations. The means of assessing is a rubric and the desired standard of achievement constitutes a 'passing' or acceptable score on that rubric. Program faculty decide this by consensus. 89% of students either met or exceeded the goal. Description Exceeds Meets NI 1. Connected to database 25 (89%) 0 (0%) 3 (11%) 2. 3 tables 25 (89%) 0 (0%) 3 (11%) 3. 3 forms 21 (75%) 4 (14%) 3 (11%) Yes This exceeded the goal of 80%. - While it is good that 89% of the students either met or exceeded expectation goal and the goal was 80% there is always room for improvement. In the future, the instructor will mentor students to make sure that they complete the project. Three of the students did not complete the project at all due to illness and other issues. More time needs to be spent on the project plans before they create the project. The instructor could add project plan deadline to the schedule to ensure that the projects are on track : design and build a web application. Page 18 of 21

19 Is this outcome assessed this year?: No FY &2: demonstrate a working knowledge of networking media and hardware. Completed Students will complete a final project that is comprised of designing the IT infrastructure for a business. Students will need to make choices on the types of network media and hardware used to design and implement the network. A rubric will be used to assess the quality of LAN diagram, WAN diagram, explanation of technology, selection of hardware, and implementation final project rubric 80% of the students will meet or exceed the expectations 100% of the students met or exceeded the expectations of technical explanation, hardware selection and method of implementation. 94% of the students met or exceeded the expectations of the WAN diagram. 77% of the students met or exceeded the expectations of the LAN diagram rubric results Partially The majority of the students understood what a network is and the hardware required to set up a network. They also were able to explain the steps required in implementing the network. When the students were asked to diagram the network both at the LAN and WAN level, several students did not include this in their final project. Page 19 of 21

20 To better improve these scores, I will cover diagramming in more detail in FY15. I will also emphasize the importance of having these diagrams in their final report : manage users and files on a server. Students will be able to add, edit and delete users and files on a server. They will also understand how the permission structure works. Is this outcome assessed this year?: Students will complete a hands on exam that covers the adding, editing and deleting of users, files and folders. Students will also be required to set the permissions limiting the access of users to the files and folders : manage services on a network operating system. Students will be able to manage the different services found on a network operating system. Is this outcome assessed this year?: No FY 2015 Students will be given a hands on exam to assess if they can configure the server to run different services like web, mail and database. Page 20 of 21

21 Page 21 of 21