AITS FY15 Metrics Report 7/1/215 University of Illinois Administrative Information Technology Services
AITS FY15 Metrics Overview AITS provides a wide range of administrative information technology solutions and services to 78, students and 23, employees across the university community that are accessible, reliable, accurate, efficient, and responsive to customer needs. Administrative IT systems at the university are utilized in areas such as student services, finance, human resources, facilities, advancement, and research administration to support the mission activities of the enterprise, create efficiencies in business processes through automation, and to provide business intelligence services to help with data analysis and inform decision making. A full overview of the AITS unit and its operations is available in the AITS FY15 Annual Report posted on the AITS web site at http://www.aits.uillinois.edu/ This collection of metrics is designed to supplement and support the AITS strategic plan and progress report. The metrics were collected and compiled by the individual groups within AITS as a means for measuring progress and efficiency. Organizations within AITS have been collecting metrics for several years. This document consolidates these metrics and also identifies new items to measure. AITS, and its customers throughout the University of Illinois, will review these measurements. This report is intended to: Provide a transparent overview of AITS operations and performance. Set performance goals and operational expectations for the next year. Determine if the metrics provided in the report are still relevant and if any are missing, then implement processes for collecting the information that was not available for this report. Refine views of the data to increase the utility of the information and make interpretation easier. The measurements that are presented individually in this report can be combined or refined for use in presentations, discussions, and other reports to assist the AITS customers. These metrics have been organized into the following categories: Reliability Customer Service Projects Services Offered Infrastructure FY15 AITS METRICS 1
Table of Contents Reliability... 3 Availability (Banner and related)... 3 Banner Self Service Usage... 4 DS Outages (EDDIE and EDW)... 5 Customer Service... 5 Security Requests... 5 Service Requests... 6 Late Rollouts... 6 Service Desk Manager (SDM) Tickets... 7 Projects... 8 Project Type and Hours... 8 PMO Performance... 1 Services Offered (Systems)... 11 Departmental System Support... 11 Messaging... 12 Message Availability... 12 EDDIE Sessions... 13 Business Intelligence/Data Warehouse (BI/DW) Support Cases Opened by Request Area... 14 BI/DW Training... 15 DS Work Requests by Month and Type... 16 Infrastructure... 17 Object Use and Availability... 17 DBs and Servers... 18 Equipment Age... 18 Computer Support... 19 Data Center Backup Storage and Capacity... 2 Change Request CI Selections... 21 Change Orders by Change Category... 22 Successful Change Orders by Type... 23 Unsuccessful Change Orders by Type... 23 Total CRs Submitted... 24 Weekend Rollouts... 24 New and Decommissioned CIs and Servers... 25 FY15 AITS METRICS 2
Reliability Availability (Banner and related) Description: Banner is used by students, faculty, and staff to register for classes, pay tuition, apply for admissions, grade students, pay employees, make needed departmental purchases related to learning, and generate transcripts. As such, it is truly a 24x7 critical system that people depend on to be available. This availability measurement includes Banner Self Service and the systems and services upon which it depends, such as: apps.uillinois.edu site, EAS, brokers, Banner database, the network, the campus backbone, and application servers. Total availability for FY 15 was 98.86%. Planned downtime was less than 1 hours, accounting for 6 financial aid upgrades, 3 Banner upgrades, 1 finance end of year processing window, 3 Unix/Linux maintenance windows, and one storage and network upgrade. Availability excluding planned outages was 99.98%, meaning that unplanned unavailability of these systems was less than 2 hours this year. This downtime is a result of an afternoon EAS outage in July 214 due to Apache server issues and subsequent restarts. Banner Self Service availability by fiscal year excluding planned outages 1.% 9.% 8.% 7.% 6.% 5.% 4.% 3.% 2.% 1.%.% 99.7% 99.81% 99.94% 99.99% 99.98% FY15 AITS METRICS 3
Banner Self Service Usage Description: Banner Self Service is used by students to register for classes, request transcripts, pay tuition, and apply for admission. It is also used by faculty to grade students, view class rosters, etc. As such we want to monitor usage of these services and manage performance and capacity to ensure the system is available 24x7. Banner Self Service usage shows the number of sessions per month or year for the Banner Self Service web site. A 'Session' is defined as a series of clicks on the site by an individual visitor during a specific period of time. A Session is initiated when the visitor arrives at the site, and it ends when the browser is closed or there is a period of inactivity. This measurement, used in conjunction with the Availability metric above, provides customers with idea of the vast number of sessions initiated each month/year and how important high availability is. The drop seen from FY13 to FY14 is due in large part to the fact that UIUC Admissions is no longer using Banner Self Service. 9,4, 9,2, 9,, 8,8, 8,6, 8,4, 8,2, 8,, 7,8, Banner Self Service usage by fiscal year 9,23,847 8,746,65 8,469,413 8,523,626 8,336,26 FY15 AITS METRICS 4
DS Outages (EDDIE and EDW) Description: These metrics show the number of scheduled, unscheduled, and partial outages by month where the EDDIE and EDW environments were unavailable to customers. The Enterprise Data Delivery Information Environment (EDDIE) system is a Business Objects environment for delivery of query, analysis, and reporting. The Enterprise Data Warehouse (EDW) is a non-volatile data store containing historical, detailed data that spans a number of subject areas. This data store is fed by transactional data on a regular basis from a variety of data sources. In the eyes of the end-user, the EDW is a read-only environment. Scheduled Outages EDDIE Unschedul ed Outages Partial Outages Scheduled Outages Month July-14 August-14 3 1 September-14 1 1 October-14 1 November-14 1 December-14 1 January-15 2 1 February-15 1 1 March-15 1 2 April-15 2 2 2 May-15 2 June-15 1 2 2 EDW Unscheduled Outages Partial Outages Customer Service Security Requests Description: Security provisions access that allows users to access certain applications, services, and systems. This measure provides a count of security requests received via the AITS Security Request Application (SECAPP) as well as service desk tickets submitted. This measure is important as it indicates service desk activity levels and where AITS Security Administration staffing resource time is actually spent. FY15 AITS METRICS 5
9, 8, 7, 6, 5, 4, 3, 2, 1, Security Requests by FY 52,965 5,788 26,695 38,274 25,31 4,33 29,337 24,872 31,663 12,813 SECAPP Requests Service Desk Tickets Service Desk Requests Description: This measurement shows the total number of cases (requests and incidents) closed by year. This is helpful in understanding the volume of requests we are able to handle and to see the variation from year to year. 5, 45, 4, 35, 3, 25, 2, 15, 1, 5, Total # of cases closed by AITS (requests and incidents) 46,423 45,394 42,938 43,256 38,296 Late Rollouts Description: This metric provides an indication of how frequently outages are extended beyond the advertised outage window. This metric is useful in understanding how we are doing at completing our rollouts on time. FY15 AITS METRICS 6
% of late rollouts by fiscal year 1% 9% 8% 7% 13 6% 15 28 5% 36 27 4% 3% 2% 12 1% 5 4 8 6 % Count of on-time rollouts 28 15 13 36 27 Count of late rollouts 4 5 12 8 6 Service Desk Manager (SDM) Tickets Description: The AITS Service Desk provides 24x7 tier 1 support for students, faculty, and staff by trouble shooting issues and fielding questions and inquiries. This metric is important as it provides an idea of service desk activity levels. A total of 52,965 tickets were created in SDM in FY15. 22,286 of these tickets were initiated in SDM by the AITS Service Desk and 19,347 of the tickets were closed with the AITS Service Desk listed as the responsible group. The following chart shows the total number of problems reported in SDM by fiscal year. Problems Reported in SDM by FY 6, 5, 4, 3, 2, 1, 54,64 5,396 52,965 39,918 43,854 FY15 AITS METRICS 7
Projects Project Type and Hours Description: These measures provide summaries of the annual number of ITPC and AITS Internal projects closed by functional area and by type as well as the annual work effort (hours) for those ITPC and AITS Internal projects by functional area and project type. This is important for showing what areas and types of projects are consuming the majority of project hours each year. AITS hours by project by functional area 35, 3, 25, 2, 15, 1, 5, - BIPM Finance HR Student Tech Other Internal FY11 7,87 17,48 11,16 16,843 9,659 FY12 18 9,257 9,745 8,612 16,768 1,734 FY13 3,562 8,25 11,919 4,425 25,776 413 7,562 FY14 8,998 8,424 1,951 3,539 3,341 11,345 7,272 FY15 7,936 9,651 7,811 6,239 29,485 12,96 5,882 5, 45, 4, 35, 3, 25, 2, 15, 1, 5, - Analysis Application Development /New Application AITS hours by project by type Enhancement /Application Change Integration and Interfaces Maintenance /Upgrades Report / BI Other FY11 2,587 13,552 1,598 337 276 6,25 1,632 FY12 5,899 21,271 4,66 1,19 19,72 3,63 575 FY13 6,411 28,99 1,354 1,95 17,499 5,842 799 FY14 2,449 42,669 2,264 63 21,417 1,892 574 FY15 2,2 44,276 7,832 2,523 5,171 87 FY15 AITS METRICS 8
6 5 4 3 2 1 - Projects closed by FY by functional area BIPM Finance HR Student Tech Other Internal Total FY11 12 3 1 12 14 51 FY12 11 6 2 7 5 31 FY13 3 12 7 9 5 1 46 FY14 1 11 5 3 5 1 8 34 FY15 3 9 4 5 2-4 27 6 5 4 3 2 1 - Analysis Enhancement Projects closed by FY by type Integration and Interfaces Maintenance /Support New Application / Application Development Report Other Total FY11 8 12-19 6 3 3 51 FY12 3 4 3 1 7 3 1 31 FY13 8 4 1 13 13 6 1 46 FY14 5 3 2 12 7 3 2 34 FY15 2 4-11 8 2-27 FY15 AITS METRICS 9
PMO Performance Description: This metric consists of the following: 1) Percent of projects on schedule, moderately over schedule, and significantly over schedule. 2) Percent of projects on budget, moderately over budget, and significantly over budget. It provides a measure of how well we estimate and manage our projects. 1% 8% 6% 4% 2% % Schedule performance Jul-12 Aug-12 Sep-12 Oct-12 Nov-12 Dec-12 Jan-13 Feb-13 Mar-13 Apr-13 May-13 Jun-13 Jul-13 Aug-13 Sep-13 Oct-13 Nov-13 Dec-13 Jan-14 Feb-14 Mar-14 Apr-14 May-14 Jun-14 Jul-14 Aug-14 Sep-14 Oct-14 Nov-14 Dec-14 Jan-15 Feb-15 Mar-15 Apr-15 May-15 % on schedule % moderately over schedule % significantly over schedule 1% 8% 6% 4% 2% % Budget performance Jul-12 Aug-12 Sep-12 Oct-12 Nov-12 Dec-12 Jan-13 Feb-13 Mar-13 Apr-13 May-13 Jun-13 Jul-13 Aug-13 Sep-13 Oct-13 Nov-13 Dec-13 Jan-14 Feb-14 Mar-14 Apr-14 May-14 Jun-14 Jul-14 Aug-14 Sep-14 Oct-14 Nov-14 Dec-14 Jan-15 Feb-15 Mar-15 Apr-15 May-15 % on budget % moderately over budget % significantly over budget FY15 AITS METRICS 1
Services Offered (Systems) Departmental System Support Description: In addition to systems that support the University of Illinois administrative processes, AITS also supports systems for various departments throughout the University. This measurement shows the annual hours spent on this departmental systems support. This information is helpful in determining which departmental systems require the most support time. Hours spent by the Departmental Systems team on departmental systems support and projects 16, 14, 12, 1, 8, 6, 4, 2, Tax School 92 5 OBFS 155 248 IL Profiles 34 55 F&S 215 CITES 128 34 DS 349 788 Formbuilder 526 425 HR 1 8 132 3,635 4,481 Banner 123 66 Prairie Research Institute 17 26 47 5 CPRD 1,549 2,867 UOCP&RES 3,442 3,688 3,526 5,331 5,429 DARS 2,43 1,565 894 498 CAS 8 4 Mobile 176 3 4 FY15 AITS METRICS 11
Messaging Description: This tracks the number of times business objects or enterprise data messages are consumed by applications by month and by year. This is important in understanding the volume of messages being consumed and how that may vary over time. Messages received and delivered by fiscal year 45,, 4,, 35,, 3,, 25,, 2,, 15,, 1,, 5,, Received Delivered FY11 16,588,189 138,585,264 FY12 238,775,364 32,914,958 FY13 253,83,85 35,293,458 FY14 271,73,871 375,45,13 FY15 287,376,571 43,931,491 Message Availability Description: This tracks the number of enterprise data messages available. A higher number of enterprise data messages indicates a higher level of reusable components. The ability to view the number of messages available is important in tracking whether we are moving toward a higher number of reusable components or not. Messages available by fiscal year 7 6 5 4 3 2 1 59 61 61 61 61 FY15 AITS METRICS 12
EDDIE Sessions Description: Business Intelligence and Data Warehousing empowers decision makers in the pursuit of fulfilling the University mission and enables the University community in realizing efficiencies and effectiveness in business operations. The work of minimizing system downtime, managing user sessions, maintaining and enhancing available data, user support and training are critical factors in delivering this service. This metric shows the number of sessions where customers logged into the EDDIE environment per month. The spike beginning in March 215 is due to the deployment of the new Business Objects 4.1 and the additional training and testing needed for that effort. 1, 9, 8, 7, 6, 5, 4, 3, 2, 1, - EDDIE Sessions - FY15 88,345 74,388 64,261 54,476 54,197 33,47 28,112 17,677 17,181 11,88 14,61 14,641 Jul-14 Aug-14 Sep-14 Oct-14 Nov-14 Dec-14 Jan-15 Feb-15 Mar-15 Apr-15 May-15 Jun-15 FY15 AITS METRICS 13
Business Intelligence/Data Warehouse (BI/DW) Support Cases Opened by Request Area Description: This metric shows the total number of BI/DW support cases opened per month, broken out by request area. BI/DW Support Cases Opened by Request Area FY15 14 12 1 8 6 4 2 July Aug Sept Oct Nov Dec Jan Feb Mar April May Jun ODBC Connection 1 2 Training Enrollment 1 1 Data Availability 2 1 1 1 Reporting Assistance 8 4 4 2 3 2 5 2 1 1 1 1 User Access 3 7 3 3 2 2 4 2 1 Business Objects.Upgrade 2 1 1 3 Business Objects.Web Intelligence 2 11 3 4 3 5 7 7 12 9 9 5 Desktop Intelligence 1 1 2 2 3 2 2 1 3 1 InfoView (EDDIE) 13 6 16 3 9 9 6 3 5 11 5 6 Reporting Data and Access 7 18 2 2 5 25 43 46 21 18 36 47 Functional Area Data 2 68 65 6 3 42 33 41 12 31 26 19 FY15 AITS METRICS 14
BI/DW Training Description: This graph shows the total number of training attendees by month broken out by type of training. The spike in March 215 is due to the training for the new Business Objects 4.1 deployment. 25 ALL BI/DW Training Attendees by Type FY15 2 15 1 5 July Aug. Sep. Oct. Nov. Dec. Jan. Feb. Mar. Apr. May June WebCast 193 PracticeLab 11 24 24 44 25 29 37 33 14 8 13 CustomLab 2 2 5 4 3 1 6 12 2 1 BO 11 3 34 37 12 25 37 26 5 63 49 FY15 AITS METRICS 15
DS Work Requests by Month and Type Description: This metric lists the BI/DW work requests completed per month broken out by type. BI/DW Work Requests completed in FY15 by month and type 18 16 14 12 1 8 6 4 2 Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Standard Reports 7 2 8 8 2 3 3 1 1 8 1 4 Improve Performance 1 Enhance Existing Products 1 5 5 1 2 1 1 2 3 Data Validations 1 Data Availability 2 2 5 3 2 2 2 4 3 Functionality 1 Correction 1 1 2 1 2 4 6 2 3 Maintenance 3 1 1 1 FY15 AITS METRICS 16
Infrastructure Object Use and Availability Description: AITS is monitoring the reuse of enterprise objects by tracking the number of enterprise objects that are used by multiple applications. This shows how many enterprise objects are used by just one application and how many are used by multiple applications. When an object is used by multiple applications, it saves on analysis, development, and testing time for the development project. Tracking this metric will show how much AITS and the University are benefiting from the use of reusable objects. Enterprise objects used vs available by month (avg.) 25 2 15 1 5 # of Enterprise Objects Available # of Enterprise Objects Used 193.5 195.1 2.5 21. 22. 115.3 12.2 128.3 135.9 137. Avg. object usage by FY by # of applications (includes point to point and sync consumers) 16. 14. 12. 1. 8. 6. 4. 2.. 2 + Applications 9.7 1.5 1.8 11. 11. 1-2 Applications 7.9 7.5 9.8 11.8 12. 5-1 Applications 29.3 23. 25.3 27.9 28. 2-4 Applications 54.6 56.3 57. 57.6 58. 1 Application 13.8 22.9 25.4 27.7 28. FY15 AITS METRICS 17
DBs and Servers Description: This shows the number of host servers and databases supported by AITS ADSD Data Management. This is helpful in understanding the scope of support work related to host servers and databases for this group and how it changes year to year. # of Active DBs by FY # of Host Servers by FY 1,6 1,4 1,2 1, 8 6 4 2 1,41 994 1,83 856 717 6 5 4 3 2 1 55 47 5 44 35 Equipment Age Description: This measures the age of the equipment supported by Client Support Services. Older equipment requires more support. This is a good breakdown of the age of our equipment and how we are progressing in replacing our aging equipment. 1.% 9.% 8.% 7.% 6.% 5.% 4.% 3.% 2.% 1.%.% Age of supported equipment by fiscal year < 1 Year 6.7% 8.5% 9.1% 6.2% 11.6% 1 Year 11.9% 18.7% 21.6% 24.5% 14.4% 2 Years 26.6% 12.6% 19.% 22.% 22.3% 3 Years 18.1% 26.9% 11.3% 15.1% 2.3% 4 Years 1.2% 14.4% 19.6% 9.2% 12.8% 5 or > Years 26.5% 18.9% 19.4% 23.% 18.6% FY15 AITS METRICS 18
Computer Support Description: This measures the number of computers supported by Client Support Services by department. This is good information for knowing which departments have the largest number of computers and, thus, will need the most support. Equipment supported by department by fiscal year (end of FY15) Other, 614, 26% OBFS, 741, 32% LGC, 7, 3% Treasury Oper, 13, 4% LER, 114, 5% UICHR, 165, 7% AITS, 545, 23% FY15 AITS METRICS 19
Data Center Backup Storage and Capacity Description: Backups and storage continue to grow as we support the student and faculty systems across all campuses. This shows the backup and total storage by data center by fiscal year. 9 8 7 6 5 4 3 2 1 Backup storage by data center by fiscal year in TBs 798 625 433 44 417 35 311 29 43 Urbana Chicago 834 2 15 1 5 14 Allocated configured capacity in TBs 181 18 157 146 145 132 18 82 62 Urbana Chicago FY15 AITS METRICS 2
Change Request CI Selections Description: This measure is an annual count of both the number of times that Banner components, Banner databases, or SGHE delivered mods are selected as affected Configuration Items (CIs), as well as the number of non-banner related CIs, for all closed change requests. This metric helps to understand the volume of changes closed on a yearly basis and whether those numbers are increasing or decreasing. 12, Total # of Banner and Non-Banner Changes by Year 1, 8, 6, 4, 5,12 6,166 7,454 7,395 1,61 2, 55 645 632 489 693 Banner Non-Banner FY15 AITS METRICS 21
Change Orders by Change Category Description: This measurement identifies the top few change categories with the most changes, consolidates the remaining categories into Other, and provides the % against the total number of changes. This view helps provide for a better understanding about which change categories the greatest amount of changes take place in and their percentage of all changes. % Total of CO's by Change Category FY 15 AITS.TAM STUDENT, 231, 12% Other (all < 5% of Total), 7, 36% AITS.TAM FINANCE, 224, 12% AITS.APPLICATION DEVELOPMENT, 223, 11% AITS.APPLICATION ADMINISTRATION, 111, 6% AITS.STORAGE MANAGEMENT, 142, 7% AITS.TAM HR, 152, 8% AITS.TAM ODA, 165, 8% FY15 AITS METRICS 22
Successful Change Orders by Type Description: This measurement shows the totals for each Closed, successful Change Order Type along with the % of total. This information helps us to understand which change order types are most successful and, conversely, which are least so that we can address issues where needed. Successful Change Orders by Type FY15 Emergency High, 32, 2% Pre-Approved Normal, 135, 7% Major High, 84, 4% Normal High, 674, 36% Normal Normal, 928, 5% Major Normal, 17, 1% Unsuccessful Change Orders by Type Description: This measurement shows the totals for each Closed, unsuccessful Change Order Type along with the % of total. This information is helpful in understanding why change orders were not successful and where to focus attention in making them successful in the future. Unsuccessful Change Orders by type FY15 Successful with Unplanned Outage FY15, 3, 4% Backed Out FY15, 1, 13% Withdrawn FY15, 2, 3% Partially Successful FY15, 33, 42% Withdrawn After Approval FY15, 29, 37% Rejected FY15, 1, 1% FY15 AITS METRICS 23
Total CRs Submitted Description: This chart show the total number of change requests (CRs) submitted. This helps us understand the volume of CRs we work with each year. Total CRs submitted by fiscal year 2,5 2, 1,91 1,769 1,85 1,739 1,949 1,5 1, 5 Weekend Rollouts Description: These metrics indicates the number of weekend rollouts as well as how many changes were implemented during weekend outage windows as part of a formal rollout plan. It is a measure of balanced risk, resource utilization and efficiency. 9 8 7 6 5 4 3 2 1 Total changes from weekend rollouts by fiscal year 85 6 61 67 65 FY15 AITS METRICS 24
5 45 4 35 3 25 2 15 1 5 Weekend Rollouts by fiscal year 44 32 33 25 2 New and Decommissioned CIs and Servers Description: This measure shows the total new and decommissioned configuration items, total new and decommissioned server entries in the CMDB, and total new configuration items with a defined implementation date, which indicates a newly deployed infrastructure. 45 4 35 3 25 2 15 1 5 39 New CIs FY 15 New and Decommissioned CIs and Servers 176 173 Decommissioned CIs New Servers 19 Decommissioned Servers 31 Newly Identified Implementations FY15 AITS METRICS 25