Criteria Category : Database Management and Other General Considerations Data Management Easy to create, change, delete, and view projects and project data. 2 Accommodates all project types and project information 3 Supports entry of annotative comments and appending documents, images, and links for project documentation 4 Accommodates hundreds/thousands of projects 5 Supports data import from your existing systems and databases (e.g., planning, financial systems) 6 Supports data export to your existing systems and databases 7 Supports dependency links among projects 8 Provides data cut-and-paste, project cloning, and data roll-over 9 Provides completeness/error checks and data warnings Allows multiple portfolios and portfolio hierarchies (parent-child links) Allows dynamic portfolios (portfolios defined based on latest project data) 2 Provides search, filter, and sort 3 Provides data archiving 4 Provides statistical analysis of historical data (e.g., trend analysis) Governance and Security 5 Accommodates hundreds/thousands of users 6 Provides security (encryption), controlled access and change privileges, and audit trail (who changed what when) 7 Provides PPM workflow guidance, status, and progress reporting Database Management Page
Criteria Category : Database Management and Other General Considerations Displays and Reporting 8 Able to slice, dice, and aggregate data with ability to load and change aggregation hierarchies 9 Easy to generate useful, understandable, schedulable displays and reports 2 Provides dashboard views plus ability to drill down 2 Allows users to configure/customize/format views, graphs, and reports 22 Provides document management (document storage, read, save-as, check-in, check-out, version control, history, etc.) 23 Supports multiple languages and currencies 24 25 26 Communication and Collaboration Supports mass communication and notification (via home page "bulletin board, mass emails, etc.) Provides targeted communication and notification (selective, rule-based notifications via email) Supports real-time group communication (e.g., on-line chats, discussion forums, instant messaging) Help and Training 27 Tool delivered with training for installation and operation 28 Tool incorporates help features (e.g., mouse roll-over, documentation, educational videos, on-line training) 29 3 Delivery Provides desired delivery platform (on-demand service, desktop installation, web-based, etc.) Supports your server and workstation operating systems and database environment Vendor 3 Vendor has expertise (in PPM, your industry, etc.) 32 Vendor can be counted on to provide on-going support (maintenance, enhancements, warranties, escrow policy, etc.) Totals (this category): Totals (all categories): Database Management Page 2
Criteria Category 2: Project Evaluation and Portfolio Optimization Decision Aid Evaluates real project choices (e.g., choice among alternative project versions, do project now vs. do next year) Accommodates mandated projects (including requirement that at least 2 one project version be funded) Accounts for choice dependencies (e.g., project B may be selected only 3 if version 2 of project A is selected) Able to evaluate alternative spending levels for pooled projects (e.g., 4 what fraction of similar tasks to complete) 5 Able to evaluate and optimize multi-year plans and scenarios 6 7 Financial Analysis Allows business-case cash-flow analysis over project/asset life-cycle with summary metrics (e.g., NPV, IRR, payback period) Supports after-tax financial analysis, including forecasting using pro forma statements Risk Analysis 8 Quantifies project risk 9 Quantifies project deferral risk (risks if the project is not conducted) Supports evaluation of risk-reward tradeoffs Project Evaluation Provides "out of box" project evaluation metrics 2 Supports customizable/user-defined metrics, scales, models, logic 3 Able to support sophisticated computations/simulations (more than rateand-weight scoring) 4 Able to address non-financial project benefits (e.g., impacts on corporate image, service quality, learning, safety) 5 Able to capture and model alignment with strategy and/or strategic objectives 6 Able to provide/utilize default data/uncertainty ranges & turn off measures if data is unavailable or too time-consuming to acquire Prioritization Page 3
Criteria Category 2: Project Evaluation and Portfolio Optimization 7 8 9 Project Valuation Able to quantify project value in dollar units (to allow direct comparison with project cost) Value estimation based on comparing doing vs. not doing project (not doing project can produce negative value) Able to adjust project value based on risk and risk tolerance (riskadjusted project value) 2 Provides quantitative (cardinal) measure of project priority (not just project rank) 2 Able to account for project urgency as well as cost and value when computing priorities 22 Able to compute and display the efficient frontier of portfolios 23 Provides true portfolio optimization (solves "knapsack" problem) 24 Allows multiple constraints (e.g., multi-year costs, separate constraints for different org. units, resource constraints) Able to optimize/re-optimize portfolios with some projects being "forced 25 in" 26 Displays individual sources of project and portfolio value (e.g., financial, customer service, safety) 27 Selects project versions based on budget (e.g., lower-cost project version may be optimal under tighter budget constraint) 28 Supports tiered/staged portfolio optimization (to allow business unit priorities to be optimized/finalized prior to enterprise optimization) 29 3 Prioritization and Portfolio Optimization Allows setting performance goals/targets for a subset of portfolios Provides "sand box analysis" (local data entry/analysis prior to saving to central database) 3 Able to provides real-time feedback to users on impact of project inputs 32 Provides mechanisms for preventing/minimizing input "gaming" Totals (this category): Totals (all categories): Prioritization Page 4
Criteria Category 3: Project Planning and Project Management 2 3 Allows linking mult--level project and task plans 4 5 6 Supports timing and scheduling (e.g., via Gantt charts and Pert charts 7 Project Planning Supports workplan development (via templates, etc.), controls plan creation/modification/deletion, and provides plan storage Provides project baseline tracking, version control, audit trail, and plan history Able to compute total project costs (e.g., via labor hours, rates, burden, materials and other expenses) Allows defining projct-specific phases, gating processes, and milestones Provide compliance-based processes (e.g., PMBOK, SDLC, ISO 9, Sarbanes-Oxley, CMMI) 8 Supports project risk assessment and risk mitigation planning 9 Workflow Management Supports workflow management (generates individual task lists, reports status, routes action notifications, supports approvals, etc.) Provides template library for project tasks (charter, issues log, request forms, etc.) with ability to add, modify & save templates Provides meeting schedule with automated invites 2 Supports issue tracking and management (e.g., issue definition, assigning to issue owners, converting issues to tasks) 3 Provides change management (change reporting, approvals, change impact analysis) 4 Povides analytics and project trade-offs for supporting task level decisions 5 Provides analytics/models for project performance assessment, benefits measurement, and value realization management Project Management Page 5
Criteria Category 3: Project Planning and Project Management Project Data and Status Reporting 6 Able to manually/auto load and selectively change project data (start/end dates, units of work requied, etc.) 7 Able to capture, compute, and report real-time actuals (e.g., costs, effort, and shedule status) 8 Able to aggregate cost, effort, and schedule data across pojects (e.g., Gantt dta roll-up) 9 Able to calculate performance ratios manually or automatically at secified points in time or at project milestones 2 Provides dashboard view of status of all projects with ability to drill down 2 Computes/displays estimates of remaining work (hours to completion, percent of wok completed, end-date forecasting, etc.) 22 Provides comparison of acutal vs. planned progress with variance analysis, alerts, and rule-based notification 23 Supports project reporting/forecasting according to government contracting requirements (e.g., earned value analysis - EVA) 24 Supports risk monitoring and on-going multi-project risk management 25 26 27 Support for Accounting, Accual, Payroll, Billing, Etc. Able to use project status and project forecasts to update financial budget forecasts Able to capture and transmit project costs, expenses, commitments, etc. for accounting. Suppot preparation and generation fo wok oders for project and accounting system integration 28 Supports payroll and billing (e.g., expense reporting) 29 Supports verification of project deliverable acceptance criteria 3 3 Supports post-implementation reviews and lessons learned 32 Project Close Out and Knowledge Management Provides project outcome performance monitoring/reporting (e.g., project payback, benefits tracking) Supports project management knowledge database for storage and mining Totals (this category): Totals (all categories): Project Management Page 6
Criteria Category 4: Resource Management and Supply Demand Balancing Resource Management Captures all people resource categories and allows segmentation based on geography, organizationl unit, resource pool, etc. Captures necessary information for characterizing individual resources 2 (e.g., skills, certifications, education, rates, interests) Provides dashboard view with drill down to individual resource 3 availability (eg., by time, skill, location, assignments) Tracks evolution and development of individual resources (e.g., 4 experiences, skill growth) Includes non-human resources (normal, consumable, perishable) for 5 non-human resource management 6 Supports resource queries (e.g., chargeable/non-chargeable hours) 7 8 Provides automated, rule-based routing of updates regarding individual resources (e.g., change in availability, rate) Supports obtaining time-to-complete estimates directly from individuals (which may provide more accurate availability estimates) 9 2 3 Demand Management Allows specifying resource demand categories (e.g.,projects, organization units, applications) Supports formal resource request system (preparation of requests, aggregate views by demand categories and over time, etc.) Reports resource request and application status per your demand management workflow process Able to schedule requests based on priority, date, contribution, or other criteria Provides statistical analysis of requests (e.g., trend analysis of request types, resonse times, escalations) Resource Balancing Page 7
Criteria Category 4: Resource Management and Supply Demand Balancing 4 5 6 7 8 9 Resource Assignment Supports top-down resource assignment (e.g., provides search and sort based on roll, skill, location) Supports bottom-up resource assignment (e.g., by allowing individuals to review and select from availability assignments) Supports time-phased resource booking to projects (by manually loading resource assignments). Support resource booking to organizational requests (for subsequent assignment to projects) Includes operational and administrative resource assignment (in addition to project resource assignment) Provides automated resource assignment (based on availability and user defined criteria) 2 Allows viewing resource assignments by individual and project 2 Provides scheduling engine for assigning and scheduling resources 22 Allows manual changes to resource assignments for individual projects after project initiation 23 Supports approval processes for the assignment of resources 24 Synchronization of availability schedules with personal calendars (to incorporte non-project commitments, planned absences) 25 Supports non-human resource allocation management Supply-Demand 26 Summarizes utilization levels by resource category and over time 27 28 29 Compares resource supply-demand by resource category, identifies gaps, bottlenecks, and over-allocated resources Provides analytics to support planning for acquiring additional internal/external resources Time Tracking Exports project data to timesheet systems (e.g., ability to load time sheet with allocated activities) 3 Includes employee timesheet system 3 Includes electronic time clock 32 Exports accepted time data to payroll and billing systems Totals (this category): Totals (all categories): Resource Balancing Page 8