1 Survey of more than 1,500 Auditors Concludes that Audit Professionals are Not Maximizing Use of Available Audit Technology Key findings from the survey include: while audit software tools have been available for almost 2 decades, auditors and audit departments are not making full use of the technology auditors use audit software tools mostly on an ad hoc basis with some repetitive use, and departments do not have a strategy or plan to integrate technology in the audit process the main reason for limited use of audit technology tools is the cost of the software and training and management resistance to change Auditors have a number of technology tools and techniques available for each area of the audit process. Software vendors comprised of former technology audit professionals have developed products that can increase productivity and expand the capabilities of audit shops whether they are large or small. Despite this fact we have noticed that surveys performed by leading professional associations, consulting and auditing firms consistently report that while auditors have made gains in utilizing technology there is plenty of room for improvement. The AuditNet 2012 State of Technology Use by Auditors was launched in order to determine what tools audit departments are using, how the tools are being used, the level of use and where auditors see themselves on the Audit Utilization of Technology Optimization Scale (AUTOS). AuditNet has been on the leading edge of the profession when it comes to encouraging auditors and audit departments to integrate the use of technology in their methodology.
2 Executive Summary Information technology is now a way of life in the business community. The decreasing cost of hardware and the wide variety of software available has put computing power on the desk of most employees of even the smallest companies. This technology has also made it possible for auditors to undertake procedures that were previously impossible due to time constraints and cost. From Application of Computer Assisted Audit Techniques using Microcomputers CICA 1994 Computers assisted audit tools and techniques (CAATTs) have been available for auditors since the early 1990 s. The 2012 AuditNet Audit Use of Technology Survey found that despite the recognized added value that technology affords auditors a paradigm shift in maturity is not imminent. We received responses from almost 1,500 auditors and over 2/3 completed all the survey questions. The most widely used category of audit software used by auditors is data analysis software. That being said 59% of those surveyed said they were using data analysis tools on an ad hoc basis (when needed) or not at all. Only 21% were using data analysis tools and techniques on a repetitive basis (used for most audits). While few respondents indicated continuous use (used for every audit or project) There is clear evidence that using data analysis software results in cost savings as demonstrated by research from the Corporate Executive Board s Audit Director s Roundtable which reported in 2005 that Internal Audit Internal Audit Should Embrace Data Analytics: Data analytic procedures are a much more cost effective way to collect audit evidence. Analytic procedures cost $0.01 compared to $4 for a standard audit of the same evidence. The survey results showed that other audit software technologies were either being planned or at the ad hoc use level. Repetitive use of audit software by most auditors is far from mature in all of the software categories included in the survey. For a profession that prides itself on embracing technology it was clear from our results that auditors are far from reaching an optimum maturity level. Professional associations have promoted the benefits of enhanced technology to their members and have produced guidance on integrating technology in the audit process. The IIA implemented Standards requiring auditors to leverage technology stating that: In exercising due professional care, internal auditors must consider the use of technology based audit and other data analysis techniques. (Standard 1220.A2)
3 Professional associations have done significant research and invested significant resources into developing strategies and plans for greater use of technology by auditors however they have not openly disseminated this information to the global audit community. Association members have free access but non members must purchase the guides. Additionally audit and consulting firms have spent significant time and resources to develop unique and separate approaches and methodologies on technology solutions. If we expect to affect a paradigm shift in audit use of technology we need standards, action plans and guidance coordinated through a task force of professional associations and audit and consulting firms. These standards and guidance should be widely disseminated to the global audit community. Social media and networks have facilitated communication to the global audience of auditors and could be effectively used to raise the bar on the audit use of technology maturity scale. Additional results of our survey showed the following: 1. Training is primarily on the job as opposed to a formal setting. 2. Software cost and lack of management support continue as significant reasons for not implementing technology 3. Technology continues to be seen as the domain of IT auditors rather than all staff 4. Most audit department have not: a. defined a strategy for implementing audit technology, b. defined the benefits of implementing audit technology, c. defined ways to measure the effectiveness of technology investments, processes, and activities 5. Size of audit department has no apparent impact on maturity level of use of audit technology 6. Most audit departments were at the lowest level of maturity on the audit use of technology maturity level (from little or no use to planning and ad hoc) and few departments have matured to repetitive or continuous use of audit technology. Action Plan for Auditors 1. Conduct an inventory of technology tools and create a matrix linking tools to activities 2. Prepare a technology skills inventory for current staff and perform a gap analysis 3. Perform a gap analysis to determine target areas for improvement and determine financial resources required for the software, training and maintenance 4. Build a business case for integrating technology in the audit process 5. Hire auditors with the necessary skills to fill the gap. 6. Acquire technology for the target areas if not already purchased 7. Assign a technology champion and influencer to lead the integration and develop a succession plan to ensure technology use continuity
4 8. Develop an implementation strategy to integrate audit technology for administrative tasks and in each phase of the audit process 9. Annually conduct an audit technology assessment and benchmark progress against initial initiative 10. Develop metrics to demonstrate the impact of technology on the audit process to include outcomes as well as outputs.
5 AuditNet 2012 State of Technology Use by Auditors Survey Computers assisted audit tools and techniques (CAATTs) have been available for auditors since the early 1990 s. The 2012 AuditNet Audit Use of Technology Survey found that despite the recognized added value that technology affords auditors a paradigm shift in maturity is not imminent. We received responses from almost 1,500 auditors and over 2/3 completed all the survey questions. The most widely used category of audit software used by auditors is data analysis software. That being said 59% of those surveyed said they were using data analysis tools on an ad hoc basis (when needed) or not at all. Only 21% were using data analysis tools and techniques on a repetitive basis (used for most audits). While few respondents indicated continuous use (used for every audit or project) There is clear evidence that using data analysis software results in cost savings as demonstrated by research from the Corporate Executive Board s Audit Director s Roundtable which reported in 2005 that Internal Audit Internal Audit Should Embrace Data Analytics: Data analytic procedures are a much more cost effective way to collect audit evidence. Analytic procedures cost $0.01 compared to $4 for a standard audit of the same evidence. The survey results showed that other audit software technologies were either being planned or at the ad hoc use level. Repetitive use of audit software by most auditors is far from mature in all of the software categories included in the survey. For a profession that prides itself on embracing technology it was clear from our results that auditors are far from reaching an optimum maturity level. Professional associations have promoted the benefits of enhanced technology to their members and have produced guidance on integrating technology in the audit process. The IIA implemented Standards requiring auditors to leverage technology stating that: In exercising due professional care, internal auditors must consider the use of technology based audit and other data analysis techniques. (Standard 1220.A2) Professional associations have done significant research and invested significant resources into developing strategies and plans for greater use of technology by auditors however they have not openly disseminated this information to the global audit community. Association members have free access but non members must purchase the guides. Additionally audit and consulting firms have spent significant time and resources to develop unique and separate approaches and methodologies on technology solutions. If we expect to affect a paradigm shift in audit use of technology we need standards, action plans and guidance coordinated through a task force of professional associations and audit and consulting firms. These standards and guidance
6 should be widely disseminated to the global audit community. Social media and networks have facilitated communication to the global audience of auditors and could be effectively used to raise the bar on the audit use of technology maturity scale. Over two thirds of our responses came from audit departments with less than 10 auditors. However, based on the responses provided there appears to be no variation in how auditors use technology. We have always assumed that the larger the department the greater the utilization of audit technology but based on the results of this survey that is not the case. Availability of Audit Technology Tools Audit technology tools other than data analysis were not available in more than half of the audit departments according to the survey responses. The following chart represents the technology tools currently available by those who responded to the survey. This chart clearly demonstrates that of the nine categories of technology tools those used most and fully deployed are data analysis software (ACL, IDEA etc) followed by electronic working papers such as CCH TeamMate. Categories where little progress has been made include GRC, continuous monitoring and fraud detection/prevention software. The majority of audit departments had not even begun the evaluation process and had no plans to make technology tools available to their staff. Less than 5% were evaluating vendors. If audit technology tools are not available in more than half of audit departments then how reliable are results from other surveys regarding widespread use of computer assisted audit tools and techniques?
7 Proficiency with Technology When asked to categorize their technology skill set 28% of the respondents indicated that few of their auditors were proficient with audit technology tools and 31% said some of their auditors were proficient. The IIA standards do not require all internal auditors to possess technology skills so the responses to this question are not surprising. The emphasis by professional standards is that technology skills should be available rather than having proficiency for all staff. This would be a good area to expand this question and correlate staff level to technology skill set. Perhaps the senior staff represents auditors without technology skills as their primary role is administration. Even so we would expect that some of the audit management tools involve technology skills.
8 Few of our auditors are proficient with our audit technology 27.7% Some of our auditors are proficient with our audit technology 30.9% Most of our auditors are proficient with our audit technology 24.0% All of our auditors are proficient with our audit technology 17.4% Technology Training Most of the technology training received by both new hires and current audit staff is accomplished by on the job training. Only 7.5% reported formal training by third parties or outside the office. Training is an important factor in audit use of technology. Training must be supplemented by using the technology on a repetitive basis. Using audit technology on an ad hoc basis may result in loss of knowledge acquired from formal or on the job training i.e. use it or lose it. According to TeamMate s 2011 Internal Audit Technology Survey Despite the importance of the right Tone at the Top and technology skill sets, training does more than any other practice to help respondents utilize technology more effectively, according to the 2011 IATS results. In response to an open ended question receiving dozens of responses, more than 50 survey respondents identified some form of on the job or formal training, whether delivered by in house staff or a third party, as having done the most to help them enhance technology value and effectiveness. Keep in mind, however, that technical skills fade quickly if they are not used; the use it or lose it saying has definite application when it comes to complex technology requiring frequent use in order to master and retain what is learned. For this reason, it is useful to conduct a strategic analysis of your training needs when it comes to technology, a process that includes determining what levels of proficiency are required for various members of your group in order to achieve departmental objectives. You may only need one expert in data mining or data analytics, for example, and this expert, in turn, would be asked to train others in the department in a systematic manner.
9 Therefore one of the critical steps in moving the bar on the audit use of technology maturity scale is training tied to repetitive or continuous use of the tools. Inventory of Audit Technology Tools How can an audit department maximize the use of audit technology tools if they don t know what tools they have? The following chart shows that according to the survey responses most audit department do not maintain an inventory of audit technology tools. So the question is if audit departments do not inventory their audit technology tools how can they begin to put into place a strategy or plan to use technology? This may be an area for further study as turnover in audit departments would be a key factor in loss of institutional knowledge or a growing inventory of shelf ware (audit software purchased but not deployed). The question of available technology tools should be one of the questions asked by new hires or a new chief audit executive (CAE). A current and updated inventory of available audit technology tools represents another critical step in the audit use of technology. Current Use of Technology by Audit Departments Almost two thirds of those responding said that their audit departments performed an assessment of the current use of technology by internal audit. A key metric to establish whether audit uses technology would be to measure the current state of technology use by audit. By benchmarking and measuring the current state of technology use by audit a CAE
10 would be able to create a plan and then evaluate on a periodic basis (annually) whether the use of technology has matured beyond an ad hoc level. Auditor Maturity Ratings on the Use of Audit Technology The IIA Global Technology Audit Guide (GTAG) 16 Data Analysis Technologies provides the following group types of data analysis tasks: AD Hoc Repetitive Continuous Periodic analysis of processes from multiple data sources. Explorative and investigative in nature Always on scripted auditing and monitoring of key processes. Seeking documented conclusions and recommendations. Seeking to improve the efficiency, consistency, and quality of audits. Seeking timely notification of trends, patterns and exceptions. Supporting risk assessment and enabling audit efficiency. Specific analytic queries per formed at a point in time for the purpose of generating audit report findings. Managed analytics created by specialists and deployed from a centralized, secure environment, accessible to all appropriate staff. Continual execution of automated audit tests to identify errors, anomalies, patterns and exceptions as they occur.
11 Using similar group types for all audit technology AuditNet developed the Audit Utilization of Technology Optimization Scale (AUTOS) to measure the perceived maturity level on the use of audit technology by auditors. We asked respondents to rate their department maturity for the categories of audit software. The survey results demonstrated that most auditors are still at the ad hoc or lowest level of maturity for most audit technologies. For most of the audit software categories more than half of the auditors reported that they do not use the technology. For some categories such as governance, risk and compliance, continuous controls monitoring and fraud prevention and detection more than two thirds reported no use. The only exception was data analytics (ACL, IDEA Excel) where almost 38% reported not using the technology. Another 21% reported that they only use data analysis tools on an ad hoc basis (defined below in GTAG 16). In the category of electronic working papers and audit management software (TeamMate, Pentana and other vendors) close to 50% do not use the technology. Based on subsequent survey questions one of the delimiters to greater use of audit technology is cost of the software and training. There is a significant opportunity for vendors to develop affordable tools to capture the market of those audit functions not currently using audit software technology. Additionally affordable training opportunities for each of the software categories could have a positive impact on audit departments moving the bar on the maturity scale. Satisfaction with Implemented Audit Technology and Leveraging the Tools We asked survey participants to rate their satisfaction in each of the audit technology categories that their department has implemented. The responses demonstrated a relatively low level of satisfactions in most software categories. The only technology tool where more than half the auditors were either moderately or completely satisfied was Microsoft Office (Word, Excel and Access). For the data analytics (ACL, IDEA) and electronic working papers (TeamMate, Pentana and others) categories almost 40% of those surveyed were moderately or completely satisfied. In the data analytics and electronic working paper categories 10% of those responded they were not satisfied with the technology. When looked at in the context other survey responses the level of satisfaction is directly related to the ad hoc use of audit software, the training factor as well as support by senior management. If auditors are not using audit software technology on a repetitive or continuous basis they may not be seeing the positive impact results. If results from the use of audit software technology is not being measured or evaluated then satisfaction may be less than optimal. We also asked the previous question from the perspective of how satisfied respondents were with the audit functions leveraging of the tools. For this question approximately 20% for each
12 software category were not satisfied with how their departments were leveraging the technology. Again the highest ratings were for audit management software and data analytics. Leveraging the technology is highly dependent on whether the audit department has a plan on how to use the technology and it is clear from other survey questions that ad hoc use can be correlated to less satisfaction. If audit departments established a plan for how to integrate technology into all areas of the audit process we should expect a resulting shift in the satisfaction level by staff and management. The benefits of leveraging technology to support the internal audit mission would become evident. Detailed responses for this question are available in the full survey report. Software and Training Costs are the Primary Reasons for Not Using Audit Technology We provided a list of 15 reasons cited for not using audit technology and asked survey participants whether they agreed or disagreed. The main reason for not using audit technology is cost according to 57% of the responses. The next major reason for not using the technology was that their department had no funds allocated for training (50%). While software and training costs were the primary factors cited for not using the technology they were followed by audit management not supporting use and organizational roadblocks. Management buy in to how technology can help is a critical factor and a cost benefit analysis could contribute greatly to overcoming cost issues. Management support is critical as reported in TeamMate s 2011 Global Technology Survey where they found that tone at the top was the single factor that does the most to enhance technology effectiveness. Developing a training plan that leverages internal knowledge can also facilitate the process. In some companies organizational roadblocks such as IT (Information Technology) management of the Chief Technology Officer (CTO) impact the use of audit technology. It is therefore important for audit management to make the case for acquiring audit technology and demonstrating how it can benefit the organization. Key stakeholders and management need to be part of the process. Detailed responses for this question are available in the full survey report. Audit Department Technology Plans and Strategies The following chart shows responses to the question does your audit department have a plan or strategy to address key areas. More than half of those surveyed reported that they did not have a plan or strategy for these areas.
14 Auditors Rank Departments at Informal or Ad Hoc Use of Technology Too few auditors and audit organizations have invested much thought and resources into computer based tools and techniques, let alone information technology. David Coderre from Internal Audit: Efficiency through Automation 2009 AuditNet developed an Audit Use of Technology Optimization Scale and asked auditors where they would rank their department. More than one third (36%) of survey respondents ranked their audit department at the informal or ad hoc maturity level for audit use of technology. Another 18% ranked their department at the needs assessment level which means that they are not using any audit technology. The responses from those surveyed would contradict many other reports from the profession, vendors and consultants that indicate that most auditors are using technology on a repetitive or continuous basis. In order for auditors to achieve the efficiencies afforded by technology they need to integrate and incorporate tools as part of the audit process. To move the bar on the Technology scale auditors need to be using available tools for all audits rather than on an ad hoc basis. As organizations have embraced technology in all of their systems and operations, auditors need to embrace technology to approach how they do their work and meet the
15 objectives of their audits. This requires a cultural change that must come from the top down as well as the bottom up. The technology option must be considered from the planning phase of the audit right through to the reporting and follow up phase. Staff auditors should be encouraged to suggest how they can use technology to improve and facilitate the audit. Technology can be applied for risk assessment, planning the annual audit schedule and projects, fieldwork, reporting and follow up. Factors that will Influence a Shift in Technology Use We asked what factors have the greatest influence on making a paradigm shift towards technology maturity. The highest ranked areas were as follows: 1. Financial resources greater investment in audit technology 2. Leadership greater commitment by the CAE to embrace technology 3. Planning having a clearly defined plan 4. Training ensuring that all staff receive training 5. Human resources hiring the right auditors with technology experience The lowest ranked areas included compensation incentives, vendor suite of tools, and organizational infrastructure changes. The issues identified coincide with surveys by other organizations that emphasize cost as a major factor. This is perhaps an area where organizations who do not have the financial resources can start their technology plan using available tools such as Microsoft Office and add Excel add ins for data analytics. However, perhaps the greatest impact can be made by organizational leadership combined with planning, where the CAE and management embrace technology as an enabler to benefit the organization.
16 The final survey question was open ended and asked auditors to provide the one factor above all others that they saw as impacting a paradigm shift in auditors integrating audit technology in their audit function. More than 30% of the responses centered on the cost of either the software, training or overall technology and in many cases whether the benefit justified those costs. More than 20% indicated that management (CAE) support was the one most important factor that would contribute to a resulting shift. Following are examples of some of the thoughtful responses from auditors: Individuals are not willing to deal with change. A lot of people are not willing to learn something new because they think they will not be able to master it. Demonstrating value. Once auditors being to see value in audit effectiveness, audit efficiency, results, management responsiveness and/or board responsiveness, they get the bug. As data drives the entire business more and more, and more and more controls are automated, we will have no choice. The more auditors that have used technology and are familiar with the benefits it brings, the more push there will be from within audit departments to adapt technology.
17 Biggest factor is the value of the technology. The technology would have to significantly reduce current workload. Currently our audit staff is pressed for time on all audits. Which means we don't have a lot of time for training on new software, but if we found a solution that could be integrated with our current financial systems (if required), and it was cost effective, and allowed us to reduce much of the current workload for conducting non essential audit tasks, I could see a very good possibility of acquiring and using such audit technology. Clearly demonstrated benefit / differentiation of using technology vs not using technology in audits. What would help me would be hearing about real world examples of how things went wrong (got missed) at organizations who were not using technology in their audit function and how that cost the organization. While difficult / unfair to necessarily pin such events squarely on IA, there's enough press re: "Where was Internal Audit?" for technology providers to be able to provide examples of how their product(s) could have helped. In my opinion, the one factor impacting a paradigm shift is change. For some experiences auditors, the technology is so very new to them that they will resist as long as possible. For new auditors, without the skills with audit technology, they won't get the job to learn the technology. Being open to change and willing to take the time to learn how new technology can be used. They need to acknowledge that while using a new technology will seem like more work and that it takes longer in the short term, use and familiarity will increase productivity and the ability to think to new ways to expand effectiveness. Clearly auditors gave great thought time and effort into responding to this survey and it represents insight into where auditors see themselves and their organizations in relating to use of audit technology. The complete results of this survey are available from AuditNet and are provided as a service to the profession. Based on the response and the information gleaned from the survey we plan on repeating this to determine the trends with respect to audit use of technology. For the summary survey results click here
18 2012 State of Technology Use by Auditors 1. AuditNet Survey 2012 State of Technology Use by Auditors The AuditNet 2012 State of Technology Use by Auditors was launched in order to determine what tools audit departments are using, how the tools are being used, the level of use and where auditors see themselves on the Audit Utilization of Technology Optimization Scale (AUTOS). AuditNet has been on the leading edge of the profession when it comes to encouraging auditors and audit departments to integrate the use of technology in their methodology. Surveys by other organizations recognize the added value that technology affords auditors however it does not appear that a paradigm shift is imminent. Here are some of the key findings from other surveys on technology and internal audit: According to a recent survey by the Institute of Internal Auditors data mining and analytics are one of the top five skills sought for new internal auditors. The 2012 Internal Audit Capabilities and Needs Survey by Protiviti reported that CAATs, continuous auditing and continuous monitoring are skills areas that auditors need to improve as the profession moves toward these approaches and techniques. According to the 2011 TeamMate User Survey it is imperative that all auditors understand the technology tools available and use them on all audits. The options available to CAE emphasize either hiring auditors with the technology skills to jump start implementation of technology initiatives which helps shorten the learning curve. Additionally providing staff with training for audit technology tools is a must. According to the Grant Thornton 2012 CAE Survey most CAEs seem to recognize that their departments can better harness the power of technology. Half of respondents acknowledged their organizations do not effectively use governance, risk and compliance (GRC) specific technology. Data analytics and continuous auditing technologies are gaining wider acceptance, however. Still, given the power of today s technology tools, internal audit can do more. The IIA Standards related to use of technology (1220.A2 Leveraging Technology Resources) states that... in exercising due professional care, internal auditors must consider the use of technology based audit and other data analysis techniques. So if auditors are required to use technology, have access to this advanced technology and the benefits are clearly apparent why are auditors not higher on the Audit Utilization of Technology Optimization Scale? This survey will attempt to answer that question as well as others relating to the current state of technology usage by auditors.
19 2012 State of Technology Use by Auditors 1. Which industry do you work in? Accounting Banking Education Energy (Oil and Gas, Electric) Financial Services Government Healthcare Hospitality Retail Service Other Other (please specify) 2. What is the size of your audit department? I am a 1 person department 2 5 auditors 5 9 auditors auditors auditors Over 50 auditors
20 2012 State of Technology Use by Auditors 3. What audit technology tools are currently available or do you plan to implement in your department? None Purchased Evaluating Selecting Not yet Partially Fully Purchased not used vendors vendors deployed deployed deployed (Shelf ware) Audit & Resource Scheduling Audit Management Software (e.g. TeamMate, Pentana) Automated Issues Tracking, Follow Up & Reporting Continuous Controls Monitoring Data Analytics (e.g., ACL, IDEA) Electronic Working Papers (e.g. TeamMate, ACL Workpapers) Fraud Detection and Prevention Governance Risk and Compliance Risk Assessment
21 2012 State of Technology Use by Auditors 2. Default Section set? 1. When it comes to technology, which statement best describes your internal audit skill Few of our auditors are proficient with our audit technology Some of our auditors are proficient with our audit technology Most of our auditors are proficient with our audit technology All of our auditors are proficient with our audit technology 2. Which best describes your department's technology training for new hires? Formal instructor led training provided by outside party Formal training by existing members of the department On the job training I don't know Other (please specify) 3. Which best describes your department's technology training for current staff? Formal instructor led training provided by outside party Formal training by existing members of the department On the job training I don't know Other (please specify) 4. Does your audit department maintain an inventory of your audit technology tools? Yes No I'm not sure I don't know 5. If yes have you created a matrix linking the tools with the internal audit activities they support? Yes No I don't know
22 2012 State of Technology Use by Auditors 6. Has your audit department performed an assessment of the current use of technology by the internal audit activity? Yes No Maybe I don t know 7. AuditNet has developed an Audit Utilization of Technology Optimization Scale (AUTOS) to measure the maturity level of the use of audit technology by auditors. How would you rate your department on the use of the following audit technologies? None we do not use this technology Informal use of this Intended use of this technology is on an ad technology is planned hoc basis and deliberate Established routine use of this technology for all audits Integrated utilization of all the technologies are coordinated, monitored and evaluated Audit & Resource Scheduling Audit Management Software (e.g. TeamMate, Pentana) Automated Issues Tracking, Follow Up & Reporting Continuous Controls Monitoring Data Analytics (e.g., ACL, IDEA) Electronic Working Papers (e.g. TeamMate, ACL Workpapers) Fraud Detection and Prevention Governance Risk and Compliance Risk Assessment
23 2012 State of Technology Use by Auditors 8. What is your satisfaction with the following audit technology that your department has implemented? Not satisfied Somewhat satisfied Moderately satisfied Completely satisfied N/A Audit & Resource Scheduling Audit Management Software Automated Issues Tracking, Follow Up & Reporting Continuous Controls Monitoring Data Analytics (e.g., ACL, IDEA) Electronic Working Papers Fraud detection and prevention Governance Risk and Compliance (GRC) Microsoft Office (Word, Access, Excel) Risk Assessment 9. How satisfied are you with the extent to which your internal audit function is leveraging the following audit technology tools? Not satisfied Somewhat satisfied Moderately satisfied Completely satisfied N/A Audit & Resource Scheduling Audit Management Software (e.g. TeamMate, Pentana) Automated Issues Tracking, Follow Up & Reporting Continuous Controls Monitoring Data Analytics (e.g., ACL, IDEA) Electronic Working Papers (e.g. TeamMate, ACL Workpapers) Fraud Detection and Prevention Governance Risk and Compliance Risk Assessment
24 2012 State of Technology Use by Auditors 10. Following are reasons cited for not using audit technology. Please indicate whether you agree or disagree with each reason. Agree Disagree Neutral Don't Know The software costs too much(budget constraints) We do not have a budget for audit software training The training times and locations are not convenient The training costs too much The annual support costs too much Audit management does not mandate it's use We don t understand how it can help The software is too complex (steep learning curve) Management does not want to use it Staff does not want to use it Our audit department is too small It is not a required part of the audit planning process We have technology platform incompatibilities There are organizational roadblocks We can't find auditors with experience in using the software
25 2012 State of Technology Use by Auditors 11. Please select from the following factors regarding decisions on integrating technology in your audit process Extremely Important Important Not Very Important Not at all Important N/A Software cost Technology capabilities of our staff Training availability Training costs Staff retention (Retaining trained staff) Making the audit process more efficient Finding fraud Audit Committee (Board support Senior Management support CAE support Requires adjusting our audit work programs 12. Please rank the biggest challenges you face when implementing new audit technology in your department? Insignificant Somewhat significant Significant Very significant N/A Cost of Effort Time to Deploy Training cost Cost of the seat license Cost of the annual maintenance Effort required to maintain the technology Effort required to support the technology Other (please specify)
26 2012 State of Technology Use by Auditors 13. Does your audit department have a plan or strategy that addresses the following: Yes No I don't know The need for automated support of data mining and analysis, continuous monitoring, and other technology based activities Defined technology skill sets, based on an individual knowledge skills and abilities (KSA) inventory identifying gaps Detailed budget requirements to achieve technology related goals Defined benefits of technology investments and activities Ways to measure the effectiveness of technology investments, processes, and activities 14. In terms of the Audit Use of Technology Optimization Scale (AUTOS) where would you rank the maturity level of your internal audit department Level 0 None audit department is assessing needs but can't decide on whether audit technology will benefit the organization. Level 1 Informal ad hoc use. Few if any staff and financial resources are dedicated to audit technology. Success is based on the competence and efforts of one or two champions. Level 2 Intended Audit technology use is planned and deliberate as opposed to being performed on a reactive or as needed basis. Resources are allocated to the practice, responsibilities are assigned, and the process is managed. Level 3 Established Audit technology use is routine and part of the organization s fabric. Level 4 Integrated Audit technology use is evaluated and analyzed. Measures of performance and progress are collected and analyzed.
27 2012 State of Technology Use by Auditors 15. What factors do you see as having the biggest influence on making a paradigm shift to a higher level (towards Integration) on the AUTOS? Not important Slightly important Moderately important Highly important N/A Leadership greater commitment on the part of the CAE to embrace technology Planning having a clearly defined plan setting out realistic goals to move forward Financial resources Greater investment in audit technology and a commitment by the organization to fund it Human resources Hiring the right auditors with technology experience Training ensuring that all staff receive training (internal and external) Vendor One stop solution Incorporating all the audit software tools within a single compatible suite Infrastructure changes within the organization that will allow new technology integration Compensation incentives rewarding innovative use of technology Other (please specify) 16. In your opinion what is the one factor above all others that you see as impacting a paradigm shift in auditors integrating audit technology in their audit function? 5 6
AuditNet 2012 Survey Report on Data Analysis Audit Software Data analysis technology tools provide auditors with tremendous opportunities in today's digital world. However according to the IIA's Global
AuditNet Audit Software Survey 2009 As a new decade dawns, AuditNet survey shows how Internal Audit has adapted to technology through widespread use of audit software Audit Software Survey Summary Results
DEVELOPING AN EFFECTIVE INTERNAL AUDIT TECHNOLOGY STRATEGY SEPTEMBER 2012 DISCLAIMER Copyright 2012 by The Institute of Internal Auditors (IIA) located at 247 Maitland Ave., Altamonte Springs, Fla., 32701,
Transforming your Audit Department through Technology Marilynn Kesslar Consultant National Accounts- TeamMate IIA Survey Focusing on Effective Use of Audit Technology Rate the importance of effectively
Continuous Monitoring and Auditing: What is the difference? By John Verver, ACL Services Ltd. Call them the twin peaks of continuity continuous auditing and continuous monitoring. There are certainly similarities
Chapter 2 Establishing a Quality Assurance and Improvement Program O v e rv i e w IIA Practice Guide, Quality Assurance and Improvement Program, states that Quality should be built in to, and not on to,
01 Executive Summary At the end of the twentieth century and into the twenty-first, higher education has invested, by a conservative estimate, $5 billion in administrative and enterprise resource planning
Moving Internal Audit Back into Balance A Post-Sarbanes-Oxley Survey Fourth Edition Table of Contents Introduction... 1 Executive Summary... 2 Overview of Rebalancing Initiatives... 4 Current Status of
Department of Audit and Compliance Quality Self-Assessment November 2014 CONTENTS EXECUTIVE SUMMARY... 2 PURPOSE OF SELF-ASSESSMENT... 4 SELF-ASSESSMENT SCOPE OF WORK... 4 RESULTS OF SELF-ASSESSMENT WORK...
Internal Audit Practice Guide Continuous Auditing Office of the Comptroller General, Internal Audit Sector May 2010 Table of Contents Purpose...1 Background...1 Definitions...2 Continuous Auditing Professional
A Customer Centricity White Paper 5 Old Coach Road Hudson, NH 03051 603-491-7948 www.customercentricity.biz The Role of Feedback Management in Becoming Customer Centric By Stewart Nash QuestBack Boston
Data Analysis: The Cornerstone of Effective Internal Auditing A CaseWare Analytics Research Report Contents Why Data Analysis Step 1: Foundation - Fix Any Cracks First Step 2: Risk - Where to Look Step
How Effectively Are Companies Using Business Analytics? DecisionPath Consulting Research October 2010 Thought-Leading Consultants in: Business Analytics Business Performance Management Business Intelligence
Internal Audit Quality Assessment Presented To: World Intellectual Property Organization April 2014 Table of Contents List of Acronyms 3 Page Executive Summary Opinion as to Conformance to the Standards,
Metrics by design A practical approach to measuring internal audit performance September 2014 At a glance Expectations of Internal Audit are rising. Regulatory pressure is increasing. Budgets are tightening.
BEST PRACTICES SURVEY: AGGREGATE FINDINGS REPORT Organizational Change Management: Effective Strategies to Drive Implementation Success November 2007 Table Of Contents Program Background and Study Objectives...
ACL EBOOK Connecting the Dots: Building Internal Audit Value Using Technology to Optimize Internal Audit Processes and Increase Audit s Relevance to the Business and C-Suite By John Verver, CA, CMC, CISA,
Use of External Consulting Services Fiscal Years 2007/08 through 2010/11 April 2012 Office of the Auditor General Page 1 Use of External Consulting Services Fiscal Years 2007/08 through 2010/11 March 2012
Accenture Life Sciences Rethink Reshape Restructure for better patient outcomes The Rising Opportunity for CMO-CIO Collaboration in the Pharmaceutical Industry Demographics Life Sciences Pharma/Biotech:
Center for Effective Organizations WHAT MAKES HR A STRATEGIC PARTNER? CEO PUBLICATION G 09-01 (555) EDWARD E. LAWLER III Center for Effective Organizations Marshall School of Business University of Southern
Are CAATs keeping you awake at night? SUMMARY: The importance of using Computer-Assisted Audit Techniques is discussed. A challenge is made regarding the audit profession s traditional methodology. The
The 2012 Data Informed Analytics and Data Survey Table of Contents Page 2: Page 2: Page 4: Page 21: Page 36: Page 39 Introduction Who Responded? What They Want to Know What They Don t Understand Managing
SUSTAINABILITY & EMPLOYEE ENGAGEMENT The State of The Art By John Davies VP Senior Analyst, GreenBiz September 2014 Finding Common Ground with HR Sustainability professionals usually think of their challenges
CRM Expert Advisor White Paper 3 Keys to Preparing for CRM Success: Avoid the Pitfalls and Follow Best Practices Ten years ago, when CRM was nascent in the market, companies believed the technology alone
Top Priorities for Internal Auditors in U.S. Healthcare Provider Organizations Key Areas for Improvement Include Compliance, Information Security, Social Media and Quality Assurance INTRODUCTION Historic
Performance Measures for Internal Auditing A simple question someone may ask is Why measure performance? An even simpler response would be that what gets measured gets done. McMaster University s discussion
Key Trends, Issues and Best Practices in Compliance 2014 What Makes This Survey Different Research conducted by independent third party Clients and non-clients 301 executive decision makers 35 qualitative
Practice guide quality assurance and IMProVeMeNt PrograM MarCh 2012 Table of Contents Executive Summary... 1 Introduction... 2 What is Quality?... 2 Quality in Internal Audit... 2 Conformance or Compliance?...
Enhancing Audit Efficiencies: Maximizing the Use of Technology By Karen Titus, KnowledgeLeader contributing writer To help internal audit departments assess their options for enhancing audit efficiencies,
Internal Audit Quality Assessment Framework May 2013 Internal Audit Quality Assessment Framework May 2013 Crown copyright 2013 You may re-use this information (excluding logos) free of charge in any format
Driving Successful HR Leadership: Talent Management s Role in Core Business Strategy A New Study Exploring What s Working for Organizations Today and the Biggest Gaps to Fill Independent research conducted
Asset Management in the ITSM Industry Prepared by Daniel Wood Head of Research Service Desk Institute Sponsored by Declaration We believe the information in this document to be accurate, relevant and truthful
APICS INSIGHTS AND INNOVATIONS ENHANCING PROJECT MANAGEMENT APICS INSIGHTS AND INNOVATIONS ABOUT THIS REPORT Supply chain project management is a process that allows you to coordinate resources and activities
ACL Audit Management Software Helps Demonstrate Audit Value to Leadership Team New regulations, increasingly stringent compliance requirements, and increased stakeholder expectations are taking a heavy
EMPOWERING SMART DECISION-MAKING THROUGH SMART DATA RECENT BIG DATA INITIATIVES HAVE DRIVEN AGENCIES TO INVEST IN NEW TECHNOLOGIES AND METHODS TO ENHANCE COMPUTING POWER AND INSIGHTS GENERATED BY BIG DATA.
The Resource Management Life Cycle Resource Planning for 2013 Revised November 2012 http://epmlive.com Contents Introduction...2 What is Resource Management?...2 Who Participates in Resource Management?...2
Partnering in the Cloud 2015 ISV REPORT An in-depth look into how today s cloud solution providers create and sustain successful partnerships while empowering customers to move to the cloud. Partnering
Improving Employee Satisfaction in Healthcare through Effective Employee Performance Management Introduction The following quotes are comments made by HR professionals from U.S. healthcare providers who
www.pwc.com/workforce-analytics City and County of Denver 2015 Employee Engagement Survey Prepared for and Presented to the City and County of Denver August 28, 2015 Overview Background Survey Objectives
Health Data Analytics Data to Value For Small and Medium Healthcare organizations HEALTH DATA ANALYTICS WHITE PAPER JULY 2013 GREENCASTLE CONSULTING Abstract This paper is targeted toward small and medium
Final report Investors in People Impact Assessment 2004 Final report Investors in People Impact Assessment By: Charles Michaelis Michelle McGuire Final report Contents 1 EXECUTIVE SUMMARY... 5 1.1 BACKGROUND...5
Process Compliance to Business Excellence A Journey November 2010 This paper discusses the approach to Quality in India s BPO s from the inception years to the current scenario and also offers an insight
WHITE PAPER Best Practices for the Use of Data Analysis in Audit John Verver, CA, CISA, CMC CONTENTS Executive Summary...1 The Evolving Role of Audit Analytics...3 Applications of Audit Analytics...3 Approaches
WHITEPAPER Creating and Deploying Predictive Strategies that Drive Customer Value in Marketing, Sales and Risk Overview Angoss is helping its clients achieve significant revenue growth and measurable return
2014 STATE OF SELF-SERVICE BI REPORT Logi Analytics First Executive Review of Self-Service Business Intelligence Trends 1 TABLE OF CONTENTS 3 Introduction 4 What is Self-Service BI? 5 Top Insights 6 In-depth
Grant Thornton New Zealand Business Risk survey 2012/2013 Delivering value to your company through risk management Contents 4 Executive summary 6 What does a typical risk manager look like? 9 Attitudes
Twelve Ways Healthcare Organizations Are Enhancing Patient Experience A WBR Digital ebook September 2014 Introduction Table of Contents Introduction... 2 Research Findings The Institutionalization of Patient
ECAR Respondent Summary October 2002 Respondent Summary The Promise and Performance of Enterprise Systems in Higher Education Paula King Enterprise system implementations are among the single largest investments
2014 State of Customer Acquisition New acquisition survey findings by Trendline Interactive Research study commissioned by CertainSource an ewaydirect Company INTRODUCTION There is a bit of a schism amongst
Marketing Accountability Study White Paper Presented by 2005 INTRODUCTION It s one thing to ask marketers to justify expenses on their well-researched, thoroughly contemplated marketing programs, especially
White Paper Change Management: Driving the Long-Term Success of Your Workforce Management Solution How Do You Measure the Success of a Technology Project? When your organization embarks on a technology
IT Service Management Description Managing service levels is about understanding the importance of a service and ensuring that resources are available to meet agreed-upon performance expectations. This
The State of Analytics Maturity for Healthcare Providers The DELTA Powered TM Analytics Assessment Benchmark Report - February 24, 2014 - The International Institute for Analytics and HIMSS Analytics iianalytics.com
Training Analytics Market Analysis: How Do Companies Measure Training and ROI? Bersin & Associates Bersin & Associates March, 2005 Bersin & Associates and LTI Magazine 1 August, 2003 Training Analytics:
The 2015 State of the Internal Audit Profession Study Healthcare Internal Audit: In a Time of Transition The healthcare industry in the United States is facing many challenges with the enactment of legislation
Workforce Services Workforce Policy and Planning Department Management/ Human Resource Information Systems Employee Relations Employment Compensation and Workforce Analysis Employee Benefits Organizational
A Forrester Consulting Thought Leadership Paper Commissioned By Microsoft March 2015 Infrastructure As Code: Fueling The Fire For Faster Application Delivery Table Of Contents Executive Summary... 1 Companies
Internal audit value optimization for insurance organizations Webinar May 13, 2015 Baker Tilly refers to Baker Tilly Virchow Krause, LLP, an independently owned and managed member of Baker Tilly International.
Greener Intelligence the Three Stage Approach How to Effectively Implement Change in Your Organisation What Is Change Management? Change management is a structured approach to planning and managing your
Reconciling the Great Healthcare Consumer Paradox: Are consumers willing to change to get what they want? 2 The Affordable Care Act (ACA) will introduce approximately 51 million people to the individual
The Internal Audit Analytics Conundrum Finding your path through data December 2013 At a glance Leading organizations are able to gain significant competitive edge through data. The increasing sophistication
WHITE PAPER Mining for Insight: Rediscovering the Data Archive Sponsored by: Iron Mountain Laura DuBois June 2015 Sean Pike EXECUTIVE SUMMARY In the past, the main drivers for data archiving centered on
G00255396 Digital Marketing Budgets Increase, Reflecting Focus on Customer Experience Published: 9 January 2014 Analyst(s): Laura McLellan Gartner's Digital Marketing Spending Survey shows that digital
CGS Assessment Report: MBA Program 2013-2014 Table of Contents Assessment Process Overview... 2 Assessment Report... 4 Assessment Process... 4 Results: Direct Measures of Student learning... 5 Results:
Mobile Technology Usage and Value: The Perception of Madison Businesses Executive Summary Smartphone usage has increased significantly in the last decade, bringing with it an entirely new field of content
Deloitte and SuccessFactors Workforce Analytics & Planning for Federal Government Introduction Introduction In today s Federal market, the effectiveness of human capital management directly impacts agencies
Recognizing and Rewarding Hospital Employees A Revealing New Study of the Practices and Opportunities of Current Hospital Motivational Programs CURRENT STATE OF AFFAIRS Recognizing and rewarding employees
Successful EHR Change Management Roles and responsibilities White paper Table of contents Executive summary... 2 Introduction... 3 Never underestimate the power of the people... 3 People... 4 From resisting
FPO 2012 Internal Audit Capabilities and Needs Survey 1 2012 Internal Audit Capabilities and Needs Survey Introduction Technology is crucial to administering and managing the audit process from the beginning
IT Owes Much to PMOs Doing More with Less Doing more with less is the mantra of IT organizations reuse and productivity, and nowhere recently have these principles been more effectively applied than in
IT GOVERNANCE SUMMIT OCTOBER, 2015 REALIZING MAXIMUM BENEFITS FROM GOVERNANCE, RISKS AND COMPLIANCE (GRC) TOOLS Presented by Ralph Ugbodu CGEIT, CISA, CRISC, CISSP, CFE, EDRP, ISO 27001 Lead Auditor, COBIT5.
Activity Based Costing: How ABC is Used in the Organization September Background In July, a study was conducted among BetterManagement members to determine the state of Activity Based Costing. An on-line
SourceGas: Earning Customer Satisfaction Through Call Center Powered by SAP Software Partner SourceGas Industry Oil and gas Products and Services Natural gas Web Site www.sourcegas.com SAP s SAP Customer
INCREASING THE STRATEGIC VALUE OF PPM THE KEY TO BUSINESS-DRIVEN PPM SUCCESS BUSINESS-DRIVEN WHITE PAPER SERIES Introduction Every organization has strategic business objectives but those that successfully
Channel Incentive Study- B2B Technology Industry A CCI Report CCI conducted a study in Q4 of 2010 to assess the utilization of various incentive program types and their relative importance and/or effectiveness
BUSINESS CONSULTING SERVICES Comprehensive practice management solutions for independent investment advisors Insights, tools and resources to help you Accelerate Your Growth, Scale Your Business and Elevate
Achieve Economic Synergies by Managing Your Human Capital In The Cloud By Orblogic, March 12, 2014 KEY POINTS TO CONSIDER C LOUD S OLUTIONS A RE P RACTICAL AND E ASY TO I MPLEMENT Time to market and rapid
Recruiting Recovery Finding Hidden Budget Dollars in Optimized Recruiting Practices HRsmart October 3, 2012 2 Introduction Carl Kutsmode Partner Talent Acquisition Management Consultant with over 18 years
Technology Integration and the Service Desk Table of Contents Introduction 1 Key Findings 2 What benefits do you associate with the integration of technologies? 3 When considering your service management
From the SHRM/Globoforce Survey 2015 EMPLOYEE RECOGNITION REPORT CULTURE AS A COMPETITIVE DIFFERENTIATOR RESEARCH REPORT 2015 Employee Recognition Report // 2 EXECUTIVE SUMMARY More than ever, companies
Implementing an ISO 9001 Quality Management System ETI Group This guide to implementing an ISO 9001 Quality Management System (QMS) was prepared by ETI Group. The guide is based on our experiences assisting
Your consent to our cookies if you continue to use this website.