Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit

For Public Auditors Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit 12 th 13 th June 2014, Berlin Brochure With experts from: Swedish National Audit Office General Inspection of Social Affairs (IGAS), France Information and Analysis, Audit Commission, United Kingdom Central Audit Service, Ministry of Finance, the Netherlands Cass Business School, City University London, United Kingdom Directorate General for Audit of European Funds, Ministry of National Economy, Hungary 1

ADVANCED SEMINAR Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit Data Analysis Setting the right course for your audit The amount of information being processed and thus needing to be audited continuously increases. To keep up with this heightened complexity, it is crucial to stay up-to-date on the latest developments in the field and optimise the use of existing tools and procedures. In order to set the right course, a thorough understanding of the different data analysis steps and methods significantly solidifies the basis of both internal and external audits. Choosing the right tools to receive convincing audit results The chosen sampling method is still an important factor when dealing with comprehensive analyses in audit. However, the impact of data analysis software on accuracy and efficiency of audit procedures is vast and an important trend in public auditing. This development cannot be disregarded, whether you are already using advanced software solutions or relying on more traditional applications. Computer Assisted Audit Techniques (CAATs) allow you as an auditor to process great volumes of data. This may lead to the discovery of indications of fraud and other irregularities hidden in the jungle of numbers and spreadsheets or even help to identify benchmarks in value for money audits. When dealing with data analysis, practitioners are often confronted with questions such as: How to best collect data systematically What measures have to be taken when needed data is not available? How can you correctly evaluate sample findings? How do other experienced public institutions handle IT tools in their audits? What are the advantages of continuous auditing? Who is this seminar for? Internal and External Auditors Audit methodologists Audit statisticians Audit experts Controllers Evaluation officers Quality managers Policy makers working in Public administrations on national and regional level Subordinate government bodies Universities and Higher Education Institutes European Institutions and Agencies International Organisations and NGOs especially from the following departments Internal Audit Internal Oversight Inspection Financial Control Management Support Quality Assurance International Cooperation This seminar might be also interesting for private audit companies working with and for the public sector. Consolidate and deepen your knowledge on the different evidence collection methods presented in this advanced seminar and identify the optimal procedure for each of your comprehensive audit missions. 2

What will you learn at this seminar? How can you determine inherent and control risks for your management and control system? How to calculate the confidence level Which sampling method is the adequate choice for my audit? How to determine the sample size What are the benefits and challenges of different data-gathering tools? Which review technique is of the greatest value in which audit situation? How do you evaluate your findings correctly? What can you do when data is nonexistent? How can the right data analysis method improve your value for money audits? How to analyse data most effectively Your benefits Familiarise yourself with the toolkit for public auditors Get well-rounded audit results Improve the quality of your audit findings Be proactive Professionalise audits in your organization Gain valuable insight into internal audit practices in other countries and institutions Benefit from best practice examples Get in-depth knowledge of the most important engagement tools for auditors in the public sector Consult your individual questions and problems with our experts and receive practical advice and real solutions for your audits Network and exchange experiences with our experts and international colleagues who deal with public sector audits Which advantages does continuous auditing have for your institution? Interesting and helpful practical examples! Highly relevant topics. 3

PROGRAMME DAY 1 Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit 8.30-9.00 Registration and Handout of Seminar Material 9.00-9.05 Opening Remarks from the European Academy for Taxes, Economics & Law 9.05-9.30 Welcome Note from the Chair and Round of Introductions Dimitrios Ioannidis, Audit Coordinator, Swedish National Audit Office 9.30-10.15 Auditing Strategies for Data Access and Data Presentation Key factor in Auditing: Data Analysis What to do when data is nonexistent A difficult situation: When data needs to be presented in different ways than has been done by the audit object Dimitrios Ioannidis, Audit Coordinator, Swedish National Audit Office The views expressed in his presentation are solely those of the speaker himself and do not represent the official position of the Swedish National Audit Office. 10.15-10.30 10.30-11.00 Coffee Break and Networking Opportunity Case Study 11.00-11.45 Handling Data: Lessons Learnt in Four Cases DIMITRIOS IOANNIDIS Audit Coordinator, Swedish National Audit Office Since 2006, Dimitrios Ioannidis is Audit Coordinator at the Swedish National Audit Office. He has audited procurement processes linked to the sale of state owned companies as well as the purchase of IT and telecom services in the government sector. In 2005, he was Secretary in a Government of Committee, dealing with the review of the Swedish National Premium Pension system. Between 2001 and 2006, he was Economist at the Financial Stability Department of the Central Bank of Sweden, and participated in the procurement of a new system for the settlement of large payments. Between 1990 and 2001, he was researcher and lecturer at the Stockholm School of Economics. His research focused on the importance of buyer/seller relationship for industrial and corporate development. The views expressed in his presentation are solely those of the speaker himself and do not represent the official position of the Swedish National Audit Office. MARK BURKETT Performance Analyst, Information and Analysis, Audit Commission, United Kingdom Mark Burkett joined the Audit Commission in 2001 and has worked on a range of programmes. These include value for money research, developing audit and inspection methodologies and combining statistical analysis and data management in online tools. Prior to joining the Commission, he worked in a number of English local authorities and as an auditor specialising in performance work. A state s ownership of digital infrastructure The state as a user of IT and communication services Regulatory decisions of a Post and Telecom Authority (PTS) Delays in a railway system Dimitrios Ioannidis, Audit Coordinator, Swedish National Audit Office The views expressed in his presentation are solely those of the speaker himself and do not represent the official position of the Swedish National Audit Office. 11.45-12.00 12.00-12.45 Using Public Data to Profile Local Authorities for an Optimised Value for Money Audit How profiles of local authorities were created to support a programme of value for money (VFM) audit Development of profiles in response to changes in audit methodology Steps required to build and operate the VFM profiles Lessons learnt Mark Burkett, Performance Analyst, Information and Analysis, Audit Commission, United Kingdom 12.45-13.00 4 13.00-14.00 Lunch Break and Networking Opportunity

Case Study 14.00-14.45 Developing and Using Benchmarks as Part of Value for Money Audit Access to comparative data Using data to develop benchmarks Identifying and understanding key features of data Applying benchmarks based on the key features of data Limitations of statistical exercise Mark Burkett, Performance Analyst, Information and Analysis, Audit Commission, United Kingdom WIM SLOT Audit Manager, Central Audit Service, Ministry of Finance, the Netherlands Since 1995, Wim Slot is involved in the audit of the accounts of the Dutch Ministry of Foreign Affairs. This includes the commitments and expenditures for development cooperation, which is the largest part of his audit work. Started as just graduated auditor, he became an audit manager in 1997 and senior audit manager in 2002. For several years he has been member of the technical committee within the Central Audit Service. In this position Wim Slot contributed to the audit manual that was written in 2011. 14.45-15.00 15.00-15.30 Coffee Break and Networking Opportunity 15.30-16.15 How ISA 530 is Applied in the Audit of a National Government Best Practice Place of statistical sampling in the audit risk model Evaluation of findings Impact of corrections on the evaluation Difference of most likely error and upper error limit Wim Slot, Audit Manager, Central Audit Service, Ministry of Finance, the Netherlands 16.15-16.30 16.30 End of Day One 5

PROGRAMME DAY 2 Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit 9.00-9.15 Welcome Note from the Chair Andrew Robertson, Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom 9.15-10.00 Handling Data Samples Introduction to sampling (definitions, principal features of the population, characteristics, stratification) Statistical and non-statistical approach to sampling Statistical terminology Risk analysis Statistical sampling methods (MUS) Evaluation of the audit results Marianna Miklós-Molnár, Director of Strategy and Methodology, Directorate General for Audit of European Funds, Ministry of National Economy, Hungary 10.00-10.15 10.15-10.45 Coffee Break and Networking Opportunity 10.45-11.30 Using Computer Assisted Audit Techniques (CAAT) in the Audit Process The benefit of using CAATs Most widely used CAATs Data Analysis Pros and cons of the different IT tools Big data Andrew Robertson, Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom 11.30-11.45 MARIANNA MIKLÓS- MOLNÁR Director of Strategy and Methodology, Directorate General for Audit of European Funds, Ministry of National Economy, Hungary Marianna Miklós-Molnár has been working at the Hungarian Ministry of National Economy for many years. During this period as Auditor she has been involved in sample and system audits and risk analyses related to ERDF, ESF and CF funding. Since 2008, Marianna Miklós-Molnár has been involved in strategy development, sampling, planning and reporting activities. In 2010, she was appointed Director of Strategy and Methodology within the Directorate General for Audit of European Funds. ANDREW ROBERTSON Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom Andrew Robertson has over 35 years experience in auditing and risk management, covering manufacturing, retail, financial services and the not for profit sectors. He has been Head of Audit in several blue chip organisations, and Head of Risk in two organisations. During this time, he has been instrumental in both uncovering and resolving many organisational problems. He is a Senior Visiting Fellow at Cass Business School and until recently was managing and delivering modules on audit and risk related topics to MSc students at the Business School. Andrew Robertson delivers lectures and workshops in risk and audit related areas, particularly in fraud detection and prevention as well as the establishment of risk management systems. He has worked extensively in developing and transition, including China, Hungary, Poland, Romania, Slovakia and South Africa. His most recent assignments have been on behalf of the Commonwealth Secretariat to Trinidad, Barbados and Mauritius, and with the World Bank in Ghana. His work has taken him to 60 countries. A great opportunity to exchange experiences with other experts. 6 To the point.

Case Study 11.45-12.30 Use of CAAT (IDEA ) by a Non Specialised Auditor in Three Different Contexts Presentation of IGAS, nature of missions, auditor profile a long term but non frequent use of the tool in non repetitive audits Use in the case of child protection by local authorities Use in the case of procurement audit Use in the case of the audit of asset management by retirement pension funds Pros and cons of using a data extraction and analysis software, conditions of an efficient use Pascal Penaud, Inspector General, General Inspection of Social Affairs (IGAS), France 12.30-12.45 12.45-14.00 Lunch Break and Networking Opportunity 14.00-14.45 Continuous Monitoring and Audit in Public Institutions Principles of continuous auditing Bridging the assurance gap 3 lines of defence Differences between sampling and continuous auditing Advantages of continuous monitoring and audit Arising risks and how to avoid them Andrew Robertson, Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom 14.45-15.00 15.00-15.30 Coffee Break and Networking Opportunity 15.30-16.15 Using IT Systems for Risk Based Internal Auditing Added value through risk based internal audit Aligning the risks with the organisation s goal Risk management and IT developments Andrew Robertson, Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom ANDREW ROBERTSON Senior Fellow, Faculty of Management, Cass Business School, City University London, United Kingdom Andrew Robertson has over 35 years experience in auditing and risk management, covering manufacturing, retail, financial services and the not for profit sectors. He has been Head of Audit in several blue chip organisations, and Head of Risk in two organisations. During this time, he has been instrumental in both uncovering and resolving many organisational problems. He is a Senior Visiting Fellow at Cass Business School and until recently was managing and delivering modules on audit and risk related topics to MSc students at the Business School. Andrew Robertson delivers lectures and workshops in risk and audit related areas, particularly in fraud detection and prevention as well as the establishment of risk management systems. He has worked extensively in developing and transition, including China, Hungary, Poland, Romania, Slovakia and South Africa. His most recent assignments have been on behalf of the Commonwealth Secretariat to Trinidad, Barbados and Mauritius, and with the World Bank in Ghana. His work has taken him to 60 countries. PASCAL PENAUD Inspector General, General Inspection of Social Affairs (IGAS), France Since 2003, Pascal Penaud is Inspector General at the Inspection Générale des Affaires Sociales (IGAS) which is an inter-ministerial audit and evaluation office for social, health, employment and labour policies that assists public players in making informed decisions. As Inspector General, he is also responsible for auditing public procurement in various major French hospitals as well as social ministries. Prior, Pascal Penaud was Head of the information system department of the Ministry of Health. For his diverse audit assignments he has been using the audit software IDEA since 1998. 16.15-16.30 Final 16.30 End of Seminar and Handout of Certificates 7

ORGANISATIONAL MATTERS Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Audit Date of Event 12 th 13 th June 2014, Berlin Booking Number S-787 Event Language The event language will be English. Event Price 1.389,- Euro excl. German VAT (19%) The above price covers the following: Admission to the seminar Hand-out documents Seminar certificate, if seminar fully attended Soft drinks and coffee/tea on both event days Lunch on both event days Upon request you can receive a digital version of the seminar documents after the event for 60,- Euro excl. German VAT (19%) in addition to the seminar. BOOKING E-mail: booking@euroacad.eu Phone: +49 (0)30 80 20 80 230 Fax: +49 (0)30 80 20 80 250 For online booking please visit our website: www.euroacad.eu Contact European Academy for Taxes, Economics & Law At Potsdamer Platz, Entrance Leipziger Platz 9, 10117 Berlin, Germany Phone: +49 (0)30 80 20 80 230 Fax: +49 (0)30 80 20 80 250 E-mail: info@euroacad.eu Internet: www.euroacad.eu Your contact persons for the programme: Regina Lüning, M. Sc. econ. Head of Marketing and Sales Phone: +49 (0)30 80 20 80 246 Fax: +49 (0)30 80 20 80 259 E-mail: regina.luening@euroacad.eu Laura Hentz M.A. Conference Manager Phone: +49 (0)30 80 20 80 244 Fax: +49 (0)30 80 20 80 259 E-mail: laura.hentz@euroacad.eu (Programme is subject to alterations) Event Location Maritim Hotel Berlin Stauffenbergstraße 26 10785 Berlin, Germany Phone: +49 (0)30 2033 4410 Fax: +49 (0)30 2033 4092 E-Mail: info.ber@maritim.de Internet: www.maritim.de Please contact the hotel directly and refer to the European Academy for Taxes, Economics & Law if you wish to benefit from a limited room availability-contingent. Of course you can always look for an alternative hotel accommodation. 8

BOOKING E-mail: booking@euroacad.eu Fax: +49 (0)30 802080-250 Phone: +49 (0)30 802080-230 For online booking please visit our website: www.euroacad.eu European Academy for Taxes, Economics & Law at Potsdamer Platz Entrance: Leipziger Platz 9 10117 Berlin / Germany BOOKING BOOKING NUMBER: S-787 (PR) 12 th - 13 th JUNE 2014, BERLIN Herewith we register the following persons for the Advanced Seminar: Data Analysis Tools: Sampling Methods, Use of CAAT, IT Systems for Risk Based Delegate 1 Ms. Mr. First name Last name Your organisation Department Unit Job position Street Postcode / City Country Delegate 2 Ms. Mr. First name Last name Your organisation Department Unit Job position Street Postcode / City Country Delegate 3 Ms. Mr. First name Last name Your organisation Department Unit Job position Street Postcode / City Country Phone Fax E-mail Phone Fax E-mail Phone Fax E-mail I hereby order the digital version of the seminar documents (fee required) in addition to the seminar. I hereby order the digital version of the seminar documents (fee required) in addition to the seminar. I hereby order the digital version of the seminar documents (fee required) in addition to the seminar. Invoice Organisation First name Your Organisation Department Unit Job Position E-mail Ms. Mr. Last name Street Postcode / City Country Phone Fax With my signature I confirm my registration and accept the General Terms and Conditions as legally binding. I herewith agree to receive further information from the European Academy for Taxes, Economics & Law In case of registration of more than one delegate do you prefer: single invoice? collective invoice? NOTE Only Valid with Signature and Stamp. Place, Date Authorised Signature and Stamp European Academy for Taxes, Economics & Law Brauner Klingenberg GmbH Leipziger Platz 9 10117 Berlin Phone +49 (0)30 80 20 80 230 Fax +49 (0)30 80 20 80 259 9

Terms & Conditions for Conferences, Seminars and other Training Courses 1. Area of Application The following terms and conditions settle the contractual relationship between conference participants and the European Academy for Taxes, Economics & Law Brauner Klingenberg GmbH [referred to as European Academy for Taxes, Economics & Law in the following]. Differing terms and conditions, as well as, other settlements and/or regulations have no validity. 2. Registration / Confirmation of Application A registration can be made via internet, mail, fax, or email. The registration is considered granted and legally binding if not rejected by the European Academy for Taxes, Economics & Law in writing within seven (7) days after receipt of registration. The registration will be supplemented by a booking confirmation via email. Partial bookings are only valid for seminars designed in modules. 3. Service The course fee covers the fee per participant and course in net, subject to current German VAT. It includes training course documents as per course description, a lunch meal/ snack and refreshments during breaks, as well as, a participation certificate. The European Academy for Taxes, Economics & Law has the right to change speakers/instructors and to modify the course program if and where necessary while maintaining the overall nature of the course. All registered participants will be notified in case of a course cancellation due to force majeure, due to speakers preventions, due to troubles at the chosen location or due to a low registration rate. Course cancellation notification due to a low registration rate is issued no later than two (2) weeks before the course date. Course fees are reimbursed in the cases listed above; however, reimbursement for travel expenses or work absenteeism is only granted in cases of intention or gross negligence by the European Academy for Taxes, Economics & Law. Any reimbursement of travel expenses are to be considered as an exceptional goodwill gesture and form no future general obligation. In case of disturbances and/or interruptions, the European Academy for Taxes, Economics & Law commits itself to solve or limit any problems that might occur in order to maintain and continue the course as planned. 4. Payment Date and Payment, Default of Payment Payment of the course fee is payable immediately upon receipt of invoice. Where payment is not received or lacking clear assignment to a participant prior to commencement of the course, the European Academy for Taxes, Economics & Law may refuse the relevant participant s participation in that course. The course fee, however, is still due immediately and can be claimed as part of a dunning procedure or legal action. In accordance with BGB 247 (1), in case of default of payment within the stipulated time period, default interest on arrears of at least 5% above the ECB base rate is due and payable. The European Academy for Taxes, Economics & Law can claim higher damage for delay if and where proven. Equally, the participant may prove that a damage has not occurred or has had less effect than estimated by the European Academy for Taxes, Economics & Law. Payment shall be made by cashless bank transfer; cash or cheques will not be accepted. The European Academy for Taxes, Economics & Law is not liable for any loss of means of payment. The participant may only offset such claims against the European Academy for Taxes, Economics & Law s as are undisputed, legally recognized or recognized in writing by the European Academy for Taxes, Economics & Law. The right of retention is only acceptable in accordance with a counterclaim based on the same contract. 5. Cancellation Cancellations need to be issued in writing. Cancellation by the participant will be subject to cancellation charges as follows: 30 days or more prior to commencement of the course: service charge of 80,00 net, subject to current German VAT, payable immediately, course fee will be reimbursed, two (2) weeks to 30 days prior to commencement of the course: 50% of course fee net, subject to current German VAT, payable immediately, non-attendance or cancellation less than two (2) weeks prior to commencement of the course: 100% of course fee net, subject to current Germany VAT, payable immediately The European Academy for Taxes, Economics & Law gladly accepts without additional costs a substitute participant nominated in case of a cancellation if the substitute participant is registered at least three (3) days prior to the commencement of the course. Neither cancellation of a specific module/part of the course or substitution per module/per day is possible. 6. Copyright Seminar/course documents are protected by property rights and may not be duplicated, processed, amended, circulated or published in any other way without the written consent of the European Academy for Taxes, Economics & Law. The European Academy for Taxes, Economics & Law reserves all rights. 7. Liability All seminars and courses are prepared and presented by qualified speakers and instructors. The European Academy for Taxes, Economics & Law accepts no liability for the upto-dateness, correctness and completeness of the seminar documentation, as well as, presentation of the seminar. 8. Applicable Law, Place of Jurisdiction, Place of Performance All cases shall be governed and construed in accordance with German law to the exclusion of the UN Sales Convention. As far as legally admissible, place of performance and place of exclusive jurisdiction shall be Berlin, Germany. 9. Data Protection The European Academy for Taxes, Economics & Law protects personal data by taking appropriate protection measures. For the purpose of optimization of the product and service portfolio and according to the regulations of the data privacy laws, it stores and processes person-specific data on the training participants. Hence, all European Academy for Taxes, Economics & Law website hits are registered. All personal data will, in accordance with the law, be used for documentation requests, placed orders or other enquiries in order to send information out by post. The European Academy for Taxes, Economics & Law will, in accordance with the law, inform participants by email about special offers that resemble previously booked seminars. If and where personal data needs to be transferred to countries lacking appropriate data protection schemes, the European Academy for Taxes, Economics & Law shall grant alternative adequate protection. Furthermore, the European Academy for Taxes, Economics & Law will use personal data as far as participants have granted respective permission. When collecting personal data, the European Academy for Taxes, Economics & Law will always ask for permission regarding email information about offers. The participant may, at any time, express their objection to data collection for the purpose of advertisement or address via email or fax. Any data provided to the European Academy for Taxes, Economics & Law will be processed for reservations and bookings, as well as, for information about other seminars. Names and company names will be published in a participants list and forwarded to the mailing company. 10