Live Event Count Issue
|
|
- Dayna Shaw
- 8 years ago
- Views:
Transcription
1 Appendix 3 Live Event Document Version 1.0
2 Table of Contents 1 Introduction and High Level Summary Details of the Issue Timeline of Technical Activities Investigation on Count Day and Remedial Action Taken SQL and Manual Report Creation Process Data Structures and SQL Manually Created Result Example Investigation following Count Day Data Analysis System Diagnosis and Root Cause Analysis Stored Procedure : Dashboard_GetBallots Investigation into why data order is modified Previous Testing Coverage and comparison Analysis of Recent System Changes Document Change Summary.173 Page 2 of 21
3 1 Introduction and High Level Summary This document describes the issue that occurred on the day of the count which delayed the announcement of the results of the Mayor contest. It also provides details of the remedial action taken on the night of the count, the follow-up investigations after the count, and the findings of the investigation. The summary of the issue is that minor discrepancies were identified in the first set of Constituency Level Mayor Contest Final reports. Manual extraction of data and re-creation of reports allowed the accurate count data to be announced on the night. Analysis of previous test data shows that the issue was not present in UAT reports nor any of the Kit Readiness reports. Analysis of system changes (application code, database schema [including indices, views, and stored procedures], server patch levels, etc.) show no modifications since UAT. The root cause of the issue has been established to be the incorrect construction of the vote matrix due to data extracted from the database being in an unexpected order. The reason has been identified as a pre-existing code defect which was also present in 2012, which combined with a subsequent change to the database server configuration in 2015 (specifically SQL Server Max Degree Of Parallelism) resulted in the ordering of the data during the calculation of the mayoral figures to be incorrect in 2016 compared with The issue was not evident in the 2012 election because this combination of conditions was not present. The underlying code in this area has not changed since The server settings used in 2015 & 2016 followed industry best practice guidelines. No such guideline existed in Analysis of previous test data shows that the issue did not occur in UAT or Kit Readiness. The reason for this is that there is a Cost Threshold parameter which triggers the use of parallelism in SQL Server. The smaller datasets in UAT and Kit Readiness required a lower calculated execution cost which fell below the cost threshold required to invoke parallelism and without this being executed the data was returned in the expected order. Page 3 of 21
4 2 Details of the Issue Discrepancies were found in the Final Results report for the Constituency level London Mayor contest. The first discrepancy found was that the Total Number Of Ballot Papers Counted did not add up to the Total Number Of Good Votes plus the Total Number Of Ballots Rejected. The second discrepancy found was that the numbers of First Preference and Second Preference votes for candidates differed each time the Final Results report was run. It was found that the Total Number Of Ballot Papers Counted and the Total Number Of Ballots Rejected figures were constant, but the Total Number Of Good First and Second Preference Votes was variable. The following abbreviated screenshots illustrate the issue. Bexley and Bromley Final Report taken at 14:53:51 In the example above, the number of good votes for 1 st preference (189,027) when added to the number of ballots rejected (2,890) give a total of 191,917 which is again not equal to 191,514. Page 4 of 21
5 Bexley and Bromley Final Report taken at 15:13:00 In the example above, the number of good votes for 1 st preference (189,066) when added to the number of ballots rejected (2890) give a total of 191,956 which is not equal to 191,514. In both examples of the report, 1. The Total Number of Ballot Papers Counted is constant at 191, The Total Number Of Ballots Rejected on 1 st preference is constant at Not shown, but the Total Number Of Ballots Rejected on 2 nd preference is constant at 25, The number of good plus number rejected in both 1 st and 2 nd preference does not match the total number of ballots. Page 5 of 21
6 3 Timeline of Technical Activities The following is a description of the events that occurred from identification of the issue to publication of results to GLA. The times provided are in some cases estimates. Time Description 16:00 The second set of constituency mayor results from Lambeth and Southwark triggered the start of the investigation 16:00 18:45 Consulted with ERS on report discrepancy. Checked data for Bexley and Bromley as well. Confirmed that the sum of the 1 st preference votes + bad 1 st preference votes was not equal to total number of ballots. Investigation into possible causes of data changing. Initial suspicion on the error at this stage was either: - a central consolidation error, - a local count-site consolidation error - an error in the dataset sent to central site Connected to Bexley and Bromley database and extracted the frozen vote matrix from there. Transposed all 1 st preference votes onto paper and totalled them. Concluded that the votes sent to central site (which should have matched the votes in the frozen vote matrix and the votes on the Final Bexley and Bromley report) did not and were in fact short by the exact difference on the central report Additional information was received regarding suspected errors output to the log files information was that totals were different each time the report was run, it was not clear at this stage exactly how these totals were derived Additional information was received stating that provisional reports had been run 3 times and each time they had different data. It was confirmed that no processing was in progress at the count site, i.e. that the data should now be static. Investigation into why the data is changing, suggested possibilities at this time included; MSMQ backlog, incomplete blocked transactions, being hacked. Database trace applied to identify any instances of data updates this confirmed that no data was being updated. Inspected MSMQ nothing on the queues Concluded that it must be a consolidation issue. Started code inspection in this area targeting code suggested by log file output. This area of the code was not familiar to the technical team and there was no immediately obvious cause. 18:50 A decision was made following the 18:50 executive meeting with GLA to manually query the database to produce the data required. 18:50 to 20:25 Generation of SQL to produce manual data to identify total votes per constituency, per candidate, and by preference (1 st or 2 nd ). Checking of data produced. This was done by sanity checking against the SQL in the core product used to generate the vote matrix. 20:25 20:35 1 st preference data produced from SQL 20:41 20:45 2 nd preference data produced from SQL Page 6 of 21
7 20:40 21:25 Generation of SQL to produce manual data for 2 nd preference data for Goldsmith and Khan per constituency, per candidate. 21:29 21:34 2 nd preference data for Goldsmith and Khan produced from SQL 21:40 22:00 Generation of SQL to produce manual data for 1 st preference = 2 nd preference data 22:16-22:42 Data for counts of votes where 1 st preference = 2 nd preference produced from SQL Page 7 of 21
8 4 Investigation on Count Day and Remedial Action Taken The technical team were informed of the issue and immediately started to investigate for possible causes. This took on 2 streams of activity; one to trace back the code for the generation of the final report and one to manually query the database to check the numbers. It was discovered that 1. the underlying data stored in the database was correct. This was confirmed by the comparison of the underlying data extracted using independent SQL queries with the data extracted by the stored procedure, as explained below. 2. there was a problem in the way in which the data for the 1 st and 2 nd preference votes for candidates was being extracted and aggregated by the code module. The exact nature and root cause of this problem was not identified on the night 4.1 SQL and Manual Report Creation Process SQL was generated to extract data for the 1st and 2nd preference votes for candidates from the raw table data. This SQL was created independently of the e- Counting system, reviewed by peers, the output was checked against raw data extracted from the live stored procedure (i.e. prior to aggregation via code), then separately checked by ERS. The results were accurate. The SQL generated was stand-alone and did not change the e-counting system or the data within it in any way. The reports were constructed manually using Excel, data cross-checked, converted to PDF, and delivered to GLA Data Structures and SQL The core data for determining the results is contained in 4 tables; Contest, Ballot, Vote, and Candidate. The following diagram depicts the relationships between Contest, Ballot, and Vote. The candidate is referenced via ContestID and CandidateNumber. Page 8 of 21
9 The example outputs shown in this document are for Bexley and Bromley. Although the values for Total Number of Ballot Papers Counted was consistent across the reports, we cross-checked this using the following SQL: The output from this is as follows for Bexley and Bromley: The SQL to generate the 1 st Preference votes per candidate is as follows: The output from this query inserted into Excel and then summed shows the values: Page 9 of 21
10 The total values for each of these match the total 1 st preference votes presented in the corresponding Constituency Level Mayor Contest Final reports generated from the e-counting system. The individual candidate values did not match; the ones presented in the systemgenerated reports were variable. At this point we cross-checked the figures from our independently generated SQL with a very slightly modified version of the stored procedure Dashboard_GetBallots SQL: This SQL produced the following output from the Results and Messages tabs; the results showing that the number of records for 1 st preference is 188,624 which matches the total number from our independent SQL output: Page 10 of 21
11 This provided confidence that the underlying data from the stored procedure was accurate. We then extracted the dataset into Excel, removed the BallotId column, leaving the CandidateNumber and Choice (=1) entries. This was then pivoted by CandidateNumber to sum the Choice values and this presented the data shown below: This matches exactly the data we produced independently for 1 st choice preferences. At this stage we could potentially have made the correlation between the sort order being incorrect, but everyone was so intensely involved in generating the data, checking for the root cause had been set aside. The SQL to generate the 2 nd Preference votes per candidate is as follows: Page 11 of 21
12 The output from this query inserted into Excel and then summed shows the values: We repeated the process of checking these against the slightly modified stored procedure SQL for 2 nd preference votes, checking the output, exporting to Excel and pivoting by candidate number: Page 12 of 21
13 This matches exactly the data we produced independently for 2nd choice preferences. The SQL to generate the raw data for the matrix of count of 2 nd preference votes per candidate based on 1 st preference candidate vote is as follows: Page 13 of 21
14 An extract from the output from this SQL is as follows: This SQL was executed for each constituency and the data copied into a text file and delivered to ERS who then checked the data for consistency. This output was also pasted into an Excel spreadsheet and then totals were calculated per row. This produced an output as seen from the extract below. Page 14 of 21
15 The highlighted cells above show the count of 2 nd preference votes for candidate 1 (Sian Rebecca BERRY) which totals to The columns were summed to provide a count of the total number of good 2 nd preference votes for the constituency: The overall number of 2 nd preference votes for Bexley and Bromley is It is also noted that the grand total of 2 nd preference votes across all constituencies is Page 15 of 21
16 4.2 Manually Created Result Example The abbreviated screenshot below shows the correct data extracted. Page 16 of 21
17 5 Investigation following Count Day 5.1 Data Analysis Further analysis of the data established that for each candidate the sum of the votes for 1 st and 2 nd preference was always constant: Brent & Harrow Final Report taken at 16:56:22 Brent & Harrow Final Report taken at 17:11:44 It can be seen that for the first candidate the total votes for 1 st + 2 nd preference always add up to Similarly for the second candidate the total is always System Diagnosis and Root Cause Analysis Backups of the databases were restored to test systems and the code was debugged to identify the root cause of the problem. It was established that the construction of the votes matrix relies on a dataset returned from a stored procedure to be in a specific order; ordered by BallotID (a unique sequential identifier for individual ballot papers, and which is a key into the table to identify other attributes of the Ballot, e.g. barcode, batch, etc., and to enable linking to other tables such as Contest and Vote). However, the stored procedure Dashboard_GetBallots which extracts the data for the construction of the vote matrix does not specify an ORDER BY clause and this can cause the code method to calculate the 1 st and 2 nd preference values incorrectly. The source code repository shows that the specific code module, stored procedure, underlying tables and indexes have not been modified since SQL Server does not guarantee the order of dataset output unless there is a specific ORDER BY clause. Extract: Page 17 of 21
18 5.2.1 Stored Procedure : Dashboard_GetBallots It can be seen from above that the query does not specify an ORDER BY clause. The stored procedure was modified in the test environment to include an ORDER BY clause as follows: ORDER BY BallotId The final reports were then re-run several times and it was seen that the data matched the output produced manually on the night of the count every time. This proves that the root cause of the issue is that the data was not sorted as expected when retrieved from the database Investigation into why data order is modified Further investigation showed that there had been no significant changes to the code or database in these areas since 2012 and therefore we looked into what could cause the data order to be changed. The investigation identified some examples reported on SQL Server forums for when this scenario can occur: 1. An unordered index scan might be carried out in either allocation order or key order dependant on the isolation level in effect. 2. The merry go round scanning feature allows scans to be shared between concurrent queries. Page 18 of 21
19 3. Parallel plans are often non deterministic and order of results might depend on the degree of parallelism selected at runtime and concurrent workload on the server. 4. If the plan has nested loops with unordered pre-fetch this allows the inner side of the join to proceed using data from whichever I/Os happened to complete first The most relevant point from above is #3. SQL Server database server settings for Parallelism can have an impact on the execution plan and if parallelism is used the load of the query is spread across multiple processors which, when aggregated together to produce the results, increases the chance that the order is uncertain. There are 2 main settings that are related to Parallelism in this context: 1. Max Degree Of Parallelism (MDOP): This limits the number of processors to use in parallel plan execution. There are 3 sets of values that cause difference in operation: 0: This will utilise as many processors as are available and therefore may use parallelism 1: This will only utilise 1 CPU and will effectively disable parallelism. 2-n: This will utilise as many processors as specified [if available] and therefore may use parallelism 2. Cost Threshold For Parallelism: This value is used to specify a value that will be compared to the estimated cost of the query to determine whether or not to use a parallel plan. This is used in conjunction with MDOP. The effect of changing the settings can be seen in the execution plans for the core SQL for the Dashboard_GetBallots stored procedure. No Parallelism (MDOP=1): Page 19 of 21
20 Parallelism (MDOP=2): The 2016 setting for Max Degree Of Parallelism was 2. The SQL Servers used in the e-counting system were all virtual servers and all had 4 vcpus. This setting is in line with Microsoft s recommended guidelines. Using the setting MDOP=1 (disable parallelism) and running the reports with the original version of the stored procedure produced the correct results. To summarise the sort order investigation, there is a missing ORDER BY clause in the stored procedure, and had this been in place, under any of these circumstances it would have guaranteed the correct report data. The SQL Server settings for MDOP were different in 2016 from 2012 and this is believed to have resulted in the data order change and the problems found in the reports. 5.3 Previous Testing Coverage and comparison The results from the UAT testing were analysed in detail to check if this specific issue occurred during UAT; it did not occur in the UAT system; all reports were accurate. Small datasets; specifically UAT and Kit Readiness did not benefit from parallelism based on cost threshold not being exceeded, and that the query execution plan was simpler and did not modify the order of the data. Load testing was also undertaken. The aim of load testing was to confirm that the system would support the number of transaction throughput levels and ensure that there were no application, server and network performance bottle necks. Random images were processed by the test robots and at no point were there a set of known results to analyse. However, similar investigations on that dataset with MDOP settings enabling parallelism show that the issue would have been present. 5.4 Analysis of Recent System Changes Other than QA Scanning modifications, no software changes have been made since 14-Oct-15 (version ) prior to UAT and the gold build was produced on 13- Jan-16 from this version. Security patches were applied to servers up to 23-Feb-16. These are listed here Page 20 of 21
21 All desktops and scanners retained system levels as of UAT. SQL Server version was for UAT and upgraded to prior to Kit Readiness. The change to the SQL Server configuration MDOP setting was as a result of setting up SQL Server in 2015 & 2016 according to industry best-practice guidelines. We cannot determine the guidelines followed in 2012 as we have not retained the originally installed systems from that time and this setting is not preserved in backups. Page 21 of 21
Data Integrator Performance Optimization Guide
Data Integrator Performance Optimization Guide Data Integrator 11.7.2 for Windows and UNIX Patents Trademarks Copyright Third-party contributors Business Objects owns the following
More informationMS SQL Performance (Tuning) Best Practices:
MS SQL Performance (Tuning) Best Practices: 1. Don t share the SQL server hardware with other services If other workloads are running on the same server where SQL Server is running, memory and other hardware
More informationDBMS / Business Intelligence, SQL Server
DBMS / Business Intelligence, SQL Server Orsys, with 30 years of experience, is providing high quality, independant State of the Art seminars and hands-on courses corresponding to the needs of IT professionals.
More informationSQL Databases Course. by Applied Technology Research Center. This course provides training for MySQL, Oracle, SQL Server and PostgreSQL databases.
SQL Databases Course by Applied Technology Research Center. 23 September 2015 This course provides training for MySQL, Oracle, SQL Server and PostgreSQL databases. Oracle Topics This Oracle Database: SQL
More informationPerformance rule violations usually result in increased CPU or I/O, time to fix the mistake, and ultimately, a cost to the business unit.
Is your database application experiencing poor response time, scalability problems, and too many deadlocks or poor application performance? One or a combination of zparms, database design and application
More informationOracle Database: SQL and PL/SQL Fundamentals NEW
Oracle University Contact Us: 001-855-844-3881 & 001-800-514-06-97 Oracle Database: SQL and PL/SQL Fundamentals NEW Duration: 5 Days What you will learn This Oracle Database: SQL and PL/SQL Fundamentals
More informationLICENSING MANAGEMENT SERIES. A Guide to Assessing Windows Server Licensing
LICENSING MANAGEMENT SERIES A Guide to Assessing Windows Server Licensing July 2010 This document provides customers of Windows Server 2003, Windows Server 2003 R2, Windows Server 2008, and Windows Server
More informationSECTION 4 TESTING & QUALITY CONTROL
Page 1 SECTION 4 TESTING & QUALITY CONTROL TESTING METHODOLOGY & THE TESTING LIFECYCLE The stages of the Testing Life Cycle are: Requirements Analysis, Planning, Test Case Development, Test Environment
More informationPUBLIC Performance Optimization Guide
SAP Data Services Document Version: 4.2 Support Package 6 (14.2.6.0) 2015-11-20 PUBLIC Content 1 Welcome to SAP Data Services....6 1.1 Welcome.... 6 1.2 Documentation set for SAP Data Services....6 1.3
More informationBusiness Application Services Testing
Business Application Services Testing Curriculum Structure Course name Duration(days) Express 2 Testing Concept and methodologies 3 Introduction to Performance Testing 3 Web Testing 2 QTP 5 SQL 5 Load
More informationImplementing and Maintaining Microsoft SQL Server 2008 Integration Services
Course 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Integration Services Length: 3 Days Language(s): English Audience(s): IT Professionals Level: 200 Technology: Microsoft SQL Server 2008
More informationICAB4136B Use structured query language to create database structures and manipulate data
ICAB4136B Use structured query language to create database structures and manipulate data Release: 1 ICAB4136B Use structured query language to create database structures and manipulate data Modification
More informationPhysicians are fond of saying Treat the problem, not the symptom. The same is true for Information Technology.
Comprehensive Consulting Solutions, Inc. Business Savvy. IT Smar Troubleshooting Basics: A Practical Approach to Problem Solving t. White Paper Published: September 2005 Physicians are fond of saying Treat
More informationStreamServe Persuasion SP5 Microsoft SQL Server
StreamServe Persuasion SP5 Microsoft SQL Server Database Guidelines Rev A StreamServe Persuasion SP5 Microsoft SQL Server Database Guidelines Rev A 2001-2011 STREAMSERVE, INC. ALL RIGHTS RESERVED United
More informationWith each new release of SQL Server, Microsoft continues to improve
Chapter 1: Configuring In This Chapter configuration tools Adjusting server parameters Generating configuration scripts With each new release of, Microsoft continues to improve and simplify the daily tasks
More informationDBMS / Business Intelligence, Business Intelligence / DBMS
DBMS / Business Intelligence, Business Intelligence / DBMS Orsys, with 30 years of experience, is providing high quality, independant State of the Art seminars and hands-on courses corresponding to the
More informationAV-005: Administering and Implementing a Data Warehouse with SQL Server 2014
AV-005: Administering and Implementing a Data Warehouse with SQL Server 2014 Career Details Duration 105 hours Prerequisites This career requires that you meet the following prerequisites: Working knowledge
More informationwww.dotnetsparkles.wordpress.com
Database Design Considerations Designing a database requires an understanding of both the business functions you want to model and the database concepts and features used to represent those business functions.
More informationToad for Oracle 8.6 SQL Tuning
Quick User Guide for Toad for Oracle 8.6 SQL Tuning SQL Tuning Version 6.1.1 SQL Tuning definitively solves SQL bottlenecks through a unique methodology that scans code, without executing programs, to
More informationReport and Dashboard Template 9.5.1 User Guide
Report and Dashboard Template 9.5.1 User Guide Introduction The Informatica Data Quality Reporting and Dashboard Template for Informatica Data Quality 9.5.1, is designed to provide you a framework to capture
More informationAbstract. For notes detailing the changes in each release, see the MySQL for Excel Release Notes. For legal information, see the Legal Notices.
MySQL for Excel Abstract This is the MySQL for Excel Reference Manual. It documents MySQL for Excel 1.3 through 1.3.6. Much of the documentation also applies to the previous 1.2 series. For notes detailing
More informationOracle Database: Develop PL/SQL Program Units
Oracle University Contact Us: 1.800.529.0165 Oracle Database: Develop PL/SQL Program Units Duration: 3 Days What you will learn This Oracle Database: Develop PL/SQL Program Units course is designed for
More informationFigure 1 - BI Publisher Enterprise Capabilities. OAUG Forum @ Collaborate 08 Page 2 Copyright 2008 by Lee Briggs
Oracle BI Publisher was originally developed to solve these reporting problems. It was first released with Oracle E- Business Suite 11.5.10 towards the end of 2005. The original release was called XML
More informationEASY for NAVISION: Archiving for Microsoft Dynamics NAV.
EASY ENTERPRISE.+ EASY for NAVISION: Archiving for Microsoft Dynamics NAV. Transparent and revision-proof archiving. With its linkage to the leading document management system EASY ENTERPRISE, EASY for
More informationDB Audit Expert 3.1. Performance Auditing Add-on Version 1.1 for Microsoft SQL Server 2000 & 2005
DB Audit Expert 3.1 Performance Auditing Add-on Version 1.1 for Microsoft SQL Server 2000 & 2005 Supported database systems: Microsoft SQL Server 2000 Microsoft SQL Server 2005 Copyright SoftTree Technologies,
More informationSystem Requirements for Archiving Electronic Records PROS 99/007 Specification 1. Public Record Office Victoria
System Requirements for Archiving Electronic Records PROS 99/007 Specification 1 Public Record Office Victoria Version 1.0 April 2000 PROS 99/007 Specification 1: System Requirements for Archiving Electronic
More informationSAP Data Services 4.X. An Enterprise Information management Solution
SAP Data Services 4.X An Enterprise Information management Solution Table of Contents I. SAP Data Services 4.X... 3 Highlights Training Objectives Audience Pre Requisites Keys to Success Certification
More informationMicrosoft. Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server
Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server Length : 5 Days Audience(s) : IT Professionals Level : 300 Technology : Microsoft SQL Server 2014 Delivery Method : Instructor-led
More informationOptimizing Performance. Training Division New Delhi
Optimizing Performance Training Division New Delhi Performance tuning : Goals Minimize the response time for each query Maximize the throughput of the entire database server by minimizing network traffic,
More informationSQL Server 2005 Implementation and Maintenance. 50 Cragwood Rd, Suite 350 South Plainfield, NJ 07080
COURSE SYLLABUS SQL Server 2005 Implementation and Maintenance MS Certified Technology Specialist: (MCDBA Exam 70-431) 50 Cragwood Rd, Suite 350 South Plainfield, NJ 07080 Victoria Commons, 613 Hope Rd
More informationAdvanced Oracle SQL Tuning
Advanced Oracle SQL Tuning Seminar content technical details 1) Understanding Execution Plans In this part you will learn how exactly Oracle executes SQL execution plans. Instead of describing on PowerPoint
More informationApplication of Predictive Analytics for Better Alignment of Business and IT
Application of Predictive Analytics for Better Alignment of Business and IT Boris Zibitsker, PhD bzibitsker@beznext.com July 25, 2014 Big Data Summit - Riga, Latvia About the Presenter Boris Zibitsker
More informationOracle Database 11g: SQL Tuning Workshop
Oracle University Contact Us: + 38516306373 Oracle Database 11g: SQL Tuning Workshop Duration: 3 Days What you will learn This Oracle Database 11g: SQL Tuning Workshop Release 2 training assists database
More informationInside the PostgreSQL Query Optimizer
Inside the PostgreSQL Query Optimizer Neil Conway neilc@samurai.com Fujitsu Australia Software Technology PostgreSQL Query Optimizer Internals p. 1 Outline Introduction to query optimization Outline of
More informationLearnFromGuru Polish your knowledge
SQL SERVER 2008 R2 /2012 (TSQL/SSIS/ SSRS/ SSAS BI Developer TRAINING) Module: I T-SQL Programming and Database Design An Overview of SQL Server 2008 R2 / 2012 Available Features and Tools New Capabilities
More informationSmarter Balanced Assessment Consortium. Recommendation
Smarter Balanced Assessment Consortium Recommendation Smarter Balanced Quality Assurance Approach Recommendation for the Smarter Balanced Assessment Consortium 20 July 2012 Summary When this document was
More informationModule 1: Getting Started with Databases and Transact-SQL in SQL Server 2008
Course 2778A: Writing Queries Using Microsoft SQL Server 2008 Transact-SQL About this Course This 3-day instructor led course provides students with the technical skills required to write basic Transact-
More informationTips and Tricks SAGE ACCPAC INTELLIGENCE
Tips and Tricks SAGE ACCPAC INTELLIGENCE 1 Table of Contents Auto e-mailing reports... 4 Automatically Running Macros... 7 Creating new Macros from Excel... 8 Compact Metadata Functionality... 9 Copying,
More informationMicrosoft SQL Server 2008 R2 Enterprise Edition and Microsoft SharePoint Server 2010
Microsoft SQL Server 2008 R2 Enterprise Edition and Microsoft SharePoint Server 2010 Better Together Writer: Bill Baer, Technical Product Manager, SharePoint Product Group Technical Reviewers: Steve Peschka,
More informationSQL Server Maintenance Plans
SQL Server Maintenance Plans BID2WIN Software, Inc. September 2010 Abstract This document contains information related to SQL Server 2005 and SQL Server 2008 and is a compilation of research from various
More informationOracle Database: SQL and PL/SQL Fundamentals NEW
Oracle University Contact Us: + 38516306373 Oracle Database: SQL and PL/SQL Fundamentals NEW Duration: 5 Days What you will learn This Oracle Database: SQL and PL/SQL Fundamentals training delivers the
More informationMOC 20462C: Administering Microsoft SQL Server Databases
MOC 20462C: Administering Microsoft SQL Server Databases Course Overview This course provides students with the knowledge and skills to administer Microsoft SQL Server databases. Course Introduction Course
More informationHigh-Volume Data Warehousing in Centerprise. Product Datasheet
High-Volume Data Warehousing in Centerprise Product Datasheet Table of Contents Overview 3 Data Complexity 3 Data Quality 3 Speed and Scalability 3 Centerprise Data Warehouse Features 4 ETL in a Unified
More informationEMC Documentum Business Activity Monitor
EMC Documentum Business Activity Monitor Version 6.5 SP1 Implementation Guide P/N 300-008-214 A02 EMC Corporation Corporate Headquarters: Hopkinton, MA 01748-9103 1-508-435-1000 www.emc.com Copyright 2009
More informationQuality Assurance - Karthik
Prevention is better than cure Quality Assurance - Karthik This maxim perfectly explains the difference between quality assurance and quality control. Quality Assurance is a set of processes that needs
More informationTesting Big data is one of the biggest
Infosys Labs Briefings VOL 11 NO 1 2013 Big Data: Testing Approach to Overcome Quality Challenges By Mahesh Gudipati, Shanthi Rao, Naju D. Mohan and Naveen Kumar Gajja Validate data quality by employing
More informationCapacity Plan. Template. Version X.x October 11, 2012
Template Version X.x October 11, 2012 This is an integral part of infrastructure and deployment planning. It supports the goal of optimum provisioning of resources and services by aligning them to business
More informationData processing goes big
Test report: Integration Big Data Edition Data processing goes big Dr. Götz Güttich Integration is a powerful set of tools to access, transform, move and synchronize data. With more than 450 connectors,
More informationGovernment of Saskatchewan Executive Council. Oracle Sourcing isupplier User Guide
Executive Council Oracle Sourcing isupplier User Guide Contents 1 Introduction to Oracle Sourcing and isupplier...6 1.0 Oracle isupplier...6 1.1 Oracle Sourcing...6 2 Customer Support...8 2.0 Communications
More informationYu Xu Pekka Kostamaa Like Gao. Presented By: Sushma Ajjampur Jagadeesh
Yu Xu Pekka Kostamaa Like Gao Presented By: Sushma Ajjampur Jagadeesh Introduction Teradata s parallel DBMS can hold data sets ranging from few terabytes to multiple petabytes. Due to explosive data volume
More informationBusiness Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? PTR Associates Limited
Business Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? www.ptr.co.uk Business Benefits From Microsoft SQL Server Business Intelligence (September
More informationPSW Guide. Version 4.7 April 2013
PSW Guide Version 4.7 April 2013 Contents Contents...2 Documentation...3 Introduction...4 Forms...5 Form Entry...7 Form Authorisation and Review... 16 Reporting in the PSW... 17 Other Features of the Professional
More informationTogether we can build something great
Together we can build something great Financial Reports, Ad Hoc Reporting and BI Tools Joanna Broszeit and Dawn Stenbol Education Track Boston Room Monday, May 2nd 2:40 pm Reporting Options with NAV ERP
More informationTrendWorX32 SQL Query Engine V9.2 Beta III
TrendWorX32 SQL Query Engine V9.2 Beta III Documentation (Preliminary November 2009) OPC Automation at your fingertips 1. Introduction TrendWorX32 Logger logs data to a database. You can use the TrendWorX32
More informationStatement of Support on Shared File System Support for Informatica PowerCenter High Availability Service Failover and Session Recovery
Statement of Support on Shared File System Support for Informatica PowerCenter High Availability Service Failover and Session Recovery Applicability This statement of support applies to the following Informatica
More informationPERFORMANCE TIPS FOR BATCH JOBS
PERFORMANCE TIPS FOR BATCH JOBS Here is a list of effective ways to improve performance of batch jobs. This is probably the most common performance lapse I see. The point is to avoid looping through millions
More informationMySQL for Beginners Ed 3
Oracle University Contact Us: 1.800.529.0165 MySQL for Beginners Ed 3 Duration: 4 Days What you will learn The MySQL for Beginners course helps you learn about the world's most popular open source database.
More informationRational Rational ClearQuest
Rational Rational ClearQuest Version 7.0 Windows Using Project Tracker GI11-6377-00 Rational Rational ClearQuest Version 7.0 Windows Using Project Tracker GI11-6377-00 Before using this information, be
More informationOffice of History. Using Code ZH Document Management System
Office of History Document Management System Using Code ZH Document The ZH Document (ZH DMS) uses a set of integrated tools to satisfy the requirements for managing its archive of electronic documents.
More informationOracle Database 11 g Performance Tuning. Recipes. Sam R. Alapati Darl Kuhn Bill Padfield. Apress*
Oracle Database 11 g Performance Tuning Recipes Sam R. Alapati Darl Kuhn Bill Padfield Apress* Contents About the Authors About the Technical Reviewer Acknowledgments xvi xvii xviii Chapter 1: Optimizing
More informationSQL Server Business Intelligence on HP ProLiant DL785 Server
SQL Server Business Intelligence on HP ProLiant DL785 Server By Ajay Goyal www.scalabilityexperts.com Mike Fitzner Hewlett Packard www.hp.com Recommendations presented in this document should be thoroughly
More informationDBAs having to manage DB2 on multiple platforms will find this information essential.
DB2 running on Linux, Unix, and Windows (LUW) continues to grow at a rapid pace. This rapid growth has resulted in a shortage of experienced non-mainframe DB2 DBAs. IT departments today have to deal with
More informationIntegrating Big Data into the Computing Curricula
Integrating Big Data into the Computing Curricula Yasin Silva, Suzanne Dietrich, Jason Reed, Lisa Tsosie Arizona State University http://www.public.asu.edu/~ynsilva/ibigdata/ 1 Overview Motivation Big
More informationWhat's New in SAS Data Management
Paper SAS034-2014 What's New in SAS Data Management Nancy Rausch, SAS Institute Inc., Cary, NC; Mike Frost, SAS Institute Inc., Cary, NC, Mike Ames, SAS Institute Inc., Cary ABSTRACT The latest releases
More informationOracle Database: Program with PL/SQL
Oracle University Contact Us: +33 15 7602 081 Oracle Database: Program with PL/SQL Duration: 5 Days What you will learn This course is available in Training On Demand format This Oracle Database: Program
More informationTroubleshooting SQL Server Enterprise Geodatabase Performance Issues. Matthew Ziebarth and Ben Lin
Troubleshooting SQL Server Enterprise Geodatabase Performance Issues Matthew Ziebarth and Ben Lin Troubleshooting SQL Server Enterprise Geodatabase Performance Issues AGENDA General configuration recommendations
More informationTechnical Support. Technical Support. Customer Manual v1.1
Technical Support Customer Manual v1.1 1 How to Contact Transacta Support 1.1 Primary Contact: support@transacta.com.au 1.2 Escalation Telephone Number: +61 (2) 9459 3366 1.3 Hours of Operation 9:00 a.m.
More informationCourse 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Analysis Services
Course 6234A: Implementing and Maintaining Microsoft SQL Server 2008 Analysis Services Length: Delivery Method: 3 Days Instructor-led (classroom) About this Course Elements of this syllabus are subject
More information7.94 New Features Guide
7.94 New Features Guide 022315 2015 Blackbaud, Inc. This publication, or any part thereof, may not be reproduced or transmitted in any form or by any means, electronic, or mechanical, including photocopying,
More informationNUTECH COMPUTER TRAINING INSTITUTE 1682 E. GUDE DRIVE #102, ROCKVILLE, MD 20850 WEB: www.nutechtraining.com TEL: 301-610-9300
NUTECH COMPUTER TRAINING INSTITUTE 1682 E. GUDE DRIVE #102, ROCKVILLE, MD 20850 WEB: www.nutechtraining.com TEL: 301-610-9300 MCTS SQL Server 2005 Developer Course Outlines Exam 70 431: TS: Microsoft SQL
More informationIntroduction. Part I: Finding Bottlenecks when Something s Wrong. Chapter 1: Performance Tuning 3
Wort ftoc.tex V3-12/17/2007 2:00pm Page ix Introduction xix Part I: Finding Bottlenecks when Something s Wrong Chapter 1: Performance Tuning 3 Art or Science? 3 The Science of Performance Tuning 4 The
More informationSQL SERVER FREE TOOLS
SQL SERVER FREE TOOLS VidhyaSagar K kvs1983@indiamvps.net www.facebook.com/groups/cssug/ NEXT 45 MIN? Performance Analysis of Logs OpenDBiff Comparision Utility SSMS Tools SQL Sentry Plan Explorer SQLIOSIM
More informationHP ProLiant DL580 Gen8 and HP LE PCIe Workload WHITE PAPER Accelerator 90TB Microsoft SQL Server Data Warehouse Fast Track Reference Architecture
WHITE PAPER HP ProLiant DL580 Gen8 and HP LE PCIe Workload WHITE PAPER Accelerator 90TB Microsoft SQL Server Data Warehouse Fast Track Reference Architecture Based on Microsoft SQL Server 2014 Data Warehouse
More informationIntroducing Microsoft SQL Server 2012 Getting Started with SQL Server Management Studio
Querying Microsoft SQL Server 2012 Microsoft Course 10774 This 5-day instructor led course provides students with the technical skills required to write basic Transact-SQL queries for Microsoft SQL Server
More informationLearning SQL Data Compare. SQL Data Compare - 8.0
Learning SQL Data Compare SQL Data Compare - 8.0 Contents Getting started... 4 Red Gate Software Ltd 2 Worked example: synchronizing data in two databases... 6 Worked example: restoring from a backup file...
More informationUnderstanding SQL Server Execution Plans. Klaus Aschenbrenner Independent SQL Server Consultant SQLpassion.at Twitter: @Aschenbrenner
Understanding SQL Server Execution Plans Klaus Aschenbrenner Independent SQL Server Consultant SQLpassion.at Twitter: @Aschenbrenner About me Independent SQL Server Consultant International Speaker, Author
More informationWindows 2003 Performance Monitor. System Monitor. Adding a counter
Windows 2003 Performance Monitor The performance monitor, or system monitor, is a utility used to track a range of processes and give a real time graphical display of the results, on a Windows 2003 system.
More informationAmadeus SAS Specialists Prove Fusion iomemory a Superior Analysis Accelerator
WHITE PAPER Amadeus SAS Specialists Prove Fusion iomemory a Superior Analysis Accelerator 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com SAS 9 Preferred Implementation Partner tests a single Fusion
More informationSQL Server 2012 Performance White Paper
Published: April 2012 Applies to: SQL Server 2012 Copyright The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication.
More informationBI 4.1 Quick Start Java User s Guide
BI 4.1 Quick Start Java User s Guide BI 4.1 Quick Start Guide... 1 Introduction... 4 Logging in... 4 Home Screen... 5 Documents... 6 Preferences... 8 Web Intelligence... 12 Create a New Web Intelligence
More informationWhitepaper Document Solutions
Whitepaper Document Solutions ScannerVision 3 Contents Contents... 2 Introduction... 3 ScannerVision introduction... 4 Concept... 4 Components... 4 Deploying ScannerVision... 5 Supported Operating Systems...
More informationQuerying Microsoft SQL Server
Course 20461C: Querying Microsoft SQL Server Module 1: Introduction to Microsoft SQL Server 2014 This module introduces the SQL Server platform and major tools. It discusses editions, versions, tools used
More informationHow To Use The Correlog With The Cpl Powerpoint Powerpoint Cpl.Org Powerpoint.Org (Powerpoint) Powerpoint (Powerplst) And Powerpoint 2 (Powerstation) (Powerpoints) (Operations
orrelog SQL Table Monitor Adapter Users Manual http://www.correlog.com mailto:info@correlog.com CorreLog, SQL Table Monitor Users Manual Copyright 2008-2015, CorreLog, Inc. All rights reserved. No part
More informationSSMS Built in Reports for Server and Database Monitoring
SQL Server Documentation SSMS Built in Reports for Server and Database Monitoring I sometimes discover that the built in reports for SQL Server within SSMS are an unknown, sometimes this is because not
More informationPRODUCTIVITY IN FOCUS PERFORMANCE MANAGEMENT SOFTWARE FOR MAILROOM AND SCANNING OPERATIONS
PRODUCTIVITY IN FOCUS PERFORMANCE MANAGEMENT SOFTWARE FOR MAILROOM AND SCANNING OPERATIONS Machine Productivity Track equipment productivity by active run time and total wall clock time. Compare machine
More informationPRODUCT OVERVIEW SUITE DEALS. Combine our award-winning products for complete performance monitoring and optimization, and cost effective solutions.
Creating innovative software to optimize computing performance PRODUCT OVERVIEW Performance Monitoring and Tuning Server Job Schedule and Alert Management SQL Query Optimization Made Easy SQL Server Index
More informationMODULE FRAMEWORK : Dip: Information Technology Network Integration Specialist (ITNIS) (Articulate to Edexcel: Adv. Dip Network Information Specialist)
Year: 2011 (2 nd year) Term: 3 Class group: Blue Facilitator: C. Du Toit Description: Learn how to install, configure and administer a Microsoft SQL Server. Learn how to manage a SQL database hosted on
More informationThe Complete Performance Solution for Microsoft SQL Server
The Complete Performance Solution for Microsoft SQL Server Powerful SSAS Performance Dashboard Innovative Workload and Bottleneck Profiling Capture of all Heavy MDX, XMLA and DMX Aggregation, Partition,
More informationSSIS Training: Introduction to SQL Server Integration Services Duration: 3 days
SSIS Training: Introduction to SQL Server Integration Services Duration: 3 days SSIS Training Prerequisites All SSIS training attendees should have prior experience working with SQL Server. Hands-on/Lecture
More informationEnterprise Performance Tuning: Best Practices with SQL Server 2008 Analysis Services. By Ajay Goyal Consultant Scalability Experts, Inc.
Enterprise Performance Tuning: Best Practices with SQL Server 2008 Analysis Services By Ajay Goyal Consultant Scalability Experts, Inc. June 2009 Recommendations presented in this document should be thoroughly
More informationMonitor and Manage Your MicroStrategy BI Environment Using Enterprise Manager and Health Center
Monitor and Manage Your MicroStrategy BI Environment Using Enterprise Manager and Health Center Presented by: Dennis Liao Sales Engineer Zach Rea Sales Engineer January 27 th, 2015 Session 4 This Session
More informationSQL Server Performance Tuning and Optimization
3 Riverchase Office Plaza Hoover, Alabama 35244 Phone: 205.989.4944 Fax: 855.317.2187 E-Mail: rwhitney@discoveritt.com Web: www.discoveritt.com SQL Server Performance Tuning and Optimization Course: MS10980A
More informationReady Time Observations
VMWARE PERFORMANCE STUDY VMware ESX Server 3 Ready Time Observations VMware ESX Server is a thin software layer designed to multiplex hardware resources efficiently among virtual machines running unmodified
More informationDatabase Application Developer Tools Using Static Analysis and Dynamic Profiling
Database Application Developer Tools Using Static Analysis and Dynamic Profiling Surajit Chaudhuri, Vivek Narasayya, Manoj Syamala Microsoft Research {surajitc,viveknar,manojsy}@microsoft.com Abstract
More informationDetermining SQL Server 2012 Core Licensing Requirements at SA Renewal. June 2012
Determining SQL Server 2012 Core Licensing Requirements at SA Renewal June 2012 Table of Contents Overview...4 How to Create a SQL Server 2012 Transition Report...4 Step 1: Properties and Inventory...5
More informationFood Industry. www.ats global.com
Food Industry Significantly reduces scrap and rework cost Image driven inspection Web based analysis and reporting Eliminates paper checklists Real-time attribute data collection Easy-to-use operator interface
More information21 CFR Part 11 Administrative Tools Part 11 Trackable Changes Maintenance Plans Upgrades Part 11 LDAP Support QC-SORT
Product Catalog Software Solutions Prolink offers an entire suite of software solutions to address and automate the data collection and quality analysis tasks performed throughout your organization. As
More informationStandard Operating Procedure for Database Operations
PM 2.5 Diltabase Operations Date: May 8 2008 Page I of 18 Standard Operating Procedure for Database Operations Environmental Health and Safety Division RTl lnternational* Research Triangle Park, North
More informationCourse 20461C: Querying Microsoft SQL Server Duration: 35 hours
Course 20461C: Querying Microsoft SQL Server Duration: 35 hours About this Course This course is the foundation for all SQL Server-related disciplines; namely, Database Administration, Database Development
More informationBasic Unix/Linux 1. Software Testing Interview Prep
Basic Unix/Linux 1 Programming Fundamentals and Concepts 2 1. What is the difference between web application and client server application? Client server application is designed typically to work in a
More information