Corporate Records Scanning Strategy

Transcription

1 Corporate Records Scanning Strategy For the unitary authority of Northumberland County Council DRAFT Prepared by: Records Management Service, Northumberland County Council, Woodhorn, QEII Country Park, Ashington, Northumberland, NE63 9YF Webpage: CorporateScanningStrategy v0.1 Page 1 of 10

2 Version History Version Date Description Author /03/2008 Working draft K. A. Shiel /07/2009 Updated for Unitary Authority K. A. Shiel Distribution List Name Job Title Signature Date All NCC staff All Woodhorn staff Date of Next Review: 31/03/2012 Approval and Authorisation Name Job Title Signature Date Author:- K.A.Shiel Records Manager 01/07/2009 Approved by:- Authorised By:- Purpose The purpose of this strategy is to state and communicate the principles that guide the legally admissible scanning of paper records within Northumberland County Council. This document outlines the procedures and processes to be followed in the scanning and image processing of records, to ensure the authenticity, reliability and integrity of information held by the Council in accordance with the standards set out in BSI DISC PD 'Legal Admissibility and Evidential Weight of Information Stored Electronically'. Northumberland County Council acknowledges the assistance of Norfolk County Council in the preparation of this document. CorporateScanningStrategy v0.1 Page 2 of 10

3 Corporate Records Scanning Strategy Contents: 1.0 Introduction 2.0 Background 3.0 Scope 4.0 Interpretation 5.0 References 6.0 Scanning operations management 7.0 Audit trail 8.0 Standard processes 9.0 Review of strategy 1. Introduction On 1 April 2009 the seven councils in Northumberland became one unitary authority of Northumberland County Council. During the Transition and Transformation period many services will be merged and records will be digitised and assimilated into existing Electronic Document Management Systems (EDMS). There is a legacy of several EDM Systems from the merged councils and material within these systems has been digitised to varying qualities. It is therefore important to address current storage of records and ensure that information is properly maintained for business, legal, evidential and historical use and that it should meet the standards set out in BSI DISC PD 'Legal Admissibility and Evidential Weight of Information Stored Electronically'. 2. Background 2.1. Projects are already under way, or will begin shortly, to digitise active, semi-current or closed paper records and incoming documents in order to facilitate working in a wholly electronic environment and to free up space in offices for personnel movement. Records being digitised or being considered for digitisation include: Children s Social Care case file records currently in paper format. Adult Social Care case file records currently in paper format. ScanFile users will move to ADOS, the NCC Electronic Document Management System (EDMS). Revs and Bens batch scanning. Former District Council digitised records It is essential that these digitised records have the same evidential weight and value as their physical originals, particularly if those originals are no longer kept. 3. Scope 3.2. This strategy applies to the scanning of day-to-day business records consisting of text or images This strategy applies to all case files including 25+ year case files that are scanned and to be used as legally admissible records. CorporateScaningStrategy v 0.1 Page 3 of 10

4 3.4. This strategy applies to all staff that creates, uses, and manages digitally scanned documents to be kept as records This strategy does not apply to Documents that are scanned solely to facilitate a process, e.g. circulation, where the original is retained for the record, Specialist digitisation projects, for example to create electronic cultural resources, Digital spatial data, for example in geographical information systems (GIS) and computer-aided design (CAD) applications, Fee-based supply of digitised information to businesses and the public, for example under access to information legislation or as part of a research service, Public self-service scanning facilities This strategy does not set out system requirements, nor address the scope and content of system documentation. These requirements are set out in the Digital Curation Policy and Strategy The question of when it is acceptable to destroy or dispense with paper records, and who should make such a decision, is addressed in the corporate policy on Digital Preservation of Records, and in guidance on the legal admissibility and evidential weight of electronic information on the Records Management webpage. 4. Interpretation 4.1. Digitisation means electronic scanning of originals Image processing includes rendering the content of an image machine-readable by means of optical character recognition (OCR) products. 5. References 5.1. Legislation, standards and codes of practice with which this strategy complies or which have informed it are listed in Appendix A. 6. Scanning operations management 6.1. Procedures Local variation to these corporate procedures may be necessary. When this occurs, the fact and nature of the variation should be fully documented and notified to the keeper of the corporate scanning strategy Scanning and image processing will be performed to the defined processes and procedures, irrespective of whether scanning is carried out in a central facility or locally Scanning procedures should be integrated into and support the relevant business processes and workflows Procedures should cover the following, as a minimum: Scanning operations Data entry Validation and quality control CorporateScaningStrategy v 0.1 Page 4 of 10

5 Back up Security Incidents Exceptions (e.g. when a document or record may be deleted and replaced by a rescan) Disposition of originals All procedures, corporate and local, must be documented Staff All staff involved in scanning and image processing should undergo basic training of the system in use Staff may need to be certificated as meeting the requirements of quality tests before they may add documents and records to certain categories of file, or use specific systems, e.g. ScanFile, ADOS, Swift Where staff must be certificated, this need must be determined by means of a risk assessment, and the certification process documented Staff training schedules should include An initial training period, in order to ensure that staff are familiar with and understand the relevant policies, techniques, and procedures, and Regular update sessions, for familiarisation with changes to policies and procedures All staff who undertake scanning should be provided with the necessary documentation, and should at any time be able to demonstrate their familiarity with, and understanding of, that documentation Equipment and software Equipment and software procured for scanning and image processing will comply with any industry benchmarks that have been specified Software procured for scanning and image processing will support national or international standards, e.g. for image file formats and metadata input Equipment and software will be routinely and systematically checked and tested to ensure that performance and quality requirements are maintained at all times. Checks and tests will be logged Equipment calibration will be checked by scanner operators, or other designated persons, on a regular basis. Calibration checks and any necessary re-calibration will be logged Equipment maintenance logs will be maintained Quality control Quality control testing will be undertaken regularly, using a sample set of documents equivalent in characteristics to original documents, to benchmark system performance against the image quality control criteria Quality control tests and their results will be recorded in a Quality Control Log Incidents and Exceptions CorporateScaningStrategy v 0.1 Page 5 of 10

6 Incident and exception logs must be maintained Documentation A designated role, or named person, will be responsible for the content, quality, production, and dissemination of the documentation Documentation should include, but not be limited to: Technical documentation for all components of the scanning system, e.g. scanner, interface, software products User guide(s) to equipment and software Procedures manual(s) for the constituent processes, i.e. scanning, image processing, saving House rules for inputting data, e.g. metadata values, file-naming protocols Exceptions procedure checklist Incident and exceptions logging Documentation should be distributed electronically All changes and amendments to documentation must be formally recorded Documentation must be adequately protected against unauthorised or accidental modification If corporate records retention policy requires it, superseded documentation must be retained as specified in the retention and disposal schedule. 7. Audit Trail 7.1. All logs will be subject to inspection, including inspection by auditors The software must record when and by whom scanned images have been created or, exceptionally, deleted The software must record each stage of scanning, image processing, and where applicable, indexing Where an image management system is in use it should automatically generate an audit trail which will Date/time stamp each event Be non-alterable Be subject to access control Be securely stored and backed-up Be subject to either the same retention period as the image itself, or a separate retention period Have a reporting tool that can produce both standard and customized reports from the trail. 8. Standard processes 8.1. Figure 1 shows the steps that are performed routinely to ensure that a scanned image is a true representation of the original and has been captured appropriately. Prepare Document Scan Document Verify Image Index Image Commit Image Figure 1. Image capture process CorporateScaningStrategy v 0.1 Page 6 of 10

7 8.2. Prepare document (Step 1) Prior to scanning, all documents must be examined to determine the actions to be taken to prepare them and the scanning equipment, and to establish their suitability for scanning. Factors to take into account include physical condition, e.g. thin or brittle paper, creasing, tears and perforations, presence of staples, clips, or pins readability, e.g. fading, poor handwriting size attributes, e.g. black and white, colour, tonal range the need to replicate dimensions accurately Non-paper media such as roll-film, transparencies and microforms should be digitised using specialist equipment, rather than adapters such as slide frames. Advice can be obtained from the Northumberland Collections Service or from the Records Management Service at woodhorn Batching (Step 2) This step will not always apply Batch metadata template completion Where documents are batch scanned, a metadata template will be used to check completeness of the scanning process. This template will include: Unique identifier for each batch of documents Type of material to be scanned, e.g. paper document, microfilm, aperture card Terms to be selected from a controlled list Number of documents to be scanned Number of pages in each document to be scanned Retention/disposal instruction, e.g. destroy after one year, original to be retained Batch header update The batch header should include: Date and time of scanning Identity of the person who performed the scanning Confirmation of the number of documents, and number of pages, to be scanned Scan (Step 3) Check the scanner settings Default settings are: Ratio 1:1 Resolution 300 dpi Bit depth 24-bit colour File format TIFF Quality High, or numerical equivalent Optional settings are: Bit depth 1-bit and 8-bit black-and-white (where a facsimile of the original is not necessary) Resolution 600 dpi, for originals that are smaller than B6 (postcard), and where other factors indicate that a higher resolution is desirable, such as: fading, difficult-to-read handwriting, and fine detail. CorporateScaningStrategy v 0.1 Page 7 of 10

8 File format JPEG2000, PDF/A-1b with (OCR) software or PDF- searchable Guidance will be published on choosing settings Where a resolution higher than 600 dpi is necessary, for example for scans of 35mm slides or fine-detailed complex images, an exception should be logged Image manipulation processes, such as de-speckle, de-skew, and cropping, are not normally permitted Where image manipulation is allowable, the permitted action and the grounds for permitting it must be documented, and every instance of image manipulation must be logged as an exception Verify image (Step 4) This is a visual quality check to confirm that the captured image is a true representation of the original document If the scan fails this visual check, the image or batch of images must be rejected and re-scanned Index image (Step 5) This step will not always apply, but is mandatory for ScanFile, ADOS (and other EDMS), Swift Image indexing metadata will be defined in the documentation House rules should be written that specify how metadata values are to be determined Sampling should be carried out routinely to ensure that staff are applying the indexing metadata correctly Commit image (Step 6) This is the process of placing the scanned image in a repository, e.g. by saving to a folder This may be a system-controlled process. This is the case with ScanFile, an EDMS and Swift Where committing the image is a manual process, a file-naming protocol should be put in place, and documented OCR (Step 7) This step will not always apply If an image file is to be rendered as a fully-functioning electronic text by means of optical character recognition software (OCR), this process should be undertaken after the image file itself has been committed (Step 5) OCR rendition may be accomplished automatically by an image management system, or manually. CorporateScaningStrategy v 0.1 Page 8 of 10

9 The OCR version is a separate electronic file, although it may, and whenever possible it should, be tightly bound to the image file Disposal of original (Step 8) The manner in which original documents and records are to be disposed must be fully documented, and recorded in the relevant records retention schedule Disposal must always be in accordance with the corporate Digital Preservation Policy, and the guidelines on legal admissibility and evidential weight of electronic information Where clear instructions as to disposition are absent, the departmental or the corporate records manager must be consulted, and an appropriate written consent obtained, before any action is carried out that is likely to result in the destruction or disposal of records. 9. Review of strategy 9.1. This strategy must be reviewed no later than 31 March CorporateScaningStrategy v 0.1 Page 9 of 10

10 Appendix A References The following legislation, policies, standards, and codes of practice have informed this strategy: Civil Evidence Act 1995 Data Protection Act 1998 BS ISO :2001 Information and Documentation Records Management Part 1: General BS ISO :2001 Information and Documentation Records Management Part 2: Guidelines BIP 0008 Code of Practice on Legal Admissibility and Evidential Weight of Information Stored Electronically, 3 rd edition, 2004, British Standards Institution Code of Practice for Information Security Management, BS 7799: 1999/ ISO 17799, 1999 Electronic imaging Information stored electronically Recommendations for trustworthiness and reliability, ISO/TR 15801, International Organization for Standardization (ISO), 2004 CorporateScaningStrategy v 0.1 Page 10 of 10