ASSESSMENT HANDBOOK This handbook is aimed at all staff involved in assessment processes prior to Exam Board consideration i.e. assessment setting and marking. It contains formal guidance for markers, Module Organisers, Course Directors, Taught Course Directors, and administrative staff involved in supporting assessments and exams. It is also intended to inform Exam Board members, including External Examiners and Exam Board Chairs, about how the School s assessment processes work. Separate guidance on Exam Boards provides formal guidance on the operation and role of Exam Boards and their members. Additional detailed guidance is also available for assessment irregularities (e.g. plagiarism), re-sits, extenuating circumstances affecting assessment and moderation. This handbook is based on regulations, policies and procedures agreed by relevant London School of Hygiene & Tropical Medicine (LSHTM) committees including the Senate Executive Group, Quality & Standards Committee and Learning & Teaching Committee. The final compiled version has been approved by the Associate Dean of Studies (Quality Management & Enhancement). London School of Hygiene & Tropical Medicine. Last updated July 2015. Improving Health Worldwide
INTRODUCTION Purpose of this handbook 1. This handbook compiles the School s formal guidance about assessment processes that happen prior to Board of Examiners consideration. This includes setting assessment tasks, exam questions and marking schemes; grading work; and dealing with issues such as extensions or special exam arrangements. The first part of this document is a summary overview of all assessment processes, followed by a set of individual annexes with detailed policies and guidance. Audience for this handbook 2. This handbook is particularly aimed at markers, Module Organisers, Course Directors and Taught Course Directors; as well as administrative staff who support assessment processes, including in the Teaching Support Office, the Distance Learning Office and the Registry. It is also intended to inform Exam Board members, including External Examiners and Exam Board Chairs, about how the School s assessment processes work. Important related documents 3. Policies regarding three important areas of assessment are published separately to this handbook both because they are long and comprehensive, and because they are about quite specific matters that only affect a small proportion of students. These are: The Re-sits policy The Extenuating Circumstances policy The Plagiarism and Assessment Irregularities policy 4. Separate Exam Board guidance provides information about how the School s Boards of Examiners should operate, including the specific roles of External Examiners, Exam Board Chairs and other Board members. This is supplemented by a separate Module Moderation policy, which sets out formal procedures for moderating module grades after they have been double-marked and before they are considered by Exam Boards. Applicability 5. The guidance in this handbook is expected to apply to assessment of all of the School s taught courses, at module and course level, and whether award-bearing or non-awardbearing. The guidance has been written with a focus on face-to-face (F2F) Master s degrees and modules, however it also applies more widely to other provision within the School including short courses. For distance learning (DL) modules and courses, School procedures have been designed to meet the requirements of the University of London International Programmes Guidelines for Examinations (2013-14). Areas where DL procedures differ have been indicated throughout. Should any discrepancy arise, the regulations and policies of the International Programmes are expected to take precedence. For collaborative courses, including intercollegiate MSc courses taught jointly with other University of London colleges, the partner institution s procedures will normally apply in respect of modules they lead, and/or where the Memorandum of Agreement for the course specifies that their assessment model should apply at the level of the course overall. This handbook does not cover research degrees, except where research degree students may take a taught course as part of their studies. 6. In the event of any inconsistency between the information in this handbook and any other School document, advice should be sought in the first instance from the Head of Registry. 2
CONTENTS INTRODUCTION... 2 CONTENTS... 3 OVERVIEW OF ASSESSMENT PROCESSES... 4 ANNEX 1: ASSESSMENT CODE OF PRACTICE... 10 ANNEX 2: MODULE ASSESSMENTS... 19 ANNEX 2A: ASSESSMENT FEEDBACK FORM... 22 ANNEX 3: UNSEEN WRITTEN EXAMINATIONS... 23 ANNEX 3A: EXAM PREPARATION SUPPORT FOR STUDENTS... 26 ANNEX 4: PROJECT REPORTS... 28 ANNEX 5: SPECIAL EXAMINATION ARRANGEMENTS POLICY... 30 ANNEX 6: GUIDELINES ON INFORMATION RETENTION AND DISCLOSURE... 32 3
OVERVIEW OF ASSESSMENT PROCESSES Introduction 1. The notes below describe key elements of the assessment lifecycle at the School as described both later in this handbook, and in the separate Exam Board guidance. General principles Assessment code of practice 2. The Assessment Code of Practice, given at Annex 1 of this handbook, is the key document setting out assessment principles to be followed at the School. The overall aim of assessment is to facilitate students learning regarding key elements of each course and module, and to test that the student has reached the minimum standard acceptable for the award. The School uses a standard assessment scale of six integer grade points (GPs), defined in both the Assessment handbook and the Award Scheme. These are 5 = Excellent (distinction standard), 4 = Very good, 3 = Good, 2 = Satisfactory, 1 = Poor (unsatisfactory), and 0 = Very poor. Grades 2 and above are pass grades, whilst grades below 2 are fail grades. Where an assessment is made up of more than one individually-graded task (e.g. a module with both groupwork and essay tasks), grades may be combined according to the relevant weightings to generate a grade point average (GPA), with figures to two decimal places. 3. Key details about assessment methods and requirements are set out in published programme specifications for each award-bearing course, and in module specifications for modules. 4. The School operates a credit system covering the bulk of award-bearing and modular provision. Under this, credits are gained for passing individual modules or degree elements, and degree awards are determined on the basis of accumulating the required number of credits from prescribed or permitted modules and degree elements. 5. Each course has a formal Award Scheme used to determine the award of degrees, diplomas or certificates there is a generic Award Scheme for face-to-face MSc courses, another for DL courses, and specific individual Schemes for all others e.g. award-bearing short courses. Award Schemes have the status of regulations. The School s Taught Course Regulations specify some further generally-applicable assessment requirements, all of which are fully explicated within the Assessment and Exam Board guidance. Exam Boards 6. Assessment for each award or set of awards (relating to a course) comes under the authority of a specific Exam Board, operating in parallel to the Course Committee. Oversight of module assessment also comes under the authority of specific nominated Exam Boards. Students grades are confirmed and awards ratified at final Exam Board meetings annually. Full terms of reference for Exam Boards and standing orders for the conduct of meetings are set out in the Exam Board guidance pages. 7. Each Board includes: An Exam Board Chair and Deputy Chair who co-ordinate activities; One or more External Examiners who help to provide specific external confirmation about academic standards and the rigour of assessment processes; 4
Further Internal Examiners (staff members) who are involved in setting exam questions, marking all types of assessed work, and take part in final Board meetings. 8. Assessors may be appointed to assist Exam Boards in the setting, conducting and marking of assessments. They are not Exam Board members and cannot confirm grades or ratify awards. Setting and conducting assessments Setting assessment tasks 9. Clear marking criteria and guidance must be prepared for all assessments. Further guidance on this is given in the Assessment code of practice (Annex 1), including guidance on setting more detailed criteria for qualitative or quantitative assessments, use of numeric marking schemes where appropriate, principles for combining grades, etc. Students should also be made aware of the broad criteria against which each assessment task will be marked. 10. Module Organisers have substantial delegated authority (under the oversight of the responsible Board) for setting module assessment tasks and criteria. Further guidance about this is given in Annex 2. 11. Exam Boards are responsible for setting course-level exam papers and associated marking criteria/guidance. This is co-ordinated by Exam Board Chairs, with internal Examiners being involved in writing exam questions and External Examiners in reviewing final drafts. Some further pointers about this are given in Annex 3; with more comprehensive guidance, including a standard timetable and security procedure for setting and signing off MSc exam questions in the Exam Board guidance pages. 12. Exam Boards are also responsible for setting criteria, requirements and marking schemes for MSc projects. Further guidance on this is given in Annex 4. Conduct of module assessments 13. Module Organisers have substantial delegated authority (under the oversight of the responsible Board) for co-ordinating module assessment arrangements, including arranging coursework submissions, module exams, tests and practicals. Further guidance about aspects of this is given in Annex 2. Conduct of unseen written examinations 14. Strict rules apply to the conduct of unseen written examinations, as described at Annex 3. Administrative support for exams is provided by the Registry and Teaching Support Office, or for distance learning courses by the DL Office and the International Programmes Exams Office. Special student circumstances and requests Adjustments for timed and written assessments Special arrangements may be made for candidates who are ill, disabled, pregnant or have other just cause to require them. Students should contact the Student Adviser and arrange a meeting to discuss options for assessment adjustments. Requests for adjustments need to be supported by appropriate documentation (e.g. medical evidence or an Educational Psychologist's report) and must be approved by the Head of Registry (or their nominee) in line with the Exam Regulations. Arrangements that may be made at the discretion of the Head of Registry include special seating (e.g. a separate room), 5
use of a computer, use of an amanuensis, permission to take food and drink into an exam, rest breaks and additional time in exams for registered-blind candidates (who may also be given Braille/enlarged papers) or up to 25% additional time for those who can supply medical evidence or an educational psychologist s report (e.g. regarding dyslexia), etc; Extensions to coursework hand-in deadlines may also be given based on valid reasons, by the Head of Registry (or their nominee) for disabled or pregnant candidates; or by the relevant Taught Course Director for all other candidates; Any other requests will be considered by a special examinations committee. Extensions and deferrals 15. Clear deadlines are set for the submission of all assessed coursework, and likewise dates for examinations are scheduled and notified well in advance. Students who are aware that they may anticipate problems meeting a coursework deadline or taking part in an examination can request an extension or deferral from their Faculty Taught Course Director, in line with guidance set out at in the School s Extensions & Deferrals Policy. These will only be given where there are valid supporting reasons: An extension will typically be for a matter of days or at most weeks, with the expectation that the work can be marked in time to go forward to the same Exam Board meeting due to confirm grades for other work submitted at the original deadline. This is possible for coursework only; A deferral means the student should submit at the next scheduled assessment deadline or opportunity (e.g. the year-end re-sits deadline for F2F modules, or in the following year for F2F exams and projects or DL work), and may need to undertake a slightly different assessment task for this purpose. 16. Alternatively, students may request an Interruption of Studies if a personal emergency or other circumstance arises which necessitates a break in their course of study Extenuating circumstances 17. A separate Extenuating Circumstances policy describes how to deal with cases where students ability to take or perform in assessments are affected by unforeseen circumstances. Key elements to be aware of are: Students must raise such issues at the time of their occurrence, to be considered by the Extenuating Circumstances Committee (ECC), rather than waiting until the final Board of Examiners; Where the ECC finds a student has valid extenuating circumstances, this will be recorded and reported to the final Board of Examiners. If the student has failed, and subsequently fails to gain credits, the Board of Examiners may permit them a new attempt at the assessment at the next scheduled opportunity. New attempts will not count as a re-sit, unless the student has already had a re-sit attempt for the affected assessment; Boards of Examiners may consider such circumstances, alongside a portfolio of work, when determining awards for borderline candidates. However, Boards of Examiners may not re-grade work in light of extenuating circumstances. Marking and grading Marking student work 18. Marking by examiners and assessors is carried out primarily under the direction of Module Organisers and Faculty Taught Course Directors for modules, and under the direction of Exam Board Chairs and Faculty Taught Course Directors for exams and projects. 6
19. Wherever possible, assessed work should be marked with students identity remaining anonymous. Candidate numbers provided by the Registry are used to achieve this. 20. Formative assessments which do not count towards credits or an award do not need to be double-marked, but defined marking criteria and sampling of scripts should be used to assure consistency 21. As set out in Annex 1, all summative assessed work is double-marked by two markers. Each should grade it without knowledge of the other s mark. Markers are encouraged to use the full range of available marks (the 0-5 grading scale), to reflect the full range of student achievement. Markers must jointly discuss and reconcile any substantive differences in grades, to be able to give an agreed grade to the student. 22. Along with provisional grades, students are given individual feedback for module coursework (see template at Annex 2a) and projects. 23. Further pointers about marking module work are given in Annex 2, about marking exams in Annex 3, and about MSc projects in Annex 4. 24. Following initial module grading, Module Organisers should look at the distribution of grades for their module. If this deviates significantly from past performance or other key comparators, this should be considered in more depth. In some cases, Module Organisers may wish to recommend re-marking, procedures for which are detailed in the Module Moderation policy. 25. Boards of Examiners will review provisional grades for exams and projects prior to confirmation, with External Examiners specifically moderating samples of work. Grades may be adjusted where appropriate using the guidance given in the Exam Board guidance pages. Plagiarism and assessment irregularities 26. The Assessment Irregularities Procedure for taught courses sets out comprehensive procedures for identifying and acting on plagiarism, cheating or any other form of suspected assessment irregularity. Key elements to be aware of include that: Course handbooks give definitions of plagiarism and other assessment irregularities, provide outline guidance on good referencing practice, and refer students to the School s comprehensive Academic Writing handbook for further information. Before the first time they submit any in-course work for assessment, all students are required to sign and submit a form to declare they have read, understood and will follow the School s definitions and guidance. These forms are held on file by the Teaching Support Office or Distance Learning Office; If a case of plagiarism or cheating is suspected, the Assessment Irregularities procedure which forms part of the overall policy should be followed. Any such cases should be dealt with before any student grades are brought forward for consideration by an Exam Board if a case is still in progress, provisional confirmation of grades for affected work will be suspended, and thus Exam Boards should not be asked to confirm them; The Assessment Irregularities procedure allows for a number of grade penalties to be applied, including marking down of work. Exam Boards will only be asked to consider student performance after such penalties have been applied (e.g. to confirm if a re-sit is required where a student has been given a fail grade due to plagiarism). 7
Moderation of grades 27. Both F2F and DL modules may be taken by students from across different courses. Module grades therefore need to be confirmed before any relevant Exam Boards meet to ratify awards or make re-sit recommendations. As set out in the separate Module Moderation policy: The relevant Exam Board Chair, or another nominated member of the Board (who may be an External Examiner), should act as Moderator to review and confirm grades on behalf of all Boards whose students have taken the module. Moderators should not normally have been involved in any of the assessments, e.g. question-setting or marking, for the module they are moderating; The Administrator for each module sends their Moderator details of the assessment task, marking guidelines and grading criteria, a sample of assessed work (at least six scripts, two from each of the top, middle and bottom of the grade range) plus relevant information on grades and grade distributions etc. The Moderator must carefully review all this material to be able to confirm the validity of marking; The procedure allows for re-marking if the Moderator identifies a problem in which case they must first review a wider sample of all potentially-affected work, so all students who may have been affected are considered for re-marking. Any or all of the reviewed work may then be re-graded, by either the Moderator or their nominee. The Moderator should consult with the Module Organiser before ratifying any re-marking; Finally, a Moderator s Report must be completed and returned to confirm moderation has happened. As standard, all modules should be moderated within 4 weeks of the assessment being marked. All moderation must be completed by a set deadline, ahead of Exam Boards meeting in July (F2F Boards hold interim meetings then to determine which students should re-sit in September, while DL Boards hold the first of two final meetings). 28. After module grades have been confirmed through moderation, then for F2F modules this changes the status of grades from provisional to confirmed, and they may not be altered by subsequent meetings of any Exam Board. For DL modules, grades technically remain provisional after moderation, pending confirmation by a final Exam Board. 29. External Examiners are also required to review samples of exam and project scripts, to confirm the validity of marking ahead of the final Exam Board meeting. This is known as moderation of exams and projects, and operates similarly to module moderation. External Examiners will likewise be sent samples of assessed module work to review; but this should already have been moderated, and (for F2F modules) the grades will not be amenable to change. Information retention and disclosure 30. Annex 6 gives provides guidance on information retention and disclosure, including regarding marking criteria, assessment scripts and any markers comments. Assessment outcomes Exam Board meetings and use of the Award Scheme 31. Final Exam Board meetings review and confirm candidates grades and ratify final degree awards based on the agreed Award Scheme for each course (see the Exam Board guidance for F2F MScs, or published separately for other courses), which forms part of the regulations. 8
32. To make classification decisions for any candidates in a borderline range, the Exam Board Chair and External Examiner(s) should review relevant portfolios of work ahead of final Exam Board meetings. 33. Exam Boards also make recommendations about students progression status, including re-sits for those who have failed. 34. It should be noted that in addition to passing required assessments, active participation in relevant modules or courses is a requirement for the award of credits or degrees, and Exam Boards may decide not to confirm results for students deemed not to have participated fully. The School s attendance expectations are defined in the Student Attendance Policy. Re-sits 35. A separate Re-sits policy describes the School s procedures for dealing with assessment re-sits. Exam Boards will need to make re-sit recommendations for each candidate who has failed a degree element, including about requirements or options and related timing; Students can only re-sit where they have failed to gain credits for a particular degree element. Only failed components of credit-bearing elements may be re-sat. Failed modules or exam papers cannot be re-sat if they are compensated by other results, in line with the Award Scheme. Students cannot re-sit degree elements or components they have passed in order to improve their GPA. Re-sit grades should be capped to a maximum GPA of 3 at the level of the creditbearing element. Only one re-sit of any component is permissible. The guidance makes clear when re-sits should be taken. Key aspects include that F2F module re-sits may not be arranged in-year, and must be scheduled for a specific re-sit period at the end of the year (after project hand-in); while project re-sits may be specified as either revise and re-submit with a two-month deadline, or to undertake further data collection and revisions or an entirely new project for the following year s deadline. DL re-sits and F2F exam re-sits should be taken the following year. Academic Appeals 36. Full details of the School s Academic Appeals Policy & Procedure are available on the School s website. Other documents of interest 37. Staff involved in assessment should also be aware of other relevant School codes of practice, including about Course and Module Design, Annual Monitoring, Student Feedback, Student Support, and Orientation & Induction. 9
ANNEX 1: ASSESSMENT CODE OF PRACTICE Policy Aims of assessment at the School 1. For all School courses, the overall aim of assessment is to facilitate students learning regarding key elements of each course and module, and to test that the student has reached the minimum standard acceptable for the award. Objectives of assessment at the School 2. The specific objectives of assessment are to: (i) Measure the achievement of specified learning outcomes in a valid, robust, reliable and fair way. (ii) Identify whether each student has attained a minimum level of achievement necessary to pass the course or module, and identify those who fail to achieve that level. (iii) Support desirable learning strategies, including to focus learning on the important aspects of each course or module and provide a means of encouragement. (iv) Provide feedback on performance so that learning may improve. (v) Interfere as little as possible with other important, but ungraded, aspects of students educational experience. (vi) Identify those students achieving the highest standards so that they can be considered for a Distinction. Key areas of policy 3. The School recognises that assessment is an essential component of teaching and learning. Specifically, School policy is that: (i) Assessment should be related to the intended learning outcomes and content of each course or module, and cover both essential outcomes and the range of potential learning that students may be expected to demonstrate. (ii) Grading must be criterion-referenced, testing achievement against a specified set of abilities, skills and behaviours (although the award of Distinction may take into account the proportion of students achieving the highest grades). (iii) Grading criteria should ensure that all students achieving a minimum standard will pass the relevant course or module, subject to full participation. (iv) Sufficient information about grading criteria should be made available with each assessment task so as to give both students and markers a broad understanding of what is required to pass or do well. (v) Assessment must be integrated with learning and not used merely as a grading process. (vi) Assessment should reward critical appreciation and the ability to apply what has been learnt, and minimise reward of the passive reproduction of memorised facts. (vii) Feedback to students about in-course assessment performance is an important part of assessment, and must be given in sufficient detail to help students learn and improve for the future. (viii) Elements of formal assessment towards an award should be set to assess student achievement at the appropriate level (e.g. Master s degree, Postgraduate Diploma, Postgraduate Certificate), in line with the Framework for Higher Education Qualifications in England (FHEQ) published by the Quality Assurance Agency. (ix) To be eligible for an award (e.g. MSc, Diploma, Certificate) students must have participated fully in the whole of the period of study specified for that award. 10
4. In addition: (i) The grading process will be subject to rigorous quality assurance procedures, including moderation by nominated Moderators and sampling by External Examiners. (ii) Any suspected assessment irregularities (including, plagiarism, cheating or fraud, as defined by the School) will be subject to procedures and penalties as detailed in the Plagiarism and Assessment Irregularities policy. (iii) Where assessment of individual students has been affected by unforeseen extenuating circumstances, this should be taken into account according to the procedures set out in the Extenuating Circumstances policy. (iv) Students who fail assessments such that they fail to gain credits for a relevant module or degree element should be granted a re-sit opportunity by the relevant Exam Board in line with the Re-sits policy. Credit, award schemes and assessment structures 5. The School operates a credit system covering the bulk of award-bearing and modular provision. Under this, credits are gained for passing individual modules or degree elements, and degree awards are determined on the basis of accumulating the required number of credits from prescribed or permitted modules and degree elements. Certain courses including certain joint courses or short courses may operate under different systems. 6. Each award-bearing course will have a formal Award Scheme, approved as part of formal Regulations, which is used to determine the award of degrees. All modules and degree elements taken should be expected to be assessed and used to determine the award of the degree. Credit values and any weightings (to be used when calculating overall performance for classification purposes) should be clearly specified. There may be allowance for compensation between or within different elements. In the event that a student has been assessed on more modules or degree elements than are required, the responsible Exam Board should determine whether an award may be given, and which modules are counted towards it. The School uses standard award criteria of Pass and Pass with Distinction and Fail. Students who do not gain sufficient credits to be awarded their degree will either have the opportunity to take or re-sit last elements in which credit is required, or else exit the programme without a degree but with a transcript showing the modules or degree elements they have taken. 7. Each award-bearing course will also have a programme specification, specifying the mix of compulsory or elective elements which may be taken to obtain the relevant award(s), and indicating the major assessment methods in relation to the course s intended learning outcomes. In line with the Course & Module Design code of practice, this should ensure that overall assessment of each degree is based on an appropriate mix of assessment methods, e.g. examinations and coursework. 8. Individual modules will each have a module specification, setting out details of the content covered and the method of assessment. 9. For Master s degrees taught face-to-face at the School in London, all programmes will be composed of modules, final qualifying exams, and a project report; and some programmes may also include a practical exam or exams. Modules from Term 1 will be assessed through final qualifying exams (unseen written papers, totalling six hours in length, taken under formal exam conditions) in the summer. Modules from Terms 2 and 3 will be 11
assessed using in-course assessment, which may include coursework, unseen written exams or other forms of exams, groupwork, or other appropriate methods. 10. For degrees delivered by Distance Learning, all programmes will be composed of modules, which may be assessed by either examinations taken under formal conditions, coursework or a combination of both. Some programmes may also include a project report and/or final qualifying exam(s). Anonymity 11. Wherever possible, assessed work should be marked blind, i.e. without knowledge of which students have produced which piece of work (exceptions to this will include oral presentations, some forms of groupwork, projects which are second-marked by the supervisor as a matter of course-specific policy, etc.). All students are given an anonymous candidate number, which will change each year and be different to their student number, for the purpose of identifying submitted coursework and exam scripts. Grading principles The School s grading system and grade descriptors 12. The School uses a standard assessment system, marking against six gradepoints: integers from 0 to 5. Grades 2 and above are pass grades (grade 5 can be seen as equivalent to distinction standard); whilst grades below 2 are fail grades. Table 1 below sets out the standard descriptors for matching standards of assessment to gradepoints: Table 1 Grade point Descriptor Typical work should include evidence of 5 Excellent Excellent engagement with the topic, excellent depth of understanding & insight, excellent argument & analysis. Generally, this work will be distinction standard. NB that excellent work does not have to be outstanding or exceptional by comparison with other students; these grades should not be capped to a limited number of students per class. Nor should such work be expected to be 100% perfect some minor inaccuracies or omissions may be permissible. 4 Very good Very good engagement with the topic, very good depth of understanding & insight, very good argument & analysis. This work may be borderline distinction standard. Note that very good work may have some inaccuracies or omissions but not enough to question the understanding of the subject matter. 3 Good Good (but not necessarily comprehensive) engagement with the topic, clear understanding & insight, reasonable argument & analysis, but may have some inaccuracies or omissions. 2 Satisfactory Adequate evidence of engagement with the topic but some gaps in understanding or insight, routine argument & analysis, and may have some inaccuracies or omissions. 1 Unsatisfactory / poor (fail) Inadequate engagement with the topic, gaps in understanding, poor argument & analysis. 0 Very poor (fail) Poor engagement with the topic, limited understanding, very poor argument & analysis. 12
0 Not submitted (null) Null mark may be given where work has not been submitted, or is in serious breach of assessment criteria/regulations. 13. Summative assessment combines these marks into non-integer gradepoint averages (GPAs) in the range 0 to 5, by averaging against relevant weightings see section further below on principles for combining grades. 14. The standard pass threshold for any degree component or module result is GPA 2.00. However, in describing results for elements of work below module level, or for individual exam questions, the grade should simply be quoted without describing it as a pass or fail, as those are not necessarily meaningful terms at those levels. 15. The criteria used to place students in each grade category must be written down by staff setting assessments, and adhered to by marking staff. They should be broadly consistent with Table 1 above, although specific requirements will differ from assessment to assessment. The generic School descriptors are intended only as a general guide and starting point to develop detailed marking criteria for particular assessment tasks. 16. Table 2 below gives some further very general suggestions for criteria that might apply for either quantitative or qualitative assessments, to appropriately distinguish different standards of work for the task concerned. Table 2 Grade point Simple general criteria for qualitative work (e.g. essays or other written assignments) 5 A comprehensive discussion of the topic giving all relevant information, showing indepth critical understanding of the topic, going beyond conventional answers, and bringing in additional relevant ideas or material. 4 A full discussion of the topic that includes all relevant information and critical evaluation. 3 The major points are discussed, but relevant, though less important considerations, are omitted. 2 Sufficient relevant information is included but not all major points are discussed, and there may be some errors of interpretation. 1 A few points are included, but lack of understanding is shown together with use of irrelevant points. 0 None of the major points present; many irrelevant points included and a serious lack of understanding. or Not submitted. Simple general criteria for quantitative work (e.g. multiple choice questions, mathematical questions, laboratory spot tests) All correct. Almost all correct, none incorrect. Most correct, a few incorrect allowed. Essential parts correct (to be defined for each task), some incorrect. Some correct but essential part (to be defined for each task) incorrect or unknown. Very few (or none) correct, essential part incorrect. or Not attempted. 13
17. Students should be made aware of the broad criteria against which each assessment task will be marked, to improve their understanding of the standards expected of them. Percentage or numeric marking: 18. Percentage or numeric marking schemes may be used for some elements of work, e.g. where the assessment is based on mathematical questions or yes/no questions or multiplechoice questions. In any such cases, percentages or numeric mark totals (e.g. out of twenty ) should be converted to an integer gradepoint (GP) on the standard scale, which is reported to the student and can be taken forward for combination with other grades. Students may also be given visibility of their percentage or numeric mark. 19. The School does not set any fixed percentage to gradepoint conversion scheme. Rather, the conversion should be done using a scheme agreed in advance by the relevant Board of Examiners, which best fits the particular assignment or question. The approved conversion should appear in the marking pack for each assessment/question for which it is to be used. Table 3 below gives examples of three different percentage-to-gradepoint conversion charts. Table 3 Example Example Example Mark (%) Grade point Mark (%) Grade point Mark (%) Grade point 80-100 5 95-100 5 75-100 5 70-79 4 85-94 4 60-74 4 60-69 3 75-84 3 45-59 3 50-59 2 60-74 2 30-44 2 40-49 1 50-59 1 20-29 1 <40 0 <50 0 <20 0 (typical scheme) (higher numeric pass threshold) (lower numeric pass threshold) 20. While individual assessments may use specific marking schemes in this way, as most appropriate for them, all schemes must remain compatible with the School s standard assessment framework as set out above (i.e. six-point grading scale covering 0=very poor, 1=unsatisfactory, 2=satisfactory, 3=good, 4=very good, 5=excellent). Any deviations from this should be addressed by the relevant Board of Examiners. Describing standards of work in student feedback 21. Whilst all marks should be reported to students as numeric gradepoints or GPAs (NB that grade letters should never be given), the descriptors in Table 1 such as very good or satisfactory can helpfully be used in feedback to students about their assessed module work. However, if using such terms, markers must remain consistent with this standard scheme; e.g. it would not be appropriate to use the word good throughout feedback for a piece of work then graded at 2.0, unless clearly indicating that a specific aspect had dragged the mark down. Further guidance is given in the Teachers handbook. Grade distributions and using the full range of marks 22. Markers are encouraged to use the full range of available marks, to reflect the full range of student achievement. In particular, markers should not feel reluctant to award 5.0 grades provided work meets the appropriate standards. The following specific points should be noted: 14
(i) Excellent work does not have to be outstanding or exceptional by comparison with other students. (ii) Since the School uses criterion-referenced marking rather than banded marking, 5.0 grades should not be capped to a limited proportion of students per class. (iii) There is no standard cut-off for what constitutes excellent work. Different conversion schemes may be used to convert numeric scores or percentage marks into a gradepoint result on the 0-5 integer scale. In many cases where quantitatively-scored assessments are used, a 5.0 grade may be awarded for work scoring above a particular threshold (for example 80%) of the possible marks, i.e. by no means perfect but of a sufficiently high standard. (iv) Good assessment design should ensure that tasks have clear criteria to allow excellent students to achieve 5.0 grades. 23. The School supports Module Organisers and Exam Boards in assuring consistency of marking standards by preparing annual School-wide analysis of module grade distributions. However, grades should not be forced into a standard distribution. Rather, marking criteria should reflect School standards, so student results can be seen as based on individual achievement rather than in any way biased by different module choices. Nonetheless, marking parameters may be set in light of past or typical student performance, in a way that makes it more likely for the final distribution of grades to follow a standard pattern (e.g. with most grades in the 2.0 to 4.0 range, and fewer at the 5.0 range or in the fail range). 24. Group assessment tasks should be anticipated to produce higher standards than individuals would achieve alone. 25. Following the initial grading process, Module Organisers should look at the distribution of grades for the particular module. If this deviates significantly from past performance or appears to differ significantly from other grade distributions at Course, Faculty or School level, this should be considered in more depth to confirm that the marks given are indeed in line with School criteria. In some cases, Module Organisers may wish to recommend remarking, procedures for which are detailed in the Module Moderation policy and Exam Board guidance. Double-marking and reconciliation of grades 26. All assessed work which is summative towards credits or an award must be doublemarked, with any discrepancies between markers being resolved. Neither marker should see the other s comments or grade before assigning their grade. An agreed grade must be given to the student. 27. Marking pairs must agree any marks which are formally reported to students; however below this level (i.e. if an assessment task has informal component elements), markers views may differ provided they can agree the overall grade. 28. Markers may not record two grades for work which they feel is borderline between two grade bands they must always discuss and agree one clear grade for a piece of work. 29. Where two markers disagree about the overall grade to be given to a particular piece of work then the difference must be reconciled by discussion between them, not in some way averaged away. This is intended to ensure that every grade awarded truly represents the quality of the work submitted. Where initial grades differ (in terms of where they place the work on the School s integer grading scale 0-5), a brief note recording the reasoning for the final agreed grade should be included on the marksheet returned to the relevant administration office. If marks (e.g. out of 20, or as a percentage) differ slightly but this does not affect 15
the final grade (0-5) to be assigned to the work, this does not need to be recorded and the markers may report both an averaged mark and the agreed grade to the student. Markers should also be aware that all comments made in connection with marking, such as those to support grade reconciliation, may be disclosed to the student. 30. If discussion between two markers fails to reach mutual agreement on the overall grade to assign to a particular piece of work, it may be referred to a third marker. For modules, the Module Organiser or another appropriate senior marker should be consulted. If there is still any doubt over the grade to assign, the Chair of the Exam Board to which the module has been allocated (as per Module Moderation policy) should be consulted and will take the final decision. For MSc summer exams or projects, if two examiners have been unable to reconcile a grade at major question or formal project component level or for a paper or project overall, a third appropriate examiner (nominated by the Exam Board Chair) should be consulted. Particularly in the case of projects, the External Examiner may often serve as third marker. If there is still any doubt, the Chair should take the final decision. 31. Assessments which are not summative towards credits or an award (usually termed formative assessments) do not need to be double-marked. However, clearly-defined marking criteria and sampling of scripts should be used to help assure consistency in marking formative work. 32. Any grade divulged before the final meeting of the Exam Board is provisional, subject to external review and may be amended at the discretion of the examiners. Principles for combining grades 33. Grades which are directly agreed by markers for individual pieces of work (i.e. module assignments, exam questions, projects or practical exams) should usually be on the sixpoint integer grading scale from 5 (excellent) to 0 (very poor fail). Where it is appropriate to give a more finely-detailed grade, the relevant marking scheme should be set up to define sub-components, marked with gradepoints, which are then combined to determine a Grade Point Average (GPA) on the scale 0-5, but with grades to two decimal places. When combining such individual agreed, e.g. to calculate an overall module GPA or exam GPA, straightforward weighted averages should be used. Calculations and record-keeping systems should mathematically combine and bring forward data without rounding. However, rounding is permissible in: (i) assigning an overall GP to individual module assignments or exam questions which use a numeric marking scheme (as it would be inappropriate to take forward small differences between students which arise at that level); and (ii) reporting of final marks, e.g. on transcripts, which may be rounded to two decimal places. 34. Combined marks should always be reported as a numeric GPA, and not rounded back to an integer gradepoint. However, when feeding back to students it may be desirable to associate a qualitative descriptor with a GPA result. Table 4 below gives a recommended scheme for matching GPAs and descriptors though note that this is not intended to set rigid boundaries between different grades, or affect how integer grades are assigned. Table 4 GPA range Descriptor Associated integer GP 4.50 5.00 Excellent ~ 5 3.60 4.49 Very good ~ 4 16
2.65 3.59 Good ~ 3 2.00 2.64 Satisfactory ~ 2 1.00 1.99 Unsatisfactory / poor (fail) ~ 1 0.00 0.99 Very poor (fail) ~ 0 n/a Not submitted (null) 0 Grading of module assessments, exams and projects 35. Module assessments, examinations (both unseen written exams and practicals) and project reports should all be marked using the standard grading system and procedures detailed above. More detailed guidance about each type of assessment are given in Annexes 2, 3 and 4. Plagiarism and assessment irregularities 36. The Plagiarism and Assessment Irregularities policy sets out comprehensive procedures for identifying and acting on plagiarism, cheating or any other form of suspected assessment irregularity. Student-specific matters relevant to assessment Participation 37. The learning experience for all students, in activities such as seminars, group work, practical exercises and field trips are dependent on student participation and students are therefore expected to attend, be properly prepared, and actively participate in such activities. 38. Further guidance about attendance expectations and procedures for dealing with poor attendance can be found in the School s Student Attendance Policy. 39. If a student persistently fails either to attend or willingly participate in such required activities a Course Director or Module Organiser may judge that the student has not fulfilled the requirements for the award of credits or the degree. This will be reported to the relevant Exam Board. Regardless of the grades or credits obtained in any assessed work undertaken by the student, the Board may decide to refuse to ratify credits or award the degree on the grounds that the student has failed to participate fully, in the manner appropriate to the course or modules (appropriate participation requirements will vary, e.g. between face-to-face and distance learning modes). No such decision shall be taken by the Board without considering any extenuating circumstances reported to it by the Head of Registry or his/her representative, who will attend Exam Board meetings. Special examination arrangements 40. Special examination arrangements may be made for candidates who are ill, disabled, pregnant or have other just cause to require them. Procedures are set out in the Extensions & Deferrals Policy. Extensions and deferrals 41. Students who are aware in advance that they anticipate problems meeting a coursework deadline or taking part in an exam can request an extension or deferral from their Faculty Taught Course Director, in line with policy set out in the Extensions & Deferrals Policy. 17
Interruption of Studies 42. Students should request an Interruption of Studies if a personal emergency or other circumstance arises which necessitates a break in their course of study. This should be done immediately or as soon as possible after the issue arises. Retrospective interruption of studies is not permitted. No fees are payable for a period of interruption of studies, during which the student's registration is suspended. Students are not eligible to attempt exams or assessments, during this time. As an alternative to interruption of studies, in some cases (and where assessment requirement are involved) it may be more appropriate for students encountering specific problems to seek an extension or deferral beforehand, or request extenuation thereafter, as per separate policies. Any extenuation must be claimed within three weeks of the relevant assessment date/deadline. Extenuating circumstances 43. A separate Extenuating Circumstances policy describes how to deal with cases where students ability to take or perform in assessments is affected by unforeseen and/or exceptional circumstances. Re-sits 44. A separate Re-sits policy describes the School s procedures for dealing with assessment re-sits. MSc Award Schemes set out top-level criteria for what constitutes a fail for distinct elements or components of each degree, whether this may be compensatable, and thus whether students may be eligible to re-sit a failed element (e.g. exam papers, the project, or a module assessment). In such cases, the Exam Board will make recommendations on resit requirements or options and related timing for each candidate. Academic Appeals 38. Full details of the School s Academic Appeals Policy & Procedure are available on the School s website. 18
ANNEX 2: MODULE ASSESSMENTS 1. The notes below describe standard policy and practice for the assessment of individual modules, also known as in-course assessment, which may include coursework, unseen written exams or other forms of exams, groupwork, or other appropriate methods. Further guidance relevant to unseen written exams is given in Annex 3. Objectives and nature of module assessment tasks 2. The tasks set for all module assessments should both aid the learning process and assess the achievement of the intended learning of that module. Assessment tasks must be integrated with the learning process and should not be mere add-ons. Where the understanding of new knowledge needs to be tested, this can be done during the course (for example, through untimed written answers to suitable questions) or through an unseen test at the end of the period. Where the ability to do a complex task is an essential outcome, the achievement of this task should be assessed. Where the ability to tackle a problem within a group, and not only as an individual, is an appropriate outcome, then a group task that is integrated into the learning process may be assessed. However, all groupwork assessments must be integrated with an element of individual assessment it is not appropriate for overall module assessment to be based solely on groupwork which does not distinguish the varying contributions of students or their individual level of learning achievement. Amount of in-course assessment 3. Assessment must not dominate the learning process. The number of assessed assignments should not exceed two in any module; normally one assessment will be sufficient. The amount of time needed to complete assessment tasks must be calculated realistically; extra non-contact time may be needed for some tasks to prevent the total learning time from exceeding permitted limits. Further guidance is given in the Course and Module Design code of practice. Setting and administering in-course assessments 4. All aspects of module assessment are subject to the agreement and authority of the Exam Board responsible for moderating that module. Boards should normally delegate authority to the relevant Module Organiser(s) to co-ordinate in-course assessment arrangements as set out in the relevant module outline. Separate clear procedures are in place for agreeing any changes to the module specification or the description of the assessment task which it contains. 5. Under authority of the Exam Board, Module Organisers are required to set clear assessment criteria and marking guidance for modules. These should cover any penalties which may be imposed for breach of the module-specific criteria, e.g. exceeding a set word length. Note that penalties for late submissions are standard across the School (as described in the Extensions & Deferrals Policy) and must be adhered to. 6. Marking guidance should facilitate equitable and transparent treatment of students. Penalties should not be unduly harsh or lenient a typical scale would be to downgrade by one grade for the first level of breach (e.g. going over the word limit), with further penalties as appropriate according to the severity of the offence (e.g. downgrading by two or more grades, or grading as a zero mark, or not marking the work at all). Taught Course Directors will be expected to maintain awareness of procedures across modules, and advise on marking criteria which appear to be exceptions. 19
7. Students should have visibility of the module assessment criteria prior to assessment taking place, either via broad principles set out in the module outline, or more detailed guidance disseminated by the Module Organiser(s). The criteria should give clear information about penalties, especially for anything which would constitute an automatic fail. Module specifications or other appropriate module information should indicate when work that has been downgraded to a fail may be eligible to be re-sat. 8. Pairs of markers should agree and apply any module-specific penalties in line with criteria set by the Module Organiser(s). These criteria should make clear where and to what level a penalty should be invoked, e.g. a high-quality piece of work which goes just over the word limit may quite rightly be treated differently to a disorganised and extremely over-long piece of work. Markers will always be required to exercise a degree of subjective judgment, but this should be within the parameters defined by the Module Organiser(s), to ensure that students are treated equitably. 9. Students must be registered for the correct module, and will automatically receive a null fail grade (0) for any assignments associated with any module(s) for which they are not correctly registered. The School only allows changes to module choices after set deadlines in exceptional circumstances. For face-to-face courses, in no circumstances will changes be allowed after the first week of the module commencing. Combining grades for module (in-course) marking: 10. Most modules are expected to have a single assessment which is marked on the integer grading scale. For modules where more than one assessment component is specified in the module outline (e.g. both individual and groupwork elements), these components should be marked individually on the integer scale, and the grades combined into a GPA according to an agreed weighting. Such components must be clearly defined: being spelt out in the module outline (e.g. individual versus groupwork elements), with each component being individually double-marked and marks agreed by markers, and with componentspecific grades and feedback being reported to the student so that the student could check their module GPA based on the component GPs they have been given. Where a module has distinct assessment components like this, the combined GPA should be brought forward as the module result rather than being rounded to an integer. 11. For module assessments which are qualitative, it is permissible for the Module Organiser to give students guidance regarding rough components or scoring for how an overall mark will be arrived at (e.g. one-third for background, one-third for analysis, one-third for conclusions). 12. Module assessments with a numeric (quantitative or percentage-based) marking scheme should be treated as consisting of a single component, unless there is a good reason to break into multiple components which are spelt out in the module outline and fed back on individually to students. Such assessments should first be scored against their own specific grading scheme, with the summed result then converted to an integer gradepoint (not a GPA) which is reported to the student and taken forward. An appropriate specific conversion scheme should be used, which will normally require rounding of the numeric mark. 13. It is also permissible for modules to use numeric marking schemes which convert marks directly to an overall GPA rather than a gradepoint but only for quantitative work with an objectively-grounded marking scheme, such that if necessary the task could be split in many discrete sub-components and markers required to agree marks/grades for each such sub-component (e.g. for every question in an MCQ test). Tasks where such an approach is used must always have a sufficient weight and depth of questions/sections to match the granularity of the marking scheme, allowing differences in student performance to be 20
objectively distinguished. This is not recommended as a default approach, and any staff wishing to introduce such a scheme should discuss this with the relevant Taught Course Director first. 14. For quantitative assessments, as at present it should be good practice for students to be given a reasonable idea in advance of how the marking will operate, and question papers or assignment details should make clear what proportion of the total marks may be awarded for each question/section. Feedback of progress to students 15. The system of feedback should be made clear to students before they undertake their first piece of in-course assessment. For courses taught face-to-face in London, this may be set out in course handbooks and should be explained or restated by the Course Director at an appropriate point. For courses delivered by Distance Learning, details of what students can expect will be made clear in course and module handbooks or other materials as appropriate. 16. Students should be given feedback on their progress within a defined time period, measured in weeks, during which double-marking takes place, feedback is written, and grades and feedback are passed to Course Administrators in the Teaching Support Office or DL Office to send to students. Feedback will consist of full comments on the piece of work plus a grade, the former being used to give informative guidance to the student on progress made. For courses taught face-to-face in London, the standard turnaround time for marks to be agreed and feedback given to the student is within either three weeks of the deadline for handing in the work in term time, or the end of the first week of the next term, whichever is later. For courses delivered by Distance Learning, turnaround times for marks to be agreed and feedback given to the student may be more variable; but clear guidance on the timeframe within which this should happen will be given to all marking and administrative staff. 17. A standard pro-forma for giving students feedback about assessed module work is given at Annex 2a. More guidance and good practice for giving students feedback about their assessed work is available in the Teachers handbook. Moderation of assessed module work 18. After having been marked, and provisional marks fed back to students along with written comments, module grades should be formally moderated. This entails scrutiny of a sample of work (from across the top, middle and bottom of the grading range) by a designated Moderator from the Exam Board with authority over the module. This is described in separate comprehensive Module Moderation procedures. Module assessment and Exam Boards 19. Boards of Examiners must receive sufficient information on in-course assessment to be able to review marking criteria across modules and adopt remedial action if a serious lack of comparability emerges. All in-course assessed work must be available to the External Examiners. Under the authority of the relevant Faculty Teaching Committee, the Teaching Support Office and Distance Learning are required to set up systems to hold a file of each student's in-course assessed work, and of results by modules. This must be in place prior to the start of the June examinations. If a portfolio of student work is later required for consideration by the Board of Examiners, it should be taken from these filing systems. 21
ANNEX 2A: ASSESSMENT FEEDBACK FORM ASSESSMENT FEEDBACK 1st Marker only: Please use this form to give feedback cover the points listed below in sufficient detail, a few sentences only is unlikely to be adequate. Check the comments after grade reconciliation with your second marker to ensure they are commensurate with the agreed grade. Student No Module Code Assignment Title/type Summary of the main strengths and weaknesses of the work plus specific comments illustrated with reference to the student s work. Comments may refer to the work s content, structure, use of literature, understanding, rigour of argument, presentation (where appropriate), etc. An explanation of the grade given should be included. Referring to the grade criteria, explain why the grade awarded is not better and indicate how the work might have been improved. Grade awarded 22
ANNEX 3: UNSEEN WRITTEN EXAMINATIONS About unseen written examinations 1. The notes below describe standard policy and practice for assessment via unseen written exams. These are one of a range of taught course assessment methods used by the School. For face-to-face MSc courses, they are used on some modules and, crucially, in the summer exams. For distance learning courses, the majority of both core and advanced modules have a formal summer exam, often in addition to earlier module coursework. Some of the guidance below may also be applicable to practical exams, for courses or modules which use practicals. F2F MSc summer exams 2. The exam component of F2F MScs consists of two three-hour written examination papers taken in Term 3 after all taught modules have finished. Together these two papers contribute 30% to the final degree GPA (15% each). 3. Paper 1 examines the content of term 1 teaching. It usually comprises questions relating to each of the modules taken in Term 1, which may be core to multiple courses; the same questions (for individual modules) may be shared across Paper 1 exams for different MSc courses. 4. Paper 2 tests candidates ability to integrate the knowledge and skills acquired across the whole of the MSc course. As a whole, it should examine the key knowledge and skills which a candidate graduating with that particular MSc is expected to possess. Questions should require integration of knowledge/skills acquired in different parts of the MSc, and should generally be focused on material from compulsory modules, rather than optional ones which only some of the class may have taken. Where a module is considered central to the award of an MSc, questions about material in that module may be included in the final examination provided that students are specifically informed of this. Distance learning summer exams 5. Most DL modules have a 2-hour summer exam covering the content of that module, which typically contributes towards 70-100% of the module mark. MSc Epidemiology also has a 3- hour qualifying paper (EPM400), which candidates sit in their final year of the course; the paper for this is identical to F2F MSc Epidemiology s Paper 2. Exam question-setting 6. Exam question-setting is undertaken directly under the authority of Exam Boards, and hence described in-depth in the Exam Board guidance pages that contain specific guidance on standard schedules, security procedures and good practice for question-setting, as well as the format of exam papers. Please note that: Exam questions should test a range of knowledge and skills at Master s level testing and rewarding critical appreciation and the ability to apply what has been learnt, rather than the passive reproduction of memorised facts. Grading schemes and criteria should be provided for exam questions and made available to all markers and the External Examiners. Rules for conduct in exams 7. Standard rules for student conduct in examination rooms or halls that is, any test taken under formal assessment conditions are set out in the School s Assessment Irregularities Procedure (paragraphs 22 to 25). This covers written papers taken under supervision and within a defined time limit, as well as any practical, oral or similar examinations, or assessments taken online. 23
All students are expected to understand and comply with these; any offences or misconduct will be treated very seriously, and potentially severe penalties may be levied. Exam hall invigilators are likewise required to understand and apply these rules. Further or different restrictions may be set for individual assessments, tests or exams where appropriate. If variations are agreed and introduced, this must be very clearly spelt out in the examination or assessment criteria (as provided to students in advance). 8. Regarding items or materials which may or may not be permitted in an exam room: Candidates may only use specific books, notes, instruments or other materials or aids where expressly permitted for a particular exam. On entry to an exam room, all belongings (including bags and coats) not expressly permitted for the exam must be placed at the front or side of the examination room, well away from students and in sight of invigilators. Any unauthorised materials, such as books, notes or instruments, must be either placed out of reach in this way, or given to the invigilator. Where electronic calculators are permitted, they must be hand-held, quiet, and with their own power supply; the model used should be stated clearly on the exam script; and candidates are entirely responsible for ensuring that their machines are in working order. 9. Any form of activity which may result in an advantage for a student or students, through subterfuge or in contravention of published rules or guidance, may be treated and penalised as misconduct. The Chief Invigilator has the final say on any such matter. Marking written examinations Marking of exam scripts 10. Paper 1 for face-to-face MScs comprises questions based on Term 1 modules which are often common to several courses. When setting exams using shared questions, MSc Exam Boards must decide whether to (a) have relevant questions marked by module staff (who are likely to mark across multiple MScs), or (b) have relevant questions marked by Exam Board staff (in which case the Board may also choose to modify the questions). Boards must make clear from the start which of these paths they will take: In case (a), the grades for the questions should be moderated by the External Examiner from the Exam Board with authority over the relevant module; In case (b) exams scripts for the MSc should be moderated by the External Examiner for that MSc. 11. In-house Paper 2 is specific to each MSc and thus should always be moderated by the External Examiner for that MSc. Combining grades for written exam marking 12. In most cases, individual exam questions should be marked as a single unit of assessment on the integer grading scale. Individual exam question grades should be combined to give an overall paper GPA. (i) For courses taught face-to-face, Paper GPAs should normally be averaged to give an overall exam component GPA (for MSc exams, Paper I and Paper II will normally both be three hours long, and both be weighted equally as part of the overall exam GPA). 24
(ii) For courses delivered by Distance Learning, the paper GPA for each module exam should normally be combined with the related assignment grade(s), according to an agreed weighting, to produce an overall module GPA result. 13. Exam questions based on numeric marking schemes should convert the numeric result to an integer gradepoint, using an appropriate specific conversion scheme. This will entail rounding at question-result level. Alternatively, at the discretion of responsible Exam Boards (who must have approved a precisely-specified scheme in advance), individual exam questions may be marked numerically with scores combined into a numeric result for the overall paper, which is then converted to a GPA for the paper. Rounding should not normally take place in such cases, as the mark will have been based on a significant weight and depth of questions. 14. Where exam questions have subcomponents which need to be individually graded and double-marked by different sets of markers, these should be marked with individual integer grades and combined into an overall GPA for the question (not rounding to an integer gradepoint) according to an agreed weighting also clearly specified on the exam paper. Alternatively, where appropriate and at the discretion of the exam board, these separate components may be marked numerically (with the marks agreed by relevant pairs of markers) and combined into a single numeric mark for the question, which is then converted to a GPA. Issues with scripts determining what to mark 15. If a pair of markers considers a student s exam script to be illegible, they should refer it to the relevant Exam Board Chair. If the Chair agrees the script is illegible, the script, or that part of the script, should be counted as a fail. 16. If a student answers more than the required number of questions in an exam, all answers should be marked and the best grades counted towards the overall mark. Moderation of exam scripts 17. Exam scripts should be formally moderated by External Examiners from the Exam Boards responsible for specific papers or questions within papers (where questions are shared across several courses). This process is described further in the Exam Board guidance. Note that for questions shared across several courses, Moderation is normally expected to be completed before the final Exam Board meetings of any courses which have used these questions, and Exam Boards cannot subsequently change grades. Feedback on exam performance 18. Students should not expect individual feedback on their exam performance, or to have copies of their exam scripts returned to them. 19. As described in separate guidance on Information Retention and Disclosure (Annex 6), markers must not write comments on scripts. 25
ANNEX 3A: EXAM PREPARATION SUPPORT FOR STUDENTS Supporting students exam preparations 1. This note describes the range of activities, resources and support that are available to assist face-to-face MSc students to prepare for revision and examinations. These are collectively referred to as the Preparing for Revision and Examinations Programme, or PREP. Introduction 2. Many of the School s students are well-versed in the skills required to both undertake revision for the summer exams and perform in the formal written exams themselves. However others, particularly international students, may find this notably stressful, including experiencing anxiety in the actual exams. 3. The School provides a range of support to help students to prepare for revision and examinations. Some of this is available throughout the academic year, and students are encouraged to gain the skills needed for assessment as early in the year as possible. A number of activities are arranged nearer the time in Term 3 to provide additional support for students who needed it. Access to previous exam papers 4. The availability of past exam papers is a key aid to exam preparation and revision. Course Directors should strongly emphasise to students how important it is to use sample papers in their preparation. Every course should ensure that past papers (both Paper 1 and Paper 2 for F2F MScs) are made available via Moodle, along with specimen answers. At least one year s worth of past papers should always be available, and potentially several years worth. Specimen answers should also be provided for between one and a maximum of three academic years, in each case relating to available past papers. Course-level revision sessions 5. Course Directors for all F2F MScs are expected to arrange specific exam preparation sessions for their students during Term 3 noting curriculum areas to be covered, general structural approach of papers (e.g. answering three major essay-type questions from four offered), and general good practice and advice including what is expected from passstandard, good or excellent answers. Module revision sessions 6. Revision sessions for all F2F Term 1 linear modules (those shared across courses) are arranged by the relevant Module Organisers early in Term 3, circa late April / early May. Skills resources available on-line 7. Extensive useful resources are available via the School s Study Skills web-page. Specific support for non-native English speakers 8. The School s English for Academic Purposes (EAP) support programme is aimed at students from across the School s F2F courses whose first language is not English. Sessions place a strong emphasis on the need for students to communicate clearly in any assessed work they write or present. 26
Individual support from personal tutors 9. F2F MSc students are encouraged to discuss any general concerns about revision and examination techniques with their personal tutor. Further academic support through the PASS programme 10. The PASS Programme (Personalised Additional Student Support) is available throughout the academic year, as a means to provide further small-group academic support to identified students, including those who may be struggling with their studies. Referral to the programme is by Course Directors, with approval being given by Faculty Taught Course Directors. Details about the scheme are given as part of the School s Student Support code of practice. Individual support from the Student Advice & Counselling Service 11. Students who are feeling anxious about revision and examinations may be referred, or may refer themselves, to the Student Adviser (Welfare & Disability), who can give one-to-one support and advice. 12. Students with particular anxieties or stress may be referred, or may refer themselves, direct to the Student Counsellor, who can give more extensive one-to-one support and advice. 27
ANNEX 4: PROJECT REPORTS 1. The notes below describe standard policy and practice for assessing project reports. This is mainly focused on MScs, although principles may be applicable for similar types of extended research coursework conducted for other types of course. Project criteria and requirements 2. For every MSc course which includes a project, formal criteria and assessment requirements are set out in a project handbook available via Moodle. Each handbook comprises a part 1 with guidance and requirements applicable School-wide (although this comes in two flavours, for F2F and DL courses); and then a part 2 with course-specific guidance and requirements. Particularly key School-wide criteria include those for project length (i.e. word count, and which sections are counted or where specifically agreed, a page limit rather than a word limit may be applied); deadlines (and extensions); penalties for breach of criteria; and ethics approval requirements. Other standard guidance covers administrative matters such as format for paper and electronic submissions. Course-level guidance will give further details on the expected academic content of projects and more specific criteria which will apply for marking them Aspects of guidance (e.g. submission formats) may on occasion be amended later in the year. If so, this will always be clearly communicated to affected students and staff. Project marking schemes 3. Specific project criteria and marking schemes for each course should be agreed in advance by Exam Boards. These should expand on standard School-wide project marking criteria (c.f. project handbook, School-wide Section 14) that examiners should look for evidence of (i) appropriate learning, (ii) scientific and academic standards, and (iii) critical skills. 4. The most standard scheme will be for markers to agree a straightforward integer grade point mark based on the School s standard grading scale (from 0 to 5). If no more detailed marking scheme has been set, this will be the default system to use. However, alternative schemes may define specific project components to be marked, such as that the component marks can be combined into a non-integer project GPA. Setting the marking scheme 5. Different types of project (e.g. literature reviews versus primary research) may well be felt to require different marking schemes or approaches; but there should not be so many varieties for it to be onerous for individual courses to develop such schemes. Good practice examples of marking schemes are available for a number of courses, which other Boards may wish to consider. It is important for marking schemes to define: different types of project protocol to be marked; the distinct components that markers should be looking for in these; how components should be marked in line with standard School criteria; and, any mathematical weightings or calculations to be applied in order to set (then agree) the overall mark. Operation of more detailed marking schemes 6. Where boards wish to define a component-based marking scheme to generate an overall project GPA, a typical model will be to define three distinct equally-weighted components to be marked with grade points (i.e. on the standard integer grading scale), the component marks then being averaged into a GPA. 28
7. However, a wide degree of flexibility is possible, to best meet the needs of individual courses and the range and variation of project types or approaches which they may support. The number and weighting of components may be adjusted; components may differ between types of projects; and components may be broad and conceptual or more prescriptive. The most important consideration is that if the scheme is designed to produce a precise GPA (rather than an integer grade point), the GPA should be clearly justifiable as being calculated from distinct and specifically sub-marked elements. 8. Alternative approaches may be possible, to various degrees of simplicity or complexity. For example, it may be desirable to have markers grade individual defined components of projects, but then agree and award an overall (integer) grade that is holistic, rather than mathematically calculated from component marks. 9. Such component marking schemes may also provide a good opportunity to better formalise due weights, as currently understood by project markers on many courses, to aid consistency and equity of marking, and provide helpful guidance for markers. 10. It is vital for both markers to agree the final project mark awarded as per standard guidance, any differences must be reconciled by discussion between them, rather than ever being averaged away. Where formal components have been set, allowing an overall GPA to be awarded based on individual component grades (which would be reported back to students), project markers must likewise reconcile their grades for components. Student awareness of the project marking scheme 11. The general outline of the agreed project marking scheme must be published or made known to students, normally via each course s project handbook, prior to students commencing project work. This does not have to be in as great as a level of detail as the scheme which the Board has approved (e.g. some schemes might be illustrated with a model-answer type detail which it would not be appropriate for students to see); but should give a fair and reasonable view of how they expected to achieve the best marks. Where Exam Boards define project components to be marked, it is generally good practice to structure feedback to students along the same headings. Where Boards define formal components to be individually marked and combined into an overall GPA, the component marks should also be fed back to students. Operation of project marking Anonymity 12. The School cannot guarantee anonymity, but appropriate attempts should be made to keep project reports anonymous during initial marking, using candidate numbers only. Some specialist courses may require project supervisors to act as second markers. Moderation 13. Projects should be formally moderated by External Examiners. This process is described further in the Exam Board guidance. Feedback 14. Where possible, students should be given written feedback on their project report. 29
ANNEX 5: SPECIAL EXAMINATION ARRANGEMENTS POLICY Special Assessment and Examination Arrangements 1. Special examination arrangements may be made for candidates for face-to-face taught course assessments who are ill, disabled, pregnant or have other just cause to require such arrangements. These arrangements apply to any term s modules, summer examinations, project or other elements of assessment and examination. For DL exams, a similar procedure exists but applications must be made through the International Programmes. 2. If students are in a position to know in advance that particular circumstances will or may affect their ability to perform in an assessment, they should always advise staff about this in advance. In such cases e.g. long-term medical conditions, religious observance, or family/work commitments known about in advance it may be appropriate to either make special exam arrangements as below, or get an extension or deferral agreed (as per the separate Extensions & Deferrals Policy). It is not normally possible to claim Extenuating Circumstances (as per separate policy) for issues which were known about in advance. 3. Special exam arrangements agreed in line with this policy may be included in Learning Support Agreements for individual students who have a disability, medical condition or other special learning needs. For many such students, appropriate arrangements may need to be applied as standard whenever they take an assessment e.g. to allow them extra time in exams. Standard types of arrangement 4. The following standard types of special arrangements may be made at the discretion of the Head of Registry for any School assessments, providing acceptable supporting documentation is submitted to support the request: Additional time; Special seating; Interruption of an examination; Use of an amanuensis; Permission to take food and drink into an examination; The provision of Braille/enlarged papers for all registered-blind candidates ; Use of a PC;. Non-standard types of arrangement 5. Any other requests which do not fall under the categories/criteria above will be considered by a Special Examinations Committee (SEC). For modules, SEC membership is as follows: the Taught Course Director for the lead Faculty hosting the relevant module and the Head of Registry. For all other examinations or forms of assessment, including projects, SEC membership is as follows: the Taught Course Director with responsibility for the course, and the Head of Registry. On occasion it may also be appropriate to consult with the Academic Registrar. Process for requesting special arrangements 6. Applications by students for special examination arrangements for any assessed work or for the summer examinations must be made in conjunction with discussions with the Student Adviser. 30
Students who need to make such a request are encouraged to do so as soon as possible after registration or after they become aware that they may require such arrangements. Applications for special arrangements must be made in good time prior to assessment. In most cases students should see the Student Adviser to discuss their needs before completing the Special Arrangements form. The Student Adviser can advise on deadlines for making requests in time to have them agreed and put in place; and can assist students to complete the form and where appropriate pass it on to the Head of Registry. Supporting evidence from an independent source must be provided by the student. Recording and applying special arrangements 7. Once agreed, details of all special arrangements for individual students will be passed to the relevant members of the course team and a central record will be held by the Student Adviser. This includes any arrangements arising from Learning Agreements, the full details of which may be held separately. 8. The Registry will ensure that agreed arrangements or adjustments are appropriately communicated and applied. 31
ANNEX 6: GUIDELINES ON INFORMATION RETENTION AND DISCLOSURE 1. These guidelines provide advice to staff on retention and disposal of information and records in relation to teaching, learning and assessment for taught courses. They address the requirements on the School arising from the Data Protection Act (DPA) and the Freedom of Information (FOI) Act. As part of the School s approach to records retention and disposal, similar guidance is available with respect to other types of information such as research data, emails, committee papers etc. The School s approach continues to be to provide information as widely as appropriate and reasonable as it believes this helps reduce DPA and FOI-related requests. General guidance on retention and disposal of data is available online. 2. The main areas covered by these guidelines relate to assessment marking, student files, student references and record keeping by committees and Exam Boards. Terminology 3. Data protection gives individuals the right of access to information on themselves. With some exemptions, Freedom of Information gives individuals the right of access to recorded information held by the School. Both pieces of legislation cover all the records that the School creates. Further information, including on how individuals can make access requests, is available online. Assessment scripts 4. Assessment scripts here indicate any document submitted for assessment including coursework, exams, project report. Assessment scripts are kept in student files in the respective office, e.g. TSO, DL, and should be retained for two years after a student completes the course and then destroyed. Electronic copies of MSc project reports are archived and made available as reference documents by the Library. 5. Under the DPA, a student has the right to see markers comments made on an assessment script but not the actual script itself. If a student asks to see these comments, the School should have the markers comments transcribed. If comments are made on a separate document, the student has the right to see that document which should be retained for two years. 6. In most cases at the School, examination scripts are not written on directly and feedback is provided to students on separate sheets, markers often make separate personal marking notes and these are disclosable under DPA as they are deemed part of the student s assessment record. Examples include rough written notes as an aide memoire to prepare the formal feedback, or marks for sub-sections of a question marked numerically. 7. To address concerns about the value of any such notes once the formal feedback is agreed, about the practicalities of any systematic retention of such notes, and comments from examiners seeking better information on reconciliation of grades, the following practices should be adopted by all assessment markers: i) Personal marking notes need only be retained by markers until they have completed writing their feedback to students and completed reconciliation of grades with their co-marker. ii) Where initial grades differ, a brief note should be recorded of the reason for the agreed grade awarded. Advice from those modules or courses already undertaking this practice is that a simple approach to writing these reconciliation notes is to use 32
iii) phrasing used in the assessment s marking criteria to help show how/why a grade particular grade is agreed upon. Where the initial grades of markers are both the same as the agreed grade, the explanation of that grade s award should be evident in the formal assessment feedback. Markers should bear in mind that all comments made in connection with marking, such as those to support grade reconciliation, may be disclosed to the student. Marking guides 8. Marking guides are fully disclosable under FOI. Included under this heading are criteria for grades for assessment tasks (tailored as appropriate to the particular task), and information on any weighting used in the marking (e.g. if there is more than one component to the task). These are already made available to students. References 9. References received about applicants or students are disclosable under the DPA. The School holds references in an applicant/student file, and the applicant or student has a right to see them. The School s reference forms already state that the applicant has a right to see their reference. See the Disclosure of Student Information Policy for further information. 10. References given about students are not disclosable by the School but may be disclosable under the DPA by the body that receives them. Staff should bear this in mind when writing references for students. Exam Boards and committees 11. Chairs and secretaries of committees and Exam Boards in particular should note that accuracy and appropriate wording of minutes are very important. Elements of minutes are disclosable under DPA, for example where there is a minuted discussion of an individual candidate. Redacted minutes (e.g. where identification of individuals is removed) are disclosable under FOI. 12. The School s publications scheme states that The minutes of School committees and groups will be available in the publication scheme one year after the date of the meeting. Access to minutes less than a year old will be treated as standard Freedom of Information requests and will therefore be subject to exemptions. This should give sufficient time for minutes to be approved by the relevant Board or committee before they must be made available. 13. The School s policy on committee/board papers and minutes is that a record copy should be kept permanently. They should be kept by a designated member of that committee/board usually the secretary to the committee/board and passed to the archive when they are 10 years old, or before if space is an issue. Other teaching-related paperwork 14. Other paperwork such as forms associated with module moderation should be retained for two years. Debtors 15. The School will release results, on demand, to students who remain in debt at graduation but may send them on plain paper. There is no obligation for the School to allow debtors to attend graduation ceremonies or to receive transcripts. 33
Requests for information from third parties 16. These should go through Registry who will co-ordinate requests if information is held elsewhere. A release form is available on the web for non-exempt bodies, e.g. letting agents, council tax offices. For exempt bodies such as the police, Revenue and Customs etc., Registry will publish a Section 29 release form or the contact details of a staff member who should be contacted in an emergency. Reminders will be sent to academic and administrative staff about handling requests. Release forms and policy will be written and published on the internet. 34