Smarter Balanced Assessment Consortium:

Transcription

1 Smarter Balanced Assessment Consortium: Online Pilot Test Administration Manual For Spring 2013 Pilot Tests of English Language Arts/Literacy & Mathematics Updated March 11, 2013 Prepared by the American Institutes for Research (AIR) Smarter Balanced Assessment Consortium, 2013 Descriptions of the operation of the Test Delivery System, Test Information Distribution Engine, and related systems are property of the American Institutes for Research (AIR) and are used with permission of AIR.

2 Online Pilot Test Administration Manual SMARTER BALANCED ASSESSMENT CONSORTIUM SUPPORT The Smarter Balanced assessment portal at is the home for all Smarter Balanced Pilot Test administration information. All manuals, brochures, and information related to the Pilot are available on the portal. Additionally, all Smarter Balanced Pilot Test applications can be accessed through the portal. For questions regarding the online testing system or for additional assistance, please contact the Smarter Balanced Pilot Test Help Desk at the American Institutes for Research (AIR) at or The Help Desk is open Monday through Friday from 7:00 a.m. to 10:00 p.m. Eastern time/4:00 a.m. to 7:00 p.m. Pacific time. During these hours, staff will respond promptly to calls and s. The Help Desk should be contacted for situations such as the following: 1. Testing environment is down or unavailable. 2. User accounts are not available or users are not able to administer tests. 3. Incorrect or missing student(s) or student information. When contacting the Help Desk, provide as much detail as possible about the issues encountered and the system on which it occurred. This should include the following: Any error messages that appeared Operating system and browser information Information about network configuration Smarter Balanced Pilot Test Help Desk Contact Information Phone ;

3 Online Pilot Test Administration Manual TABLE OF CONTENTS Table of Contents... 1 Overview of the Smarter Balanced Pilot Test... 3 About the Smarter Balanced Assessment Consortium... 3 About the Pilot Test... 3 User Roles and Responsibilities for the Pilot Test... 4 Introduction to the Online Test Administration Manual... 6 Glossary... 6 Pilot Test Resources... 8 Test Security... 9 Testing Improprieties Test Administration Student Enrollment and Login Process Exemption from the Pilot Allowable Resources Test Time Designating Student Accessibility and Accommodation Options in TIDE Accessibility and Accommodation Options Universal Digital Tools Accommodation Supports Research Forms Directions for Administration: Computer-Administered Items Only Establishing Appropriate Testing Conditions Classroom Preparation Login Script Testing Over Multiple Sessions or Days Monitoring Testing Directions for Administration: Computer-Administered Items plus One Performance Task Establishing Appropriate Testing Conditions Classroom Preparation Login Script Testing Over Multiple Sessions or Days Directions for Administering the Performance Task Monitoring Testing TAM 1-

4 Online Pilot Test Administration Manual Directions for Administration: Computer-Administered Items plus Performance Task with Classroom Activity Establishing Appropriate Testing Conditions Classroom Preparation Login Script Testing Over Multiple Sessions or Days Directions for Administering the Classroom Activity Directions for Administering the Performance Task Monitoring Testing Following Test Administration Destroying Test Materials Reporting Testing Improprieties and Irregularities Appendix A: Test Names Test Administrator TAM 2-

5 Online Pilot Test Administration Manual OVERVIEW OF THE SMARTER BALANCED PILOT TEST About the Smarter Balanced Assessment Consortium The Smarter Balanced Assessment Consortium is a state-led consortium developing assessments aligned to the Common Core State Standards in English language arts/literacy and mathematics that are designed to help prepare all students to graduate from high school college- and career-ready. For more information about the Smarter Balanced Assessment Consortium, go to About the Pilot Test The Smarter Balanced Pilot Test provides the Consortium an opportunity to (1) gather data on the functioning of items, (2) conduct initial scaling, and (3) test the online testing system and will be delivered to 1.2 million students from approximately 6,000 schools in 21 Smarter Balanced governing states. The English language arts/literacy and mathematics assessments included in the Pilot Test will be delivered online using a secure testing system. The Pilot Test will include several thousand selected- and constructed-response items and performance tasks across grades 3 through 11. The data from the Pilot Test will provide the Consortium with important information on how these items and tasks perform in a real-world setting. Student participation. Students in the specified grade levels will participate in the Smarter Balanced Pilot Test unless they receive a special exemption. Generally, if a student is eligible for the state s general education accountability assessment or takes the Alternate Assessment based on Modified Achievement Standards (AA-MAS) and attends a school invited to participate in the Pilot, he or she is eligible to participate. School personnel should follow state and local policies regarding student participation. -TAM 3-

6 Online Pilot Test Administration Manual User Roles and Responsibilities for the Pilot Test User roles in the Online Testing System for the Smarter Balanced Pilot Test: State User Role District Coordinator (DC) School Coordinator (SC) Test Administrator (TA) Description State-level users may upload, add, and edit student information into the Test Information Distribution Engine (TIDE); add other state-level users, DCs, SCs, and TAs into TIDE as administrators; and can access the TA Interface. District Coordinators are responsible for coordinating testing in their district. They should ensure that the SCs and TAs in their districts are appropriately trained and aware of policies and procedures. Note: If District Coordinators (DCs) do not have a testing role in your state, DC duties must be explicitly assigned and/or undertaken by appropriate state or school staff. A School Coordinator can be a principal, vice principal, technology coordinator, counselor, or other staff member. We recommend that the SC be a person with noninstructional or limited instructional duties so that she or he can coordinate testing activity in the school. SCs are ultimately accountable for ensuring that testing is conducted in accordance with the test security and other policies and procedures established by the Smarter Balanced Assessment Consortium. SCs must identify TAs and ensure that they are properly trained; create or approve testing schedules and procedures for the school; work with technology staff to ensure that necessary secure browsers are installed and any other technical issues are resolved; monitor testing progress during the testing window and ensure that all students participate as appropriate; address testing problems as needed; and report all potential test improprieties to their DC, ideally within one business day of learning of the potential impropriety. Test Administrators administer the Smarter Balanced Pilot Test. The Smarter Balanced Pilot Test may be administered only by individuals approved as Smarter Test Administrators. Individuals who may be approved are: state-certified educators (teachers, administrators, or guidance counselors); paraprofessionals, if closely supervised by an on-site, trained, state-certified educator; and substitute teachers (if they are not certified educators within your state, they must be closely supervised by an on-site state-certified educator). Note: Regardless of role, all TAs must receive Smarter Balanced test administration training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced Pilot assessments. -TAM 4-

7 Online Pilot Test Administration Manual All Test Coordinators, Test Administrators, and school administrative staff who will be involved in the Smarter Balanced Pilot administration must complete the Smarter Balanced Pilot Test online training modules, which can be found on the portal at These modules will be self-paced and will provide training on technology requirements, TIDE/user roles, online test administration from the perspective of the TA and the student, and how to properly administer performance tasks. Test Administrator checklist. Activity Attend WebEx training session and review all Smarter Balanced policy and test administration documents posted to the portal Prepare the testing environment, ensuring that students have access to only those allowable resources identified by Smarter Balanced Administer the Smarter Balanced assessments, following the directions for administration and script (located in this manual) Report testing improprieties and irregularities (see the Reporting Testing Improprieties and Irregularities section of this manual for more information) Securely dispose of all printed testing materials, including student login information, print-on-request documents, and scratch paper in a secure manner (see the Destroying Test Materials section for information about securely disposing of testing materials) Completion Prior to testing Prior to testing During testing During testing After testing -TAM 5-

8 Online Pilot Test Administration Manual INTRODUCTION TO THE ONLINE TEST ADMINISTRATION MANUAL This Online Pilot Test Administration Manual (TAM) is primarily for Test Administrators who will administer the Pilot Test in their selected schools. This manual provides needed information regarding policies and procedures for the Smarter Balanced Pilot Test as well as screenshots and step-by-step instructions on how to administer the online Pilot Tests. Glossary This glossary defines terms that are specific to the Smarter Balanced Pilot Test and the online testing environment. Term Accommodation Definition A practice or procedure in presentation, response, setting, and timing or scheduling that, when used in an assessment, provides increased equity access to all students. Consortium-approved accommodations do not compromise the learning expectations, construct, grade-level standard, or intended outcome of the assessment. Classroom activity Computer-Administered Items Consortium District Coordinator (DC) Force Majeure Invalidation Classroom activities are one part of the Pilot Test and require the Test Administrator and students to interact. Students will respond to questions about the activity they completed. Computer-administered items include selected-response, constructed-response, and technology-enhanced items. The Smarter Balanced Assessment Consortium District personnel responsible for the overall administration of the Pilot Test in a district. DCs should ensure that the School Coordinators (SCs) and Test Administrators (TAs) in their districts are appropriately trained and aware of policies and procedures. An extraordinary circumstance (e.g., a power outage or network disturbance lasting for more than one full school day) or act of nature (e.g., flooding, earthquake, volcano) that directly prevents a school from making reasonable attempts to adhere to the Pilot Test schedule. The act of omitting test results and student responses from the testing, reporting, and accountability systems for a given testing opportunity for which the student may not retest. -TAM 6-

9 Online Pilot Test Administration Manual Term Online Reporting System (ORS) Performance Task (PT) Reset Restricted Resource Definition The Online Reporting System (ORS) for the Pilot Test allows users to generate participation reports. These reports allow users to track the progress of student testing and identify who has completed testing, who has not completed testing, and who has not yet begun testing. ORS also contains My Inbox from which SCs and TAs can download classroom activity instructions applicable to their individual schools. Not all grades or schools have tests that include classroom activities, so not everyone will need to use this feature. Performance tasks are one part of the Pilot Test and require students to answer a set of questions in response to an activity. Resetting a test allows the student to restart the test opportunity. For example, this may occur if the test accommodations were set incorrectly. This is extremely rare. Any computer-based application, tool, functionality, or non-electronic resource approved by Smarter Balanced for the purposes of the Pilot that does not interfere with the measured construct but has restricted availability and requires district documentation of individual student need prior to its use. An example of this is print-on-request. School Coordinator (SC) Secure Browser SSID Test Administrator (TA) Test Information Distribution Engine (TIDE) Testing Impropriety Testing Irregularity School personnel responsible for monitoring the Pilot Test schedule, process, and Test Administrators. SCs are also responsible for ensuring that testing is conducted in accordance with the test security and other policies and procedures established by the Smarter Balanced Assessment Consortium. A downloaded browser that provides access to the Pilot Test and prevents students from accessing specific hardware and software functions (e.g., other browsers, screenshot programs) that are not allowed during the assessment. A unique identifier assigned to each student by his or her state education agency. District or school personnel responsible for administering the Smarter Balanced Pilot Test in a secure manner in compliance with the policies and procedures outlined in the Online Pilot Test Administration Manual. The Test Information Distribution Engine (TIDE) provides administrators with the tools to add and manage users and students participating in the Smarter Balanced Pilot Test. TIDE uses a role-specific design to restrict access to certain tools and applications based on the user s designated role. The administration of a Smarter Balanced Pilot Test not in compliance with the policies and procedures outlined in the Online Pilot Test Administration Manual. Unusual circumstances that impact an individual or a group of students who are testing and may potentially affect student performance on the test. -TAM 7-

10 Online Pilot Test Administration Manual Pilot Test Resources Resource Online Pilot Test Administration Manual Online Pilot Test Coordinator Manual Training Test Technology Specifications Manual for Online Testing Description Manual that provides needed information regarding policies and procedures for the Smarter Balanced Pilot Test as well as screenshots and step-by-step instructions on how to administer the online Pilot Tests. Manual that includes information for State Coordinators, District Coordinators, and School Coordinators. This manual describes security and the policies and responsibilities for each role in online testing. It includes instructions on how to use the Test Information Distribution Engine (TIDE) system. Resource for test administrators and students to become familiar with the format and functionality of the online test. Manual that contains the technical specifications for online testing for Technology Coordinators, including information about Internet and network requirements, hardware and software requirements, secure browser installation, and text-to-speech. -TAM 8-

11 Online Pilot Test Administration Manual TEST SECURITY The security of assessment instruments and the confidentiality of student information are vital to maintain the validity, reliability, and fairness of the results. All test items and test materials are secure and must be appropriately handled. Secure handling protects the integrity, validity, and confidentiality of assessment questions, prompts, and student information. Any deviation in test administration must be reported to ensure the validity of the assessment results. Mishandling of test administration puts student information at risk. Failure to honor security severely jeopardizes the accuracy of student data. To ensure consistent administration across all participating schools in every Smarter Balanced state, all Test Administrators must take the Test Administrator training modules located on the Smarter Balanced Assessment Portal. Security of the Test Environment The test environment refers to all aspects of the testing situation while students are testing. The test environment includes what a student can see, hear, or access (including access via technology). Requirements of a secure test environment include, but are not limited to the following: A quiet environment, void of talking or other distractions that might interfere with a student s ability to concentrate or might compromise the testing situation. It is important to establish procedures to maintain a quiet testing environment throughout the testing session, recognizing that some students will finish more quickly than others. If students are allowed to leave the testing room when they finish, they must do so without disrupting others and know where they are expected to report once they leave. If students are expected to remain in the testing room until the end of the session, they should be instructed on what activities they may do after they finish the test. Information that is displayed on bulletin boards, chalkboards, or charts (e.g., wall charts that contain literary definitions, maps, etc.) and that might be used by students to help answer questions must be removed or covered. Visual barriers or adequate spacing between students seating. Student access to and use of only those allowable resources identified by Smarter Balanced that are permitted for each specific assessment (or portion of an assessment). Ensuring that only students who are testing may observe assessment items. Based on the item type (i.e., performance tasks), trained Test Administrators may also have limited exposure to assessment items in the course of properly administering the assessment; however, even Test Administrators may not actively review or analyze any assessment items. No electronic devices that allow students to access outside information, communicate among students, or photograph or copy test content. This includes cell phones, personal digital assistants (PDAs), ipods, cameras, and electronic translation devices. Administration of the Smarter Balanced Pilot Test only through the Student Testing Site via a secure browser or Google Chromebooks login profile. -TAM 9-

12 Online Pilot Test Administration Manual Secure Handling of Printed Test Materials and Note Paper: Printing, Storage, and Disposal Any note paper or assessment items and passages printed must be kept in a securely locked room that can be entered only with a key or keycard. All test materials must remain secure, both prior to the testing event and following a testing event, until testing materials are returned or securely shredded. All test materials must be returned to the School Coordinator (SC) on the day that testing is completed and kept in a secure area until all tests are completed. Under extremely rare circumstances, students may be allowed to print individual test items or stimuli using print-on-request; this is considered a restricted resource and will require sign-off prior to assigning this to a student. The decision to allow students to use print-on-request must be made on an individual basis. As noted previously, the printing of items/stimuli is intended for those extremely rare instances (e.g., photosensitive epilepsy) where a student s condition prevents him or her from accessing material online. Access to printed items/stimuli should not be assigned based solely on a student s personal preference. For students without an IEP or 504 Plan, the decision to allow this accommodation must be based on each individual student s need. Note: It is a testing impropriety to apply this restricted resource for a student without documentation of actual need. Based on reports from the Epilepsy Foundation, conditions such as epilepsy occur in less than 0.03% of school age children. Photosensitive epilepsy occurs less frequently in 4% of those cases. Once an approved student is set to receive the printing of test items/stimuli as a restricted resource, that student may submit a print request to the TA during testing. Before the TA approves the student s request to print a test item, the TA must ensure that the test item is set to print on a printer that is monitored by staff who have taken the Test Administrator training modules for the Pilot Test. Printed test items/stimuli, including embossed Braille printouts, must be collected and inventoried at the end of each testing event and securely shredded immediately. DO NOT keep printed test items/stimuli for future testing events. The following test materials must be securely shredded and recycled immediately after each testing session and may not be retained from one testing session to the next: Scratch paper and all other paper handouts written on by students during testing; Any reports or other documents that contain personally identifiable student information, including cards with student ID numbers used to help students log into the online system; Printed test items or stimuli. -TAM 10-

13 Online Pilot Test Administration Manual TESTING IMPROPRIETIES Improprieties are behaviors prohibited during test administration, either because they give a student an unfair advantage or because they compromise secure administration. Whether intentional or by accident, failure to comply with the following security rules, either by staff or students, will constitute a testing impropriety and will need to be reported to district staff, resolved, and (for the purposes of the Pilot) reported by district staff to states for reporting to Smarter Balanced. Item security rules include but are not limited to the following: No copies of the test items, stimuli, reading passages, or writing prompts may be made or otherwise retained. This includes using any digital, electronic, or manual device to record or retain an item. Descriptions of test items, stimuli, printed reading passages, or writing prompts must not be retained, discussed, or released to anyone. All printed test items, stimuli, and reading passages must be securely destroyed immediately following a testing session. Test items, stimuli, reading passages, or writing prompts must never be sent by or fax, or replicated electronically. Secure test items, modified secure test items, stimuli, reading passages, or writing prompts must not be used for instruction. No review, discussion, or analysis of test items, stimuli, reading passages, or writing prompts before, during, or between sections of the test is allowed by students, staff, or TAs. Student interaction during a test is limited to what is dictated for the purpose of a performance task. No form or type of answer key may be developed for test items. The following lists of administration improprieties by adults and students provide examples of what would be a violation of the above rules. These examples provide a basis for identifying a practice as an impropriety. As with other testing improprieties, administration improprieties by an administrator or other adult include but are not limited to the following: 1. Failing to ensure administration and supervision of the Smarter Balanced Pilot Test by qualified, trained personnel. 2. Allowing anyone other than a student to log into the Pilot Test. This includes test administrators or other staff using student information to log in or allowing a student to log in using another student s information. 3. Giving out the username and password for authorized users to other individuals, including other authorized users. 4. Sending a student s name and SSID together in an message. 5. Coaching or providing any other type of assistance to students that may affect their responses. This includes both verbal cues (e.g., interpreting, explaining, or paraphrasing the test items or prompts) and nonverbal cues (e.g., voice inflection, pointing, or nodding head) to the correct answer. 6. Providing a student access to another person s work/responses. -TAM 11-

14 Online Pilot Test Administration Manual 7. Leading students through instructional strategies such as think-aloud, asking students to point to the correct answer or otherwise identify the source of their answer, or requiring students to show their work. 8. Allowing students to continue testing beyond the close of the testing window. 9. Providing students with non-allowable materials or devices during test administration. 10. Modifying student responses or records at any time. 11. Taking paper test materials home or otherwise failing to securely store them. 12. Allowing students to take home test items, reading passages, writing prompts, or scratch paper that was used during the Pilot Test. 13. Copying or otherwise retaining test items, stimuli, reading passages, or writing prompts. This includes the use of photocopiers or digital, electronic, or manual devices to record or communicate a test item. 14. Using secure test items, modified secure test items, reading passages, or writing prompts for instructional purposes. 15. Developing answer keys to test items and using them for instructional purposes or to give students input on their progress and test performance. 16. Giving the media writing prompts, modified test items, and reading passages. 17. Reviewing or discussing the content of test items, stimuli, reading passages, or writing prompts for any reason. Administration improprieties by a student include but are not limited to the following: 1. Students cheating, including passing notes or giving help to other students during testing. 2. Students talking during testing. 3. Accessing or using electronic equipment (e.g., cell phones, PDAs, ipods, or electronic translators) during testing. 4. Using a graphing calculator to exchange information between students or to store test items or answers. 5. Accessing the Internet during a testing event. 6. Accessing or using non-allowable resources, including other students work, during a test administration. 7. Removing secure testing materials such as test items, stimuli, reading passages, writing prompts, or scratch paper from the testing environment. TAs and SCs who have witnessed, been informed of, or suspect the possibility of a testing impropriety that could potentially affect the integrity of the tests or the data should immediately contact their DC and complete the report form located on the Smarter Balanced portal. Please note that any breach in test security may also be subject to personnel action based on state and local laws, rules, and, policies. -TAM 12-

15 Online Pilot Test Administration Manual TEST ADMINISTRATION This section provides information about student enrollment and the login process, exemption, and allowable resources for the Pilot Test. Information about testing time is also included in this section. Student Enrollment and Login Process Student enrollment. Only students who are enrolled in the schools and grades participating in the Smarter Balanced Pilot Test may take the assessments. Each student must be correctly assigned to his or her school and grade in the Smarter Balanced TIDE system. If an eligible student does not appear in TIDE or is associated with an incorrect school or grade, this information must be updated before the student can test. Students should NOT test if their information is incorrect. Refer to the TIDE located in the Online Pilot Test Coordinator Manual for additional information. Student login. Each student will log into the Smarter Balanced Pilot Test using his or her legal first name (i.e., first name as it appears in TIDE), his or her state abbreviation (e.g., Iowa = IA) followed by a hyphen and SSID number, and a test session ID. (Note: When a Test Administrator creates a test session, a unique session ID is automatically generated. Session IDs typically are the first four letters of the TA s last name followed by a hyphen and at least one number. This session ID must be provided to the students before they log in.) Sample: First Name: John State-SSID: WA Session ID: Demo-123 Verifying student information Test Coordinators and Test Administrators can verify students SSIDs in TIDE prior to starting a test administration. However, it is important for anyone with access to this information to remember that student personal information, including SSIDs, is confidential. If materials containing both the student name and the SSID are distributed to students, these materials must be collected before the students leave the testing room and then shredded. For additional information about security protocols, refer to the Test Security section of this manual. -TAM 13-

16 Online Pilot Test Administration Manual Exemption from the Pilot Smarter Balanced is in the final stages of crafting a comprehensive A&A framework for students with special assessment needs, and is developing a variety of innovative digital accessibility tools that will be embedded in the Smarter Balanced assessment delivery platform. However, this work will not be completed in time for the spring 2013 Pilot Testing, resulting in a menu of A&A options for the Pilot Test that represent a subset of those that will be available for Field Testing and operational assessments. The pilot will feature several of the new universal digital accessibility tools, and a variety of accommodations supports. The purpose of the Pilot is to collect as complete and valid information on the items as possible. As many students as possible, in the scientific sample, should participate if the available Universal Digital Tools and Accommodations Supports (described in the Accessibility and Accommodation Options section of this manual) provide adequate supports to ensure valid assessment. However, we understand that the Pilot Test will not offer a sufficient set of A&A tools and supports for all students. Therefore, some students may need to be exempted from Pilot Test participation. For the Pilot Test only, schools may exempt individual students from participation. This must be determined by school personnel, who are familiar with the student s assessment needs. Student exemption may be warranted when appropriate school personnel determine that the available tools and accommodations will not be sufficient to allow valid assessment of the student s knowledge and skills. In order to make the Pilot sample as complete as possible, schools are strongly encouraged to use this exemption judiciously and to include students in the pilot whenever possible. School personnel should follow state and local policies regarding student participation. In the case of an exemption, school personnel must adhere to local and state policies. For answers to questions about the tools and accommodations available for the Pilot Test, school personnel should contact the Smarter Balanced Pilot Test help desk at or smarterbalancedhelpdesk@air.org. Please note that exemption allowances apply only to the Pilot Test. An expanded set of accessibility and accommodations tools will be available for the Smarter Balanced Field Test in 2014 as well as for the operational assessments in TAM 14-

17 Online Pilot Test Administration Manual Allowable Resources During the Pilot Test administration, students may have access to and use only those allowable resources identified by Smarter Balanced that are permitted for each specific assessment (or portion of an assessment). Allowable Additional Resources for the Smarter Balanced Tests Mathematics Posters offering students encouragement or inspiration without any specific content related to content standards Headphones: Students will need headphones for text-to-speech. Pen, pencil, or highlighter Blank paper or graph paper (any size) Online test keyboard navigation symbols: Consortium-approved keyboard navigation symbols can be provided to students as a poster or wall chart or as individual handouts. However, if students write on them, the handouts will need to be shredded after testing. English Language Arts Posters offering students encouragement or inspiration without any specific content related to content standards Headphones: In addition to students receiving the text-to-speech accommodation, all students will need headphones for English language arts listening items. Pen, pencil, or highlighter Blank/lined paper Online test keyboard navigation symbols: Consortium-approved keyboard navigation symbols can be provided to students as a poster or wall chart or as individual handouts. However, if students write on them, the handouts will need to be shredded after testing. ELA Performance Tasks: In part two of an ELA performance task ONLY, all students may have access to a hard-copy dictionary. This resource is not allowable during any other part of the test, or in any other test. It is highly recommended that ALL students access the Training Test Site before taking the Pilot Test. The training tests will be especially beneficial for those students who have not previously participated in online testing. The Smarter Balanced Pilot Test includes the following question types (although not all tests contain all item types): Selected-response items: The student selects an answer option by clicking anywhere on the answer choice. Note that some items may instruct students to select multiple correct options. Constructed-response items: The student types a response into a response box. Technology-enhanced items: The student uses the mouse or keyboard to manipulate items or draw responses in the response box. Performance tasks: The student completes an extended activity in preparation for answering questions. -TAM 15-

18 Online Pilot Test Administration Manual Test Time Schools that participate in the Pilot Test will be assigned to a two-week testing window. Within that window, schools will need to complete the testing of all their students in the designated grade(s). The online tests are NOT timed. Students may test over multiple sessions. It is not good testing practice, however, to allow an excessive amount of time to pass between beginning a test and completing it. When possible, it is a good idea to complete the test within one week of beginning. The tables on the following pages show the approximate time each test will take. This information can help you estimate the number of days needed to administer the Pilot Test. These estimates do not account for any time needed to start computers, load secure browsers, and log in students. TAs should work with SCs to determine precise testing schedules. Three possible scenarios exist for the Pilot Test. Based on the scientific sample, each grade within a school has been assigned to one of these three scenarios: 1. Computer-administered items: Students take an assessment of selected-response, constructedresponse, and technology-enhanced items only and are not given any performance tasks (PT). 2. Computer-administered items and one performance task (PT): Students take an assessment and complete an assigned performance task. 3. Computer-administered items, classroom activity, and performance task: Students take an assessment, participate in a classroom activity, and complete one performance task. Notes: The number of items in the computer-administered items portion of the Pilot Test will vary depending on the scenario. The tests are not timed, so all time estimates are approximate. Students should be allowed extra time if they need it. The computer-administered items portion of the Pilot Test should not be spread out over more than 3 sessions. Testing time can be spread out over multiple days as needed. -TAM 16-

19 Online Pilot Test Administration Manual English Language Arts: Grades 3 8 Computeradministered items only Computeradministered items plus one PT Computeradministered items plus PT with classroom activity Session minutes (can be broken up over three sessions if desired see page 36) 64 minutes 64 minutes Session 2 35 minutes 65 minutes (includes 30- minute classroom activity) Session 3 85 minutes 85 minutes English Language Arts: Grades 9 11 Computeradministered items only Computeradministered items plus one PT Computeradministered items plus PT with classroom activity Session (can be broken up over three sessions if desired see page 36) 70 minutes 70 minutes Session 2 35 minutes 65 minutes (includes 30-minute classroom activity) Session 3 85 minutes 85 minutes -TAM 17-

20 Online Pilot Test Administration Manual Mathematics: Grades 3 8 Computeradministered items only Computeradministered items plus one PT Computeradministered items plus PT with classroom activity Session minutes (can be broken up over three sessions if desired see page 36) 45 minutes 45 minutes Session 2 60 minutes 90 minutes (includes 30- minute classroom activity) Mathematics: Grades 9 11 Computeradministered items only Computeradministered items plus one PT Computeradministered items plus PT with classroom activity Session minutes (can be broken up over three sessions if desired see page 36) 45 minutes 45 minutes Session 2 90 minutes 120 minutes (includes 30- minute classroom activity) -TAM 18-

21 Online Pilot Test Administration Manual DESIGNATING STUDENT ACCESSIBILITY AND ACCOMMODATION OPTIONS IN TIDE Accommodations refer to practices or procedures in presentation, response, setting, and timing or scheduling that, when used in an assessment, provide increased equity access to all students. Consortium-approved accommodations do not compromise the learning expectations, construct, grade-level standard, or intended outcome of the assessment. For the Smarter Balanced Pilot assessment, specific test settings and accommodations must be enabled in TIDE by the appropriate staff member (as designated in your state). Accommodations are defined by content area (English Language Arts [ELA] and Mathematics). The features and functions described below, called tasks, are included in TIDE. Tasks are identified by their file tab names. The Student Information task group allows all users to view student information, including test settings. Certain test settings are editable by authorized users, and these settings are listed below in italicized text. This is how District and School Coordinators set accommodations for students who require them. State-level users and District and School Coordinators may add students to TIDE as well as update student information. User Access to Tasks in TIDE Task Group Description Tasks and Editable Settings User Role State DC SC TA Student Information Add, view and edit student information, including test settings. *Note: All users can view student information. However, TAs cannot update student information or test settings. Upload Student File Add Students View/Edit Students* Edit student information Accommodated Text-to- Speech (TTS) Braille Color Choice Edit Language Print on Request (Passages/Stimuli) Print Size Upload Accommodations -TAM 19-

22 Online Pilot Test Administration Manual Test Administrators may view student information. However, TAs cannot add, upload, or edit student information. Within the TA Interface, the only setting a TA can change prior to the start of the Pilot Test is the default font size. For the Training Test only, TAs may change the color choice setting in addition to the font size. If a student s settings or accommodations are not correct and cannot be changed by the TA, that student should not begin testing until a state-level user, District Coordinator, or School Coordinator has updated that information in TIDE. As noted on the previous page, statelevel users, District Coordinators and School Coordinators may upload files that contain student information and test accommodations. They may also add students individually to TIDE, as well as edit their information. See the TIDE for instructions on how to view, add, upload, and edit student information. -TAM 20-

23 Online Pilot Test Administration Manual ACCESSIBILITY AND ACCOMMODATION OPTIONS Universal Digital Tools The Pilot Test and training test contain Universal Digital Tools that are available to all students without being preset in TIDE. These tools can be activated by the student during testing. Pause the test and resume it any time before the test window ends. Upon resuming, students will be directed to the first page with unanswered questions. Refer to the pause rules section of the Test Administrator for additional information. Variable font sizes: Students can make test text and graphics larger by clicking the [Zoom In] button. Students can also click the [Zoom Out] button to return to the default or smaller print size. When using the zoom feature, a student only changes the size of text and graphics on the current screen. The default font size for all tests is 14 pt. In order to increase the default print size of the entire test, print size must be set for the student in TIDE, or set by the TA prior to the start of the test. This is the only accommodation that TAs can set. The options are: - Level 0 (No Zoom) = 1X - Level 1 = 1.5X - Level 2 = 1.75X - Level 3 = 2.5X - Level 4 = 3X Highlighter: Students can highlight all or parts of stimuli and questions. Mark for review: Students can use the flag function to mark a question to return to later. (Note: If a test comprising only computer-administered items is paused for more than 20 minutes, the student will not be allowed to return to marked questions.) Strikethrough (Answer eliminator): Students can cross out selected-response options by using the strikethrough function. (Note: Students must still select a response option in order to answer the question and move to the next question.) Expandable passages: Students can expand stimuli so they take up a larger portion of the screen. Keyboard commands (Tab-enter navigation): Students can use keyboard commands to navigate between test elements, features, and tools. Calculator: Students are able to use an online embedded calculator for some mathematics assessments. Available calculator types include Basic, Scientific, Graphing, and Regression. External calculators are not allowed in the testing environment. Students who receive an ELA performance task will receive access to a note-taking tool that persists across segments and through test pauses. -TAM 21-

24 Online Pilot Test Administration Manual The following writing tools are available for ELA performance task extended-response items only: Bold, Italics, Underline Indent Cut, Copy, Paste Spell check Undo/Redo Accommodation Supports Accommodations are available to students based on evidence of demonstrated need, as identified at the local level by school personnel who are familiar with the student s assessment needs. These are available on all Pilot Test forms for identified students. Students need to be identified in TIDE prior to test administration. Accommodations not described in this document are not permitted for Pilot Test administration. In addition, adults should not review or have access to Pilot Test questions. The following accommodation supports are available for Pilot Test administration. Frequent breaks: This support allows a student to take one or more breaks during the administration of an assessment. For purposes of the Pilot Test, frequent breaks and extended time are universal accessibility options. Test Administrators must be aware of the defined testing window when determining breaks and additional time, to ensure adequate time for completion. Extended time: This support allows a student to have sufficient time to complete the assessment. For purposes of the Pilot Test, frequent breaks and extended time are universal accessibility options. - The tests are not timed, so all time estimates are approximate. Students should be allowed extra time if they need it, as long as students continue to make productive progress. - The number of items in the computer-administered items portion of the Pilot Test will vary depending on the scenario. - The computer-administered items portion of the Pilot Test should not be spread out over more than three sessions. Total testing time can be spread out over multiple days as needed. - All students must complete the assessment within the testing window allotted to their schools. Quiet environment: Students testing in a separate, quiet environment must have a trained proctor (not necessarily a TA, but a staff member trained to enforce test policies) present. -TAM 22-

25 Online Pilot Test Administration Manual Font background color alternatives: These text and background colors are available for selection in TIDE. The color choice selected will apply to all tests for that student. By default, tests are presented with black text on a white background. Students who require a different combination of text and background should be assigned the appropriate accommodation. - Black on White (default) - Black on Rose - Medium Gray on Light Gray - Yellow on Blue - Reverse Contrast Print on request: Students who require any print-on-request setting must have it set in TIDE before beginning testing. - Passages/Stimuli: Students may require the print-on-request feature for individual reading passages or stimuli. Permission for a student to request printing of a passage/stimulus must first be set in TIDE by a state-level user, District Coordinator, or School Coordinator. - Items: In extremely rare circumstances most districts will not use this students can request to print individual items. If a student will require items to be printed, School Coordinators or District Coordinators must contact the Smarter Balanced Help Desk ( ) to have this accommodation set for the student. This is the one accommodation that cannot be directly set in TIDE by a School or District Coordinator. When contacting the Help Desk, provide the Help Desk with the student s state-ssid information as well as the reason for the accommodation. Research Forms Smarter Balanced is committed to providing the broadest access to the assessment possible, while ensuring that the assessment yields fair and accurate results. Test forms used by a small number of students in the spring 2013 Pilot Test will be research forms. These forms will help the Consortium investigate specific assessment Accessibility and Accommodations (A&A) protocols. The table below shows the grades and content areas in which research forms may be administered. -TAM 23-

26 Online Pilot Test Administration Manual Research Forms Distribution Mathematics English Language Arts Spanish Side-by-Side Translation 3, 7, 11 N/A Online Spanish Glossary 3, 7, 11 N/A Online Refreshable Braille 3, 7, 11 4, 7, 11 Text-to-Speech 3, 7, 11 4, 7, 11 Online English Glossary 3 4 Note: Students receiving the above accommodations must meet all of the following conditions: 1. They are in one of the listed grade/subject combinations. 2. Based on the scientific sample assignment of their school and grade, they are in a grade that is assigned to receive computer-administered items only. 3. They meet the description of an eligible student. Students receiving performance tasks will have access only to color and print size accommodations. The following information is intended to give guidance to School Coordinators in determining if a student is eligible to receive a Research Form accommodation. -TAM 24-

27 Online Pilot Test Administration Manual Spanish side-by-side translation. All tests are presented in English. The Spanish side-by-side translation accommodation allows a student to view a stacked Spanish-English translation of mathematics items and directions. Students who require a Spanish translation should have the Spanish option selected for Language in TIDE. In determining students who are eligible for a Spanish side-by-side translation for the Mathematics portion of the Smarter Balanced Pilot Test, districts should take the following into consideration: Time in U.S. schools, including enrollment for less than 12 months Composite English Language Proficiency Level (Beginning, Intermediate, or Advanced). Note: Additional proficiency levels may exist within each state. However, the intermediate and advanced categories broadly reflect the general categories all states provide students on their English language proficiency assessments. English Language Proficiency Sub-Scores in Reading, Writing, Listening, or Speaking Level (Beginning, Intermediate, or Advanced) Native language literacy Exposure in English to academic language expected on the assessment Exposure in native language to academic language expected on the assessment Grade/Age Affective needs and/or cultural needs Method(s) of accessing academic content during instruction When selecting students who may be eligible for this accommodation for the Pilot Test, the educational team must also consider: 1. Is the student identified as an English language learner? 2. Does the student communicate in Spanish and is the student able to decode text-based content presented in Spanish? 3. Is the student familiar with the academic language to be contained in directions in the translated language? 4. Do a student s English Language Proficiency scores or other information collected by the school about the student s English language proficiency provide evidence that the student may have difficulty accessing text-based content presented in English? 5. Does the student read below grade level and/or have difficulty accessing text-based content in English? 6. Is the student s language of instruction Spanish? 7. Will the presentation of directions in a translated form confuse or distract the student? 8. Will the presentation of items in a translated form confuse or distract the student? -TAM 25-

28 Online Pilot Test Administration Manual Affirmative responses to each of the first six questions support the assignment of the option to a student. An affirmative response to either of the final two questions would not support assignment of the option. Test Administrators should keep in mind that TAs may not provide any information about the meaning of a word or item during test administration. Online Spanish glossary. This accommodation allows a student to use an embedded digital tool that provides Spanish synonyms (but not definitions) for terms that have been identified as non-essential to the construct measured in a math item or passage. From the Student Interface students can expect to access this accommodation by clicking each designated term. Students who require a Spanish glossary should have the Spanish Glossary option selected in TIDE. In determining students for the Pilot Test who are eligible for the Spanish glossary, educators should consider the following: 1. Is the student identified as an English language learner? 2. Is the student identified as having at least an intermediate English language proficiency level? Note: Additional proficiency levels may exist within each state. However, the intermediate category broadly reflects a general category all states provide students on their English language proficiency assessments. 3. Does the student use a word-to-word bilingual dictionary when accessing content in the classroom or during assessments? 4. Will the use of a Spanish glossary improve the student s understanding of the items and tasks? 5. Is the student s language of instruction English? 6. Will the use of a Spanish glossary confuse or distract the student? Affirmative answers to the first five questions support assignment of the option to the student. An affirmative answer to the sixth question would not support assignment of the option to the student. Test Administrators should keep in mind that if a student experiences challenges locating a word in the glossary, the supervising adult may provide directions on how to locate words using the glossary but may not provide any information about the meaning of a word. Braille. This accommodation is essential for specific access needs and is open to those with a documented need who have access to the necessary technology. The documented need must be present in the student s IEP. Students who require a Braille accommodation should have the Braille option selected for Language in TIDE and have required technology available. -TAM 26-

29 Online Pilot Test Administration Manual Testing with Braille in the Online System For the Pilot Test administration, the following assessments can be delivered to students with the Braille accommodation: ELA 4, 7, and 11 (Contracted or Uncontracted Braille) Mathematics 3, 7, and 11 (Nemeth Braille) The Braille interface of the Student Testing Site provides the following to students: A Text-to-Speech component for the ELA and Math assessments listed above. This is consistent with the Text-to-Speech accommodation. The Job Access with Speech (JAWS) screen reading software provided by Freedom Scientific can be used with the Braille interface. Math assessments presenting students with items in Nemeth Braille via a Braille embosser. ELA assessments presenting students with items in either contracted or uncontracted Literary Braille: - Items containing only text will be sent to a Refreshable Braille Display (RBD). - Items containing text and images that cannot be read by an RBD will be sent to a Braille embosser. Ability to use the Zoom tool. Students who have some vision can use the Zoom buttons on the Braille interface to increase the size of text and graphics. Students may request embossing for any item or reading passage as they progress through the test. District or School Coordinators may also designate a student to receive all items through the Braille embosser instead of through the Refreshable Braille Display as an accommodation, based on the student settings specified in TIDE. This accommodation must be set in TIDE prior to the start of a given test opportunity (refer to the Student Information section of the TIDE ). Technology Requirements Prior to administering assessments using the Braille interface, TAs must ensure that the technical requirements listed below are met. These requirements apply to the student s computer, the Test Administrator s computer, and the supporting Braille technologies used in conjunction with the Braille interface. -TAM 27-

30 Online Pilot Test Administration Manual Requirements for Student Computers: The Student Testing Site currently supports the Braille interface on Windows 7 machines only. Windows Secure Browser 6.0 must be installed on all machines used for student testing, including tests administered using the Braille interface. JAWS Screen Reader (version 12 or 13). Braille display that is compatible with Windows 7 and JAWS. We recommend that the Braille display have a minimum of 40 cells. For more information about JAWS, including product download and purchase, go to Prior to administering tests using the Braille interface, set up each student computer as follows: 1. Configure JAWS to recognize the Secure Browser. 2. Apply settings for Contracted/Uncontracted Braille through JAWS. Requirements for Test Administrator Computers: TAs administering tests to students who require Braille must have the following software installed on their machine prior to testing. The software is necessary to process these students print requests. Tiger Max Embosser and the supporting ViewPlus Desktop Embosser driver The Desktop Embosser Driver can be downloaded from The download includes the Tiger Viewer software, which is needed to handle print requests for items and passages that contain tactile or spatial components. Duxbury Braille Translator 11.1 SR4 This software allows printing of items and reading passages (without images) and can be downloaded from See the TA for information about configuration, print requests, and interacting with the Braille Interface. Text-to-Speech. This accommodation allows text-based content and graphic descriptions contained in mathematics items to be presented in a spoken form. Text-to-Speech is also available in ELA tests for items only. Text-to-Speech is available to students with an identified need. This accommodation may be assigned by an individual educator or an educational team that is knowledgeable about the student access needs during the assessment. The student may have an IEP, 504, ELL plan, or a plan of need for this accommodation. -TAM 28-

31 Online Pilot Test Administration Manual Text-to-Speech is available only to students in schools assigned to tests with only computeradministered items and for the following grades: Mathematics grades 3, 7, and 11 ELA grades 4, 7, and 11 Note: Text-to-Speech is not available in Spanish. Students who require Text-to-Speech should have either the Items or Items and Stimuli setting selected (depending on the content area) and the required technology (i.e., headphones). See the TA for instructions on using the Text-to-Speech tool in the online system. Online English glossary. An English glossary is an embedded digital tool that allows students to view words identified as key to understanding what is being asked by an item or task, and then view one or more glossaries for that word. Glossaries provide context or synonyms but do not provide formal definitions for a keyword term. These key-word terms have been identified as non-essential to the construct measured by the item. From the Student Interface students can expect to access this accommodation by clicking the designated words to open the glossary. Students who require an English glossary should have the English Glossary option selected in TIDE. An English glossary is useful for students who are developing proficiency with the English language or who may be unfamiliar with a word or phrase that appears in an item. In determining students who are eligible for the English glossary during the Pilot Test, educators should consider the following questions: 1. Does the student have a disability that affects memory retrieval and/or decoding skills? 2. Does the student receive special education services? 3. Does the student have an advanced language proficiency level? 4. Will the presence and/or use of a key word glossary create a distraction that outweighs the potential benefit of the use of the tool? Affirmative answers to the first three questions support assignment of the option to the student. An affirmative answer to the fourth question would not support assignment of the option. Test Administrators should keep in mind that if a student experiences challenges locating a word in the glossary, the supervising adult may provide directions on how to locate words using the glossary but may not provide any information about the meaning of a word. -TAM 29-

32 Online Pilot Test Administration Manual DIRECTIONS FOR ADMINISTRATION: COMPUTER-ADMINISTERED ITEMS ONLY Note: This section includes directions for administration and a script to use in the administration of tests with computer-administered items only. TAs administering tests with computer-administered items plus one PT or tests with computer-administered items plus PT with classroom activity may go directly to the appropriate section. Establishing Appropriate Testing Conditions The School Coordinators and Test Administrators will need to work together to determine the most appropriate testing option(s) and testing environment based on the number of computers available, the number of students in each tested grade, and the estimated time needed to complete each test. Testing students in classroom-sized groups is preferable to administering tests to large groups in large facilities. Establishing smaller groups lessens test fear and anxiety for the students and facilitates monitoring and control for the TA. The test administration should be conducted in a room that does not crowd students. Good lighting, ventilation, and freedom from noise and interruptions are important factors to be considered when selecting a site. The room should be prepared for test administration. Information that is displayed on bulletin boards, chalkboards, or charts and that might be used by students to help answer questions should be removed or covered. This applies to rubrics, vocabulary charts, student work, posters, graphs, charts, etc. Cell phones or other electronic devices are not allowed in the testing room. It may be helpful to place a TESTING DO NOT DISTURB sign on the door. It may also be helpful to post signs in halls and entrances rerouting hallway traffic, if necessary, in order to promote optimum testing conditions. Students should be seated so that they will not be tempted to look at the answers of others. Appropriate seating arrangements should be used to discourage students from aiding one another. To prevent confusion, arrangements for student seating should be completed prior to the test administration. Establish procedures to maintain a quiet testing environment throughout the testing session, recognizing that some students will finish more quickly than others. If students are allowed to leave the testing room when they finish, explain the procedures for leaving without disrupting others and where they are expected to report once they leave. If students are expected to remain in the testing room until the end of the session, instruct them on what activities they may do after they finish the test. -TAM 30-

33 Online Pilot Test Administration Manual Classroom Preparation The TA will need to take the following steps immediately before testing: 1. Open the secure browser on each student s computer or open the secure browser app on each the student s ipad/tablet. 2. Distribute materials. Distribute any needed materials such as blank paper and pencils (see Allowable Resources in the Test Administration section of this manual). 3. Log into the Test Administrator Site and establish a test session. Log into the testing site using your username and password. Select the TA Interface application. If you do not have a username and password or you cannot access the TA Interface, contact your SC. In the upper left corner, select all of the tests associated with the grade and content area you will be testing. After you have selected the tests, click [Start Session]. Your students will only receive the test to which they were pre-assigned. A Session ID will automatically be generated and will appear in the top center of the screen. This Session ID will generally have four letters followed by a hyphen and then a number (for example, DEMO-01). Students will need this test Session ID to log into the test. TAs will provide the same Session ID to all students testing in that session. The test session must be created on the day of testing. Students from the same class who take tests at different times or with different TAs will not have the same test session ID. -TAM 31-

34 Online Pilot Test Administration Manual Login Script In order to ensure that all students are tested under the same conditions, you should adhere strictly to the script for administering the test. These instructions can be found in the boxes in bold on the following pages. When asked, you should answer questions raised by students, but you should never help the class or individual students with specific test items. No test items can be read to any student for any content or subject area. Please remember that the script must be followed exactly and used each time a test is administered. If you are resuming a test and are sure that all students are able to log in without hearing the login directions again, you may skip the italicized portions of the directions. All directions that you are to read to students are indicated by the word SAY and are in boxes so that they stand out from the regular text. Read these directions exactly as they are written, using a natural tone and manner. If you make a mistake in reading a direction, stop and say, I made a mistake. Listen again. Then read the direction again. Try to maintain a natural classroom atmosphere during the test administration. Before each test begins, encourage students to do their best. Any time a student logs into the testing system, the TA should follow this script. SAY: Today, you will take a test in the area of [insert name of test being given at this time]. You will be given a Test Session ID that is required to start the test. If you need an individual break during the test, raise your hand and wait for my instructions and permission. Once you have logged in, you will have to wait for me to approve the test before you can start. I ll be checking that you have correctly entered your ID number and other information Give students the test session ID. Write the test session ID for the test you will be giving on the board or another place where students can see it. Make sure students know that they must enter the test session ID exactly as it is written, without extra spaces or characters. Student information, such as the SSID, may be provided to students ahead of time on a card to help them type it in accurately. However, please remember that student ID numbers are confidential information and cards will need to be collected and shredded if used. -TAM 32-

35 Online Pilot Test Administration Manual SAY: Enter your legal first name (not your nickname), your two-letter state abbreviation followed by a hyphen and your SSID, and the test session ID that I provided. Raise your hand if you cannot see these numbers well enough to type them on your keyboard. Please do not share your SSID as it is your own private information. Once you have successfully logged in, you will see a screen with your full legal name, birth date, SSID, school, and grade. If all of the information on your screen is correct, select YES to continue. If any of the information is incorrect, please raise your hand so that you can show me what is wrong. Make sure all students have successfully entered their information. Be sure that the students use their legal first names, not nicknames. If a student is unable to log in, he or she will be prompted to try again and provided with a message describing the reason (an invalid SSID, for example). If the student is still having difficulty, the TA can look up the correct information using the Student Lookup function on the TA Site. TAs may assist students with logging in if necessary. If the problem cannot be resolved, please contact the Help Desk at or SmarterBalancedHelpDesk@air.org. SAY: On the next screen, select the test you will be taking today and click START TEST. After you have selected your test, you will see a screen with a moving bar and message saying that you are waiting for Test Administrator approval. This step helps ensure that you are taking the correct test. Please wait quietly while I verify each of your tests. In the event of technical difficulties with the secure browser, contact the technology coordinator, School Coordinator, or Smarter Balanced Help Desk. -TAM 33-

36 Online Pilot Test Administration Manual Approving students for testing. After students log in, you must confirm that these are the correct students to take the test and approve the students login requests. The upper right corner of your screen will always display a list of students who are awaiting approval at any time. Please make sure the correct student has logged in. Once students begin appearing in the preview box, you can click [Approvals (#)] to open the Approvals pop-up window. Review each student s test settings and edit as necessary. You can either click [Approve] for each individual student (recommended) or, when you are satisfied that all students in the list can be approved, click [Approve All Students]. Reminder: If any student s test settings are incorrect, do NOT approve that student. To refresh the list of students awaiting approval at any time, click the [Refresh] button at the top of the pop-up window. SAY: After I approve you to begin testing, you will see a screen asking you to check your test subject and settings. If all the information is correct, you may select YES, START MY TEST. If any of it is incorrect, please raise your hand and I ll be with you shortly. Each student will be logging in at a different time. Monitor the sessions and get all students logged in who are currently ready before assisting any students who are having problems. -TAM 34-

37 Online Pilot Test Administration Manual SAY: Before your test appears, you will see a tutorial page listing the test tools and buttons that you may use during the test or that will appear on the test. Please read this carefully. You can also find this information during your test by clicking the HELP button in the top right corner. You must answer each question on the screen before going on to the next question. During the test, you may see a page with no test questions. Follow the directions on the page to continue taking the test. If you are unsure of an answer, provide what you think is the best answer; there is no penalty for guessing. If you would like to review that answer at a later time, mark the item for review by clicking the box next to the flag in the upper right corner of the screen before going on to the next question. Flagging the item will remind you to go back and decide whether you need to change the answer during this test session. You may PAUSE at any point in the test by clicking PAUSE rather than NEXT after answering an item. The PAUSE button is used to stop the test. Please raise your hand if you need a break and ask me prior to clicking PAUSE. However, you should try to answer at least one item before pausing. If you PAUSE a test for more than 20 minutes, you will not be able to review or change the answers to items you have already answered. Your answers need to be your own work. Please keep your eyes on your own test and remember that there should be no talking. When you are ready to begin your test, click BEGIN TEST NOW at the bottom of the page. Please keep in mind that after you complete the test or a section of the test and have submitted your answers, you can no longer review questions you have already answered. You will be prompted to review your answers before you submit them. Note: The student will not be able to return to previously answered or marked questions if a test with only computer-administered items has been paused for 20 minutes or more. However, on the ELA test, if the student selects PAUSE without answering all of the items in an item set, he or she will be allowed to return to the screen/page containing that item set and continue; the student will not be able to review and change responses on any prior test screens/pages. After a pause, the student s test opportunity can be resumed at any time within the testing window. Students should not test after the test window has ended. -TAM 35-

38 Online Pilot Test Administration Manual Testing Over Multiple Sessions or Days If you intend to administer the test over the course of multiple days, it may be important for all of the students to pause after they reach a designated point. You should give the students clear directions on when to pause. These instructions may be written on a dry-erase board, chalkboard, or another place that students can easily see. For example, you may ask the students to pause at the end of the first section. Students will receive a notification when they reach the end of the section. When testing is resumed on a subsequent day, the TA will need to start a new test session and provide a new Session ID. When instructing the students to log in, TAs should read the un-italicized sections of the general script to the students from the beginning. Monitoring Testing Once students have started their tests, circulate through the room to ensure that all conditions of test security are maintained. You may also use the TA Site to view the testing progress of any student. This site will not show test questions or scores but will let you see how many questions have been delivered to each student (e.g., question 24 of 40). The TA Site is designed to automatically refresh every minute; you can manually refresh at any time by clicking the [Refresh Now] button at the top left of the page. Do NOT click the web browser s refresh button. If you notice that a student is off task, you may say the following statement to the student, verbatim, to keep him or her focused. SAY: It is important that you do your best. Do you need to pause the test and take a break? If a student asks for assistance either in answering an item or manipulating an item type, gently let the student know that he or she should try his or her best, but that you cannot help answer an item. SAY: I can t help with the test. Try to do your best. -TAM 36-

39 Online Pilot Test Administration Manual Warn students before the end of the test session. When there are approximately 5 minutes left for the test session, give students a brief warning. SAY: We are nearing the end of this testing period. Please review any completed or marked items now. If you have not finished, you will have the chance to finish the test at another time. End the test session and log out of the Test Administrator Site. After answering the last question, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all questions available to the student (presented after any pause taken) or to end the test. Tests can no longer be paused after the last question has been presented. After answering the last question on the test and reviewing test questions, students must end their test. They do so by clicking [REVIEW MY ANSWERS] or [SUBMIT TEST]. If a student clicks [SUBMIT TEST], the student will not be able to review answers. SAY: This testing session is now over. If you have finished, click SUBMIT TEST. If you have not finished, click PAUSE, and you will be able to finish at another time. I will now collect any scratch paper or other materials. Collect any scratch paper. Then click [Stop Session] to end the test session and pause any student tests in your session that are still in progress. When you are finished, you can log out of the TA Site by clicking the [Logout] button at the top right. -TAM 37-

40 Online Pilot Test Administration Manual DIRECTIONS FOR ADMINISTRATION: COMPUTER-ADMINISTERED ITEMS PLUS ONE PERFORMANCE TASK Note: This section includes directions for administration and a script to use in the administration of tests with computer-administered items plus one PT. TAs administering tests with computeradministered items only or tests with computer-administered items plus PT with classroom activity may go directly to the appropriate section. Following the completion of the computer-administered items, students will be engaged in a performance task. Performance tasks involve interaction of students with stimulus materials and/or engagement in problem solution. Establishing Appropriate Testing Conditions The School Coordinators and Test Administrators will need to work together to determine the most appropriate testing option(s) and testing environment based on the number of computers available, the number of students in each tested grade, and the estimated time needed to complete each test. Testing students in classroom-sized groups is preferable to administering tests to large groups in large facilities. Establishing smaller groups lessens test fear and anxiety for the students and facilitates monitoring and control for the TA. The test administration should be conducted in a room that does not crowd students. Good lighting, ventilation, and freedom from noise and interruptions are important factors to be considered when selecting a site. The room should be prepared for test administration. Information that is displayed on bulletin boards, chalkboards, or charts and that might be used by students to help answer questions should be removed or covered. This applies to rubrics, vocabulary charts, student work, posters, graphs, charts, etc. Cell phones or other electronic devices are not allowed in the testing room. It may be helpful to place a TESTING DO NOT DISTURB sign on the door. It may also be helpful to post signs in halls and entrances rerouting hallway traffic, if necessary, in order to promote optimum testing conditions. Students should be seated so that they will not be tempted to look at the answers of others. Appropriate seating arrangements should be used to discourage students from aiding one another. To prevent confusion, arrangements for student seating should be completed prior to the test administration. Establish procedures to maintain a quiet testing environment throughout the testing session, recognizing that some students will finish more quickly than others. If students are allowed to leave the testing room when they finish, explain the procedures for leaving without disrupting others and where they are expected to report once they leave. If students are expected to remain in the testing room until the end of the session, instruct them on what activities they may do after they finish the test. -TAM 38-

41 Online Pilot Test Administration Manual Classroom Preparation The TA will need to take the following steps immediately before testing: 1. Open the secure browser on each student s computer or open the secure browser app on each the student s ipad/tablet. 2. Distribute materials. Distribute any needed materials such as blank paper and pencils (see Allowable Resources in the Test Administration section of this manual). 3. Log into the Test Administrator Site and establish a test session. Log into the testing site using your username and password. Select the TA Interface application. If you do not have a username and password or you cannot access the TA Interface, contact your SC. In the upper left corner, select all of the tests associated with the grade and content area you will be testing. After you have selected the tests, click [Start Session]. Your students will only receive the test to which they were pre-assigned. A Session ID will automatically be generated and will appear in the top center of the screen. This Session ID will generally have four letters followed by a hyphen and then a number (for example, DEMO-01). Students will need this test Session ID to log into the test. A TA will provide the same Session ID to all students testing in that session. The test session must be created on the day of testing. Students from the same class who take tests at different times or with different TAs will not have the same test session ID. -TAM 39-

42 Online Pilot Test Administration Manual Login Script In order to ensure that all students are tested under the same conditions, you should adhere strictly to the script for administering the test. These instructions can be found in the boxes in bold on the following pages. When asked, you should answer questions raised by students, but you should never help the class or individual students with specific test items. No test items can be read to any student for any content or subject area. Please remember that the script must be followed exactly and used each time a test is administered. If you are resuming a test and are sure that all students are able to log in without hearing the login directions again, you may skip the italicized portions of the directions. All directions that you are to read to students are indicated by the word SAY and are in boxes so that they stand out from the regular text. Read these directions exactly as they are written, using a natural tone and manner. If you make a mistake in reading a direction, stop and say, I made a mistake. Listen again. Then read the direction again. Try to maintain a natural classroom atmosphere during the test administration. Before each test begins, encourage students to do their best. Any time a student logs into the testing system, the Test Administrator should follow this script. SAY: Today, you will take a test in the area of [insert name of test being given at this time]. You will be given a Test Session ID that is required to start the test. If you need an individual break during the test, raise your hand and wait for my instructions and permission. Once you have logged in, you will have to wait for me to approve the test before you can start. I ll be checking that you have correctly entered your ID number and other information -TAM 40-

43 Online Pilot Test Administration Manual Give students the test session ID. Write the test session ID for the test you will be giving on the board or another place where students can see it. Make sure students know that they must enter the test session ID exactly as it is written, without extra spaces or characters. Student information, such as the SSID, may be provided to students ahead of time on a card to help them type it in accurately. However, please remember that student ID numbers are confidential information and cards will need to be collected and shredded if used. SAY: Enter your legal first name (not your nickname), your two-letter state abbreviation followed by a hyphen and your SSID, and the test session ID that I provided. Raise your hand if you cannot see these numbers well enough to type them on your keyboard. Please do not share your SSID as it is your own private information. Once you have successfully logged in, you will see a screen with your full legal name, birth date, SSID, school, and grade. If all of the information on your screen is correct, select YES to continue. If any of the information is incorrect, please raise your hand so that you can show me what is wrong. Make sure all students have successfully entered their information. Be sure that the students use their legal first names, not nicknames. If a student is unable to log in, he or she will be prompted to try again and provided with a message describing the reason (an invalid SSID, for example). If the student is still having difficulty, the TA can look up the correct information using the Student Lookup function on the TA Site. TAs may assist students with logging in if necessary. If the problem cannot be resolved, please contact the Help Desk at or SmarterBalancedHelpDesk@air.org. SAY: On the next screen, select the test you will be taking today and click START TEST. After you have selected your test, you will see a screen with a moving bar and message saying that you are waiting for Test Administrator approval. This step helps ensure that you are taking the correct test. Please wait quietly while I verify each of your tests. In the event of technical difficulties with the secure browser, contact the technology coordinator, School Coordinator, or Smarter Balanced Help Desk. Approving students for testing. After students log in, you must confirm that these are the correct students to take the test and approve the students login requests. The upper right corner of your screen will always display a list of students who are awaiting approval at any time. Please make sure the correct student has logged in. Once students begin appearing in the preview box, you can click [Approvals (#)] to open the Approvals pop-up window. Review each student s test settings and edit as necessary. You can either click [Approve] for each individual student (recommended) or, when you are satisfied that all -TAM 41-

44 Online Pilot Test Administration Manual students in the list can be approved, click [Approve All Students]. Reminder: If any student s test settings are incorrect, do NOT approve that student. To refresh the list of students awaiting approval at any time, click the [Refresh] button at the top of the pop-up window. SAY: After I approve you to begin testing, you will see a screen asking you to check your test subject and settings. If all the information is correct, you may select YES, START MY TEST. If any of it is incorrect, please raise your hand and I ll be with you shortly. Each student will be logging in at a different time. Monitor the sessions and get all students logged in who are currently ready before assisting any students who are having problems. SAY: Before your test appears, you will see a tutorial page listing the test tools and buttons that you may use during the test or that will appear on the test. Please read this carefully. You can also find this information during your test by clicking the HELP button in the top right corner. You must answer each question on the screen before going on to the next question. During the test, you may see a page with no test questions. Follow the directions on the page to continue taking the test. If you are unsure of an answer, provide what you think is the best answer; there is no penalty for guessing. If you would like to review that answer at a later time, mark the item for review by clicking the box next to the flag in the upper right corner of the screen before going on to the next question. Flagging the item will remind you to go back and decide whether you need to change the answer during this test session. You may PAUSE at any point in the test by clicking PAUSE rather than NEXT after answering an item. Your answers need to be your own work. Please keep your eyes on your own test and remember that there should be no talking. The PAUSE button is -TAM 42-

45 Online Pilot Test Administration Manual used to stop the test. Please raise your hand if you need a break and ask me prior to clicking PAUSE. When you are ready to begin your test, click BEGIN TEST NOW at the bottom of the page. Please keep in mind that this test is divided into sections. When you get to the end of the each section, you will be prompted to review your answers before moving on. Once you submit your answers and move on to the next section, you will not be able to return to the previous section. Note: After a pause, the student s test opportunity can be resumed at any time within the testing window. Students should not test after the test window has ended. Testing Over Multiple Sessions or Days If you intend to administer the test over the course of multiple days, it may be important for all of the students to pause after they reach a designated point. You should give the students clear directions on when to pause. These instructions may be written on a dry-erase board, chalkboard, or another place that students can easily see. For example, you may ask the students to pause at the end of the first section. Students will receive a notification when they reach the end of the section. When testing is resumed on a subsequent day, the TA will need to start a new test session and provide a new Session ID. When instructing the students to log in, TAs should read the un-italicized sections of the general script to the students from the beginning. Directions for Administering the Performance Task If necessary, follow the Login Script to log the students back into the test. The students must work independently on the performance task; instructions will be delivered to them in the Test Delivery System. During part two of the performance task only, students may have access to a hard-copy dictionary. -TAM 43-

46 Online Pilot Test Administration Manual Monitoring Testing Once students have started their tests, circulate through the room to ensure that all conditions of test security are maintained. You may also use the TA Site to view the testing progress of any student. This site will not show test questions or scores but will let you see how many questions have been delivered to each student (e.g., question 24 of 40). The TA Site is designed to automatically refresh every minute; you can manually refresh at any time by clicking the [Refresh Now] button at the top left of the page. Do NOT click the web browser s refresh button. If you notice that a student is off task, you may say the following statement to the student, verbatim, to keep him or her focused. SAY: It is important that you do your best. Do you need to pause the test and take a break? If a student asks for assistance either in answering an item or manipulating an item type, gently let the student know that he or she should try his or her best, but that you cannot help answer an item. SAY: I can t help with the test. Try to do your best. Warn students before the end of the test session. When there are approximately 5 minutes left for the test session, give students a brief warning. SAY: We are nearing the end of this testing period. Please review any completed or marked items now. If you have not finished, you will have the chance to finish the test at another time. -TAM 44-

47 Online Pilot Test Administration Manual End the test session and log out of the Test Administrator Site. After answering the last question, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all questions available to the student (presented after any pause taken) or to end the test. Tests can no longer be paused after the last question has been presented. After answering the last question on the test and reviewing test questions, students must end their test. They do so by clicking [REVIEW MY ANSWERS] or [SUBMIT TEST]. If a student clicks [SUBMIT TEST], the student will not be able to review answers. SAY: This testing session is now over. If you have finished, click SUBMIT TEST. If you have not finished, click PAUSE, and you will be able to finish at another time. I will now collect any scratch paper or other materials. Collect any scratch paper. Then click [Stop Session] to end the test session and pause any student tests in your session that are still in progress. When you are finished, you can log out of the TA Site by clicking the [Logout] button at the top right. -TAM 45-

48 Online Pilot Test Administration Manual DIRECTIONS FOR ADMINISTRATION: COMPUTER-ADMINISTERED ITEMS PLUS PERFORMANCE TASK WITH CLASSROOM ACTIVITY Note: This section includes directions for administration and a script to use in the administration of tests with computer-administered items plus PT with classroom activity. TAs administering tests with computer-administered items only or tests with computer-administered items plus one PT may go directly to the appropriate section. Following the completion of the computer-administered items, students will be engaged in a classroom activity followed by a performance task. Classroom performance tasks involve a classroom-wide activity as well as individual student activities. For example, the classroom activity may consist of a group discussion about a particular stimulus, such as a chart or photo. Students may take notes during this time, but the notes must be destroyed before proceeding to Part 1 of the performance task. During the task, students work individually and may read sources, engage in answering research items delivered via the Student Interface, and then write a full-length essay, article, or report. Classroom activities may be administered in a computer lab or classroom and may take place on a separate day from previous and subsequent parts of the test. Regardless of where the classroom activity is administered, the TA should be able to record information for students to see (such as on a chalkboard). If the classroom activity takes place in a room without computers, students may log into the testing site after the classroom activity has been completed. Subsequent parts of the test require logging into the online system. Establishing Appropriate Testing Conditions The School Coordinators and Test Administrators will need to work together to determine the most appropriate testing option(s) and testing environment based on the number of computers available, the number of students in each tested grade, and the estimated time needed to complete each test. Testing students in classroom-sized groups is preferable to administering tests to large groups in large facilities. Establishing smaller groups lessens test fear and anxiety for the students and facilitates monitoring and control for the TA. The test administration should be conducted in a room that does not crowd students. Good lighting, ventilation, and freedom from noise and interruptions are important factors to be considered when selecting a site. The room should be prepared for test administration. Information that is displayed on bulletin boards, chalkboards, or charts and that might be used by students to help answer questions should be removed or covered. This applies to rubrics, vocabulary charts, student work, posters, graphs, charts, etc. Cell phones or other electronic devices are not allowed in the testing room. It may be helpful to place a TESTING DO NOT DISTURB sign on the door. It may also be helpful to post signs in halls and entrances rerouting hallway traffic, if necessary, in order to promote optimum testing conditions. Students should be seated so that they will not be tempted to look at the answers of others. Appropriate seating arrangements should be used to discourage students from aiding one another. -TAM 46-

49 Online Pilot Test Administration Manual To prevent confusion, arrangements for student seating should be completed prior to the test administration. Establish procedures to maintain a quiet testing environment throughout the testing session, recognizing that some students will finish more quickly than others. If students are allowed to leave the testing room when they finish, explain the procedures for leaving without disrupting others and where they are expected to report once they leave. If students are expected to remain in the testing room until the end of the session, instruct them on what activities they may do after they finish the test. Classroom Preparation The TA will need to take the following steps immediately before testing: 1. Retrieve the classroom activity directions from ORS. Tests with classroom activities include directions (that include a script) associated with that specific classroom activity. To retrieve these materials, TAs must log into ORS, where they will find the directions located in My Inbox. Review the teacher directions for the classroom activity carefully to ensure that you know how to prepare for and carry out the classroom activity. Note: Although downloading the classroom activity directions does need to take place prior to administration of the classroom activity, it does not necessarily need to take place prior to testing the computer-administered items. 2. Open the secure browser on each student s computer or open the secure browser app on each student s ipad/tablet. 3. Distribute materials. Distribute any needed materials such as blank paper and pencils (see Allowable Resources in the Test Administration section of this manual). 4. Log into the Test Administrator Site and establish a test session. Log into the testing site using your username and password. Select the TA Interface application. If you do not have a username and password or you cannot access the TA Interface, contact your SC. -TAM 47-

50 Online Pilot Test Administration Manual In the upper left corner, select all of the tests associated with the grade and content area you will be testing. After you have selected the tests, click [Start Session]. Your students will only receive the test to which they were pre-assigned. A Session ID will automatically be generated and will appear in the top center of the screen. This Session ID will generally have four letters followed by a hyphen and then a number (for example, DEMO-01). Students will need this test Session ID to log into the test. A TA will provide the same Session ID to all students testing in that session. The test session must be created on the day of testing. Students from the same class who take tests at different times or with different TAs will not have the same test session ID. Login Script In order to ensure that all students are tested under the same conditions, you should adhere strictly to the script for administering the test. These instructions can be found in the boxes in bold on the following pages. When asked, you should answer questions raised by students, but you should never help the class or individual students with specific test items. No test items can be read to any student for any content or subject area. Please remember that the script must be followed exactly and used each time a test is administered. If you are resuming a test and are sure that all students are able to log in without hearing the login directions again, you may skip the italicized portions of the directions. All directions that you are to read to students are indicated by the word SAY and are in boxes so that they stand out from the regular text. Read these directions exactly as they are written, using a natural tone and manner. If you make a mistake in reading a direction, stop and say, I made a mistake. Listen again. Then read the direction again. -TAM 48-

51 Online Pilot Test Administration Manual Try to maintain a natural classroom atmosphere during the test administration. Before each test begins, encourage students to do their best. Any time a student logs into the testing system, the Test Administrator should follow this script. This includes logging in to complete the computer-administered items, the classroom activity, or the performance task. SAY: Today, you will take a test in the area of [insert name of test being given at this time]. You will be given a Test Session ID that is required to start the test. If you need an individual break during the test, raise your hand and wait for my instructions and permission. Once you have logged in, you will have to wait for me to approve the test before you can start. I ll be checking that you have correctly entered your ID number and other information Give students the test session ID. Write the test session ID for the test you will be giving on the board or another place where students can see it. Make sure students know that they must enter the test session ID exactly as it is written, without extra spaces or characters. Student information, such as the SSID, may be provided to students ahead of time on a card to help them type it in accurately. However, please remember that student ID numbers are confidential information and cards will need to be collected and shredded if used. SAY: Enter your legal first name (not your nickname), your two-letter state abbreviation followed by a hyphen and your SSID, and the test session ID that I provided. Raise your hand if you cannot see these numbers well enough to type them on your keyboard. Please do not share your SSID as it is your own private information. Once you have successfully logged in, you will see a screen with your full legal name, birth date, SSID, school, and grade. If all of the information on your screen is correct, select YES to continue. If any of the information is incorrect, please raise your hand so that you can show me what is wrong. Make sure all students have successfully entered their information. Be sure that the students use their legal first names, not nicknames. If a student is unable to log in, he or she will be prompted to try again and provided with a message describing the reason (an invalid SSID, for example). If the student is still having difficulty, the TA can look up the correct information using the Student Lookup function on the TA Site. TAs may assist students with logging in if necessary If the problem cannot be resolved, please contact the Help Desk at or SmarterBalancedHelpDesk@air.org. -TAM 49-

52 Online Pilot Test Administration Manual SAY: On the next screen, select the test you will be taking today and click START TEST. After you have selected your test, you will see a screen with a moving bar and message saying that you are waiting for Test Administrator approval. This step helps ensure that you are taking the correct test. Please wait quietly while I verify each of your tests. In the event of technical difficulties with the secure browser, contact the technology coordinator, School Coordinator, or Smarter Balanced Help Desk. Approving students for testing. After students log in, you must confirm that these are the correct students to take the test and approve the students login requests. The upper right corner of your screen will always display a list of students who are awaiting approval at any time. Please make sure the correct student has logged in. Once students begin appearing in the preview box, you can click [Approvals (#)] to open the Approvals pop-up window. Review each student s test settings and edit as necessary. You can either click [Approve] for each individual student (recommended) or, when you are satisfied that all students in the list can be approved, click [Approve All Students]. Reminder: If any student s test settings are incorrect, do NOT approve that student. To refresh the list of students awaiting approval at any time, click the [Refresh] button at the top of the pop-up window. SAY: After I approve you to begin testing, you will see a screen asking you to check your test subject and settings. If all the information is correct, you may select YES, START MY TEST. If any of it is incorrect, please raise your hand and I ll be with you shortly. Each student will be logging in at a different time. Monitor the sessions and get all students logged in who are currently ready before assisting any students who are having problems. SAY: Before your test appears, you will see a tutorial page listing the test tools and buttons that you may use during the test or that will appear on the test. -TAM 50-

53 Online Pilot Test Administration Manual Please read this carefully. You can also find this information during your test by clicking the HELP button in the top right corner. You must answer each question on the screen before going on to the next question. During the test, you may see a page with no test questions. Follow the directions on the page to continue taking the test. If you are unsure of an answer, provide what you think is the best answer; there is no penalty for guessing. If you would like to review that answer at a later time, mark the item for review by clicking the box next to the flag in the upper right corner of the screen before going on to the next question. Flagging the item will remind you to go back and decide whether you need to change the answer during this test session. You may PAUSE at any point in the test by clicking PAUSE rather than NEXT after answering an item. Your answers need to be your own work. Please keep your eyes on your own test and remember that there should be no talking. The PAUSE button is used to stop the test. Please raise your hand if you need a break and ask me prior to clicking PAUSE. When you are ready to begin your test, click BEGIN TEST NOW at the bottom of the page. Please keep in mind that this test is divided into sections. When you get to the end of the each section, you will be prompted to review your answers before moving on. Once you submit your answers and move on to the next section, you will not be able to return to the previous section. We will wait until the entire class finishes the first section and then I will approve everyone to move on to the second section. Note: After a pause, the student s test opportunity can be resumed at any time within the testing window. Students should not test after the test window has ended. Testing Over Multiple Sessions or Days If you intend to administer the test over the course of multiple days, it may be important for all of the students to pause after they reach a designated point. For most tests, there is nothing built into the system preventing students from progressing from one section of the test to another. In those cases, the Test Administrator should give the students clear directions on when to pause. These instructions may be written on a dry-erase board, chalkboard, or another place that students can easily see. For example, you may ask the students to pause at the end of the first section. Students will receive a notification when they reach the end of the section. -TAM 51-

54 Online Pilot Test Administration Manual When testing is resumed on a subsequent day, the TA will need to start a new test session and provide a new Session ID. When instructing the students to log in, TAs should read the un-italicized sections of the general script to the students from the beginning. Directions for Administering the Classroom Activity A TA administering a test that includes a classroom activity will be required to approve students to move on to the classroom activity whether or not this section is started on a different day from the computer-administered item portion of the test. This will ensure that all students reach the activity at the same time. Once the students are approved to begin this session, follow this script to administer the classroom activity. If you are administering a classroom activity on a different day from the previous section of the test, follow the Login Script and make sure the students have all successfully logged in before beginning the classroom activity script. As a security measure, students tests are automatically paused and the students will be logged out after 20 minutes of test inactivity. Before the system logs the student out of the test, a warning message will be displayed on the screen. Students should click [OK] within 30 seconds after this message appears, to prevent the system from logging them out. If students are logged out due to inactivity, they may simply log back in again to resume testing. Directions for Administering the Performance Task If necessary, follow the Login Script to log the students back into the test. The students must work independently on the performance task responses; instructions will be delivered to them in the Test Delivery System. During part two of the performance task only, students may have access to a hard-copy dictionary. Monitoring Testing Once students have started their tests, circulate through the room to ensure that all conditions of test security are maintained. You may also use the TA Site to view the testing progress of any student. This site will not show test questions or scores but will let you see how many questions have been delivered to each student (e.g., question 24 of 40). The TA Site is designed to automatically refresh every minute; you can manually refresh at any time by clicking the [Refresh Now] button at the top left of the page. Do NOT click the web browser s refresh button. -TAM 52-

55 Online Pilot Test Administration Manual If you notice that a student is off task, you may say the following statement to the student, verbatim, to keep him or her focused. SAY: It is important that you do your best. Do you need to pause the test and take a break? If a student asks for assistance either in answering an item or manipulating an item type, gently let the student know that he or she should try his or her best, but that you cannot help answer an item. SAY: I can t help with the test. Try to do your best. Warn students before the end of the test session. When there are approximately 5 minutes left for the test session, give students a brief warning. SAY: We are nearing the end of this testing period. Please review any completed or marked items now. If you have not finished, you will have the chance to finish the test at another time. End the test session and log out of the Test Administrator Site. After answering the last question in each section, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all questions available to the student (presented after any pause taken) or to end the test. Tests can no longer be paused after the last question has been presented. After answering the last question and reviewing test questions, students must end their test. They do so by clicking [REVIEW MY ANSWERS] or [SUBMIT TEST]. If a student clicks [SUBMIT TEST], the student will not be able to review answers. SAY: This testing session is now over. If you have finished, click SUBMIT TEST. If you have not finished, click PAUSE, and you will be able to finish at another time. I will now collect any scratch paper or other materials. Collect any scratch paper. Then click [Stop Session] to end the test session and pause any student tests in your session that are still in progress. When you are finished, you can log out of the TA Site by clicking the [Logout] button at the top right. -TAM 53-

56 Online Pilot Test Administration Manual FOLLOWING TEST ADMINISTRATION Destroying Test Materials Federal law (FERPA) prohibits the release of any student s personally identifiable information. Any printouts must be securely stored and then destroyed when no longer needed. The following test materials must be securely shredded and recycled immediately following each testing session and may not be retained from one testing session to the next: Any print-on-request documents printed for the students use during testing. The TA Interface can generate a report that allows the tracking of all documents printed to make sure they have all been retrieved. Scratch paper and all other paper handouts written on or printed by students during testing. Any reports or other documents that contain personally identifiable student information, including student login cards that might contain student names and SSIDs. Reporting Testing Improprieties and Irregularities In addition to reporting testing improprieties, Test Administrators and School Coordinators should also report testing irregularities. Testing irregularities are unusual circumstances that impact an individual or group of students who are testing and may potentially affect student performance on the test, test security, or test validity. Examples of testing irregularities include major disruptions to a test, such as a fire drill, a schoolwide power outage, or a force majeure. In rare cases where testing improprieties or irregularities occur during administration of an online test, impacted tests may be invalidated, although invalidation will not occur automatically. Tests will not be invalidated until the facts associated with the alleged testing impropriety or irregularity are validated. In extremely rare instances, the student s test may be reset at the request of the school district if a reset does not compromise the security or validity of the assessment. If an online test is reset, the student responses will be removed, and the student may retest. Test Administrators and School Coordinators who have witnessed, been informed of, or suspect the possibility of a testing impropriety or irregularity should immediately contact their District Coordinator and complete the report form located on the Smarter Balanced portal. -TAM 54-

57 Online Pilot Test Administration Manual APPENDIX A: TEST NAMES The following table includes test names as they appear in the online system. The Test Name will appear in the TA Interface in the list from which TAs select tests to add to the test session. The corresponding Test Description explains the shorter Test Name. Test Name Test Description G3 Math G3 Math 1 PT G3 Math ClassPT A G3 Math ClassPT B G3 Math ClassPT C G3 ELA G3 ELA 1 PT G3 ELA ClassPT A G3 ELA ClassPT B G3 ELA ClassPT C G4 Math G4 Math 1 PT G4 Math ClassPT A G4 Math ClassPT B G4 Math ClassPT C G4 ELA G4 ELA 1 PT G4 ELA ClassPT A G4 ELA ClassPT B Grade 3 Mathematics Grade 3 Mathematics with Performance Task Grade 3 Mathematics with Classroom-Based Performance Task A Grade 3 Mathematics with Classroom-Based Performance Task B Grade 3 Mathematics with Classroom-Based Performance Task C Grade 3 English Language Arts Grade 3 English Language Arts with Performance Task Grade 3 English Language Arts with Classroom-Based Performance Task A Grade 3 English Language Arts with Classroom-Based Performance Task B Grade 3 English Language Arts with Classroom-Based Performance Task C Grade 4 Mathematics Grade 4 Mathematics with Performance Task Grade 4 Mathematics with Classroom-Based Performance Task A Grade 4 Mathematics with Classroom-Based Performance Task B Grade 4 Mathematics with Classroom-Based Performance Task C Grade 4 English Language Arts Grade 4 English Language Arts with Performance Task Grade 4 English Language Arts with Classroom-Based Performance Task A Grade 4 English Language Arts with Classroom-Based Performance Task B -TAM 55-

58 Online Pilot Test Administration Manual Test Name G4 ELA ClassPT C G5 Math G5 Math 1 PT G5 Math ClassPT A G5 Math ClassPT B G5 Math ClassPT C G5 ELA G5 ELA 1 PT G5 ELA ClassPT A G5 ELA ClassPT B G5 ELA ClassPT C G6 Math G6 Math 1 PT G6 Math ClassPT A G6 Math ClassPT B G6 Math ClassPT C G6 ELA G6 ELA 1 PT G6 ELA ClassPT A G6 ELA ClassPT B G6 ELA ClassPT C G7 Math Test Description Grade 4 English Language Arts with Classroom-Based Performance Task C Grade 5 Mathematics Grade 5 Mathematics with Performance Task Grade 5 Mathematics with Classroom-Based Performance Task A Grade 5 Mathematics with Classroom-Based Performance Task B Grade 5 Mathematics with Classroom-Based Performance Task C Grade 5 English Language Arts Grade 5 English Language Arts with Performance Task Grade 5 English Language Arts with Classroom-Based Performance Task A Grade 5 English Language Arts with Classroom-Based Performance Task B Grade 5 English Language Arts with Classroom-Based Performance Task C Grade 6 Mathematics Grade 6 Mathematics with Performance Task Grade 6 Mathematics with Classroom-Based Performance Task A Grade 6 Mathematics with Classroom-Based Performance Task B Grade 6 Mathematics with Classroom-Based Performance Task C Grade 6 English Language Arts Grade 6 English Language Arts with Performance Task Grade 6 English Language Arts with Classroom-Based Performance Task A Grade 6 English Language Arts with Classroom-Based Performance Task B Grade 6 English Language Arts with Classroom-Based Performance Task C Grade 7 Mathematics -TAM 56-

59 Online Pilot Test Administration Manual Test Name G7 Math 1 PT G7 Math ClassPT A G7 Math ClassPT B G7 Math ClassPT C G7 ELA G7 ELA 1 PT G7 ELA ClassPT A G7 ELA ClassPT B G7 ELA ClassPT C G8 Math G8 Math 1 PT G8 Math ClassPT A G8 Math ClassPT B G8 Math ClassPT C G8 ELA G8 ELA 1 PT G8 ELA ClassPT A G8 ELA ClassPT B G8 ELA ClassPT C G9 Math G9 Math 1 PT G9 ELA Test Description Grade 7 Mathematics with Performance Task Grade 7 Mathematics with Classroom-Based Performance Task A Grade 7 Mathematics with Classroom-Based Performance Task B Grade 7 Mathematics with Classroom-Based Performance Task C Grade 7 English Language Arts Grade 7 English Language Arts with Performance Task Grade 7 English Language Arts with Classroom-Based Performance Task A Grade 7 English Language Arts with Classroom-Based Performance Task B Grade 7 English Language Arts with Classroom-Based Performance Task C Grade 8 Mathematics Grade 8 Mathematics with Performance Task Grade 8 Mathematics with Classroom-Based Performance Task A Grade 8 Mathematics with Classroom-Based Performance Task B Grade 8 Mathematics with Classroom-Based Performance Task C Grade 8 English Language Arts Grade 8 English Language Arts with Performance Task Grade 8 English Language Arts with Classroom-Based Performance Task A Grade 8 English Language Arts with Classroom-Based Performance Task B Grade 8 English Language Arts with Classroom-Based Performance Task C Grade 9 Mathematics Grade 9 Mathematics with Performance Task Grade 9 English Language Arts -TAM 57-

60 Online Pilot Test Administration Manual Test Name G9 ELA 1 PT G10 Math G10 Math 1 PT G10 ELA G10 ELA 1 PT G11 Math G11 Math 1 PT G11 Math ClassPT A G11 Math ClassPT B G11 Math ClassPT C G11 ELA G11 ELA 1 PT G11 ELA ClassPT A G11 ELA ClassPT B G11 ELA ClassPT C Test Description Grade 9 English Language Arts with Performance Task Grade 10 Mathematics Grade 10 Mathematics with Performance Task Grade 10 English Language Arts Grade 10 English Language Arts with Performance Task Grade 11 Mathematics Grade 11 Mathematics with Performance Task Grade 11 Mathematics with Classroom-Based Performance Task A Grade 11 Mathematics with Classroom-Based Performance Task B Grade 11 Mathematics with Classroom-Based Performance Task C Grade 11 English Language Arts Grade 11 English Language Arts with Performance Task Grade 11 English Language Arts with Classroom-Based Performance Task A Grade 11 English Language Arts with Classroom-Based Performance Task B Grade 11 English Language Arts with Classroom-Based Performance Task C -TAM 58-

61 Online Pilot Test Administration Manual Change Log This table provides an overview of changes that have been made to this manual since its original publication. Page Section Change Date Designated Student Accessibility and Accommodation Options in TIDE; Accessibility and Accommodation Options Added sections to include more detail about accommodations and eligibility. 2/6/ Allowable Resources Added hard-copy dictionaries as allowable resources for students during only Part 2 of an ELA performance task. 2/6/ , 44, 53 Directions for Administration (all test types) Monitoring Testing Added text explaining how teachers should respond if students ask for assistance during the test. 2/21/ Research Forms Updated the description of research forms. 2/26/ Directions for Administration: Computer-Administered Items plus Performance Task with Classroom Activity 35, 42, 51 Directions for Administration (all test types) Approving Students for Testing Updated the description of tests with classroom activities. Included clarification about destroying notes taken during a classroom-based activity. Included language in the script explain what students should do if they encounter a blank page on the test. 2/26/2013 3/11/13 -TAM 59-

62 TEST ADMINISTRATOR USER GUIDE Smarter Balanced Assessment Consortium: Test Administrator For the Spring 2013 Scientific Pilot Test Administration Updated February 19, 2013 Prepared by the American Institutes for Research (AIR) Smarter Balanced Assessment Consortium, 2013 Descriptions of the operation of the Test Delivery System, Test Information Distribution Engine, and related systems are property of the American Institutes for Research (AIR) and are used with permission of AIR. 6060

63 Test Administrator Table of Contents Overview of the Online Testing System... 7 Systems for the Secure Pilot Test and Training Tests... 7 Pilot Test Administration... 7 Training Test Administration... 7 Introduction to This... 9 Content... 9 Other Resources Section I. General Rules of Online Testing Test Administration Policies and Procedures About Test Settings and Accommodations Basic Test Rules Pause Rules Assessments with Only Computer-Administered Items Assessments with Computer-Administered Items and Performance Tasks Test Timeout (Due to Inactivity) Section II. Accessing the Test Administrator Sites Accessing the TA Interface for the Pilot Test Accessing the TA Training Site for the Training Test Switching between Smarter Balanced Systems (Common Login System) Section III. Understanding the Test Administrator Interface Recognizing the Difference between the TA Sites TA Interface Layout TA Interface Quick Reference Student Lookup: Quick Search and Advanced Search Alert Messages Viewing Past Alerts Printing Session Information Section IV. Administering Online Assessments Starting a Test Session Selecting Assessments to Include in the Test Session Starting a Test Session Adding Assessments to the Test Session Viewing Students Test Settings and Approving Students for Testing Notification of Students Awaiting Approval (Approvals Preview) Viewing and Editing Students Test Settings and Accommodations Approving Students for Testing Denying Students Entry into the Test Session TA 2

64 Test Administrator Monitoring Students Testing Progress Student Statuses During Testing Pausing a Student s Test Stopping a Test Session and Logging Out Stopping the Test Session Exiting or Logging Out of the TA Interface Closing the Browser/Unintentional Exit Test Session Timeout/Automatic Logout Logging Out Section V. Understanding the Student Testing Site Test Layout Test Tools General Test Tools Calculator Tool Reading Passage Expansion Tool Text-to-Speech Accommodation and Speak Tool Print-on-Request Tool Section VI. Taking Online Assessments (Student View) Student Login and Test Selection Step 1 Logging In Common Student Login Errors Step 2 Verifying Student Information Step 3 Selecting a Test Step 4 Verifying Test Information Step 4b Audio Check Step 5 Viewing Test Instructions and Help and Starting the Test Proceeding through the Test Answering Test Items Marking Items for Review Reviewing Past or Marked Items Reaching the End of a Segment and Reviewing Items Pausing Tests Reaching the End of the Test End Test Review/Submit Page Test Submitted Confirmation Screen Appendix A. About the Secure Browser Forbidden Application Detection Secure Browser Error Messages Force-Quit Commands for Secure Browsers TA 3

65 Test Administrator Appendix B. Transferring Test Sessions between Computers Appendix C. Accessing Training Tests Appendix D. Global and Context Menus for Students Global and Context Menus Global Menu Context Menus and Test Elements Accessing an Element Context Menu with the Mouse Accessing an Element Context Menu with Keyboard Commands Context Menu: Highlighting Text with the Keyboard Appendix E. Keyboard Commands for Students Test Selection Screens and In-Test Pop-ups Keyboard Commands for Items with Add Point or Add /Arrow Tool Appendix F. Calculators in the Online Testing System About Calculators in the Test Delivery System Accessing the Sample Calculators Open a Sample Calculator on Windows/Mac/Linux Create a Desktop Shortcut to the Sample Calculator Open a Sample Calculator on a Mobile Tablet Save a Sample Calculator to your Home Screen (ipad) Bookmark and Add a Sample Calculator to Your Home Screen (Android) Available Calculators Basic (Four-Function) Calculator Scientific Calculator Graphing Calculator Expressions (Y=) Window View Table View Graph (Output) View Regression Calculator Keyboard Shortcuts for Calculators Appendix G. Using Braille with Online Testing About Online Testing and Braille Technology Requirements and Configuration Requirements for Student Computers Configure JAWS to Recognize the Secure Browser Applying Settings for Contracted/Uncontracted Braille Requirements for Test Administrator Computers Approvals and Student Test Settings for Braille Student Print Requests TA 4

66 Test Administrator Approving Print Requests Configuring Default Printing Preferences on the TA Computer BRF Files with the Duxbury Braille Translator Software PRN Files with the Tiger View Software Braille Interface Tools and Navigation JAWS Commands Navigating through the Login Screens TA 5

67 Table of Figures TA 6 Test Administrator Figure 1. Sample CLS Drop-Down Menu Figure 2. TA Interface Banner for Pilot Test Figure 3. TA Training Site Banner for Training Tests Figure 4. TA Interface for Pilot Test Figure 5. Quick Search Figure 6. Advanced Search Figure 7. Sample Alert Message Figure 8. Sample Past Alert Figure 9. Assessments Sorted by Grade Level Figure 10. Add Test to Session Confirmation Message Figure 11. No Students Awaiting Approval Figure 12. Students Awaiting Approval Figure 13. Approvals and Test Settings Screen Figure 14. Approvals and Test Settings for Selected Student Figure 15. Approvals and Student Test Settings Screen Figure 16. Students in Your Test Session Table Figure 17. Students in Your Test Session Table Figure 18. TA Interface Banner Containing Stop Session Button Figure 19. Log Out Warning Message Figure 20. Sample Item Page Figure 21. Expand Stimulus Icon Figure 22. Speak Tool Options for Items Figure 23. Print Passage Icon Figure 24. Print Item Icon Figure 25. Print Request Submitted Message Figure 26. TA Interface Print Button Figure 27. Print Request Preview (TA Interface) Figure 28. Secure Browser Login Page Figure 29. Sample Is This You? Screen Figure 30. Sample Your Tests Screen Figure 31. Waiting for TA Approval Figure 32. Sample Is This Your Test Screen Figure 33. Text-to-Speech/Audio Check Page Figure 34. Test Instructions and Help Page Figure 35. Sample Item with Flag Figure 36. Sample End Segment Screen Figure 37. Sample Item Page with End Test Button and Message Figure 38. Sample End Test Review/Submit Page Figure 39. Sample Test Submitted Confirmation Screen Figure 40. Unable to Establish Connection Message Figure 41. Enter Active Test Session ID Figure 42. Sample Global Menu Figure 43. Sample Test Elements Figure 44. Context Menu for Questions Figure 45. Context Menu for Answer Options Figure 46. Sample Combined Calculator Figure 47. Basic Calculator Figure 48. Scientific Calculator Figure 49. Graphing Calculator (Default View) Figure 50. Graphing Calculator: Expressions Figure 51. Graphing Calculator: Window View Figure 52. Graphing Calculator: Table View Figure 53. Graphing Calculator: Graph View Figure 54. Regression Calculator Figure 55. TA Interface: Test Settings for Student with Braille Figure 56. TA Interface: Student Print Request(s) Screen... 80

68 Overview of the Online Testing System Test Administrator The Smarter Balanced Scientific Sample Pilot Test (Secure Pilot Test) is open only to schools and districts that confirmed their participation. Schools and districts that volunteered for the Open Pilot Test will receive information in March 2013 about how to access that test. The Smarter Balanced Training Test is available only to schools and students participating in the Secure Pilot Test. The Training Test allows students and teachers to practice using the testing software prior to participating in the Secure Pilot Test. Systems for the Secure Pilot Test and Training Tests Administering test sessions requires Test Administrators (TAs) to use a test administration site and students to access a secure testing site. Pilot Test Administration For the Pilot Test administration, Test Administrators must use the Test Administrator Interface (TA Interface) to create test sessions and manage students online testing progress during the session. Students must use the secure browser to access the Student Testing Site. Training Test Administration To prepare for the Pilot Test administration, Test Administrators can create practice test sessions using the TA Training Site. Students can practice answering items and navigating through the test using the Training Tests. Access to the Training Tests is through a supported Internet browser or the secure browser. Key differences between the applications used for the Pilot and Training Test are listed in Table 1. Please note that the term Online Testing System is generally used to refer to the operational and training sites as a whole. Refer to Appendix C for additional information about login options for the Training Tests. Table 1. Online Testing System for Test Administrators and Students Test Administrator Sites Description Test Administrator Interface (Pilot Test) Used to administer Pilot Test sessions. Test Administrators use this site to create test sessions for students to log in to and access their grade-level online tests; verify students test settings (accommodations) before approving students for testing; track each testing student s progress throughout the pilot test; and pause students tests. TA Training Site (Training Tests) Used to create training test sessions. Test Administrators can use this site to create training test sessions for students to log in to and access available training tests; verify and edit students test settings (accommodations) before approving students for testing; track each testing student s progress throughout the training test; and pause students tests. TA 7

69 Test Administrator Student Sites Student Testing Site (Pilot Test) Training Tests Description Access Login Expiration Used for taking the Pilot Tests. Students use this site to log in to a created test session and access online tests; use tools such as zoom, strikethrough, and highlighting; review answers before completing the test (subject to pause and timeout rules); and pause a test if a short break is needed. Requires the use of the Pilot Test secure browser or secure Google Chromebooks login profile. Note: Text-to-Speech is available only for the Secure Pilot Test and with the following supported secure browser: Windows, Mac, Linux, and Android. Textto-Speech is also available with Chromebooks. Only students can log in to the Student Testing Site. (Requires first name as it appears in TIDE, State-SSID number, and Session ID to log in.) Pilot Test opportunities expire 30 days after the day they were started. Students may start and resume tests in any test session proctored by a Test Administrator in their associated school. The Smarter Balanced Pilot Test window for each participating school is approximately two weeks. Thus, students tests will not expire prior to the end of each test window. Used to allow students to become comfortable with the online tests and practice using test tools and settings. Students can use this site to log in to a practice test session (if one is created by a Test Monitor in the Test Monitor Training Site); practice answering sample item types that will be available in the online tests; practice using test tools; learn how to review answers before completing the test (subject to pause and timeout rules); and pause a test if a short break is needed. Requires the use of the Pilot Test secure browser or a supported Internet browser. Allows guest login. This allows students, families, and others to see what the online testing system is like and to see sample items. Also allows students to log in to a training session with their State-SSID number and training Session ID. Training test opportunities expire at the end of each day. Thus, students must complete a training test in one day, or they will need to start again from the beginning on another date. Students who do not complete a training test in one session can resume the test that same day in another session proctored by the same TA.* Students who logged into a training test guest session with their name and SSID can resume the test the same day by logging in to another guest session. TA 8

70 Introduction to This Test Administrator This user guide supports individuals using the Online Testing System applications to manage testing for students participating in the Smarter Balanced Pilot Test. This introduction describes the contents of this document and includes a key for identifying icons and elements found in this guide. Content This user guide provides information about the Online Testing System, including the TA and student applications, for the Smarter Balanced Pilot Test in a series of five sections, as follows. Appendices provide additional information. Each section and appendix begins on a new page, which allows for easy printing. Section I, General Rules of Online Testing, covers functional rules and limits for online testing. Section II, Accessing the Test Administrator Sites, explains how to access and log in to the TA Interface and TA Training Site. Section III, Understanding the Test Administrator Interface, describes the overall layout of the TA Interface and highlights the important tasks and functions. Section IV, Administering Online Assessments, outlines the process for creating test sessions, approving students for testing, and pausing tests. Section V, Understanding the Student Testing Site, describes the overall layout of an online assessment, as well as the functions and tools available to students. Section VI, Taking Online Assessments (Student View), explains how students log in to a test session, complete an assessment, and submit the assessment. Appendices provide additional information about secure browsers, accessing the training sites, keyboard commands students can use when a mouse is not available (for physical keyboards), and using the online calculators. Table 2. Key Icons and Elements Icon Description Warning: This symbol appears with text that contains extremely important information regarding actions that may cause errors. Caution: This symbol appears with text that contains important information regarding a task. Note: This symbol appears next to text that contains helpful information or reminders. Text that appears in gray boxes provides instructions relevant to the task described. Numbered (ordered) lists provide step-by-step instructions. Bulleted lists provide instructions that do not need to be done in a specific order. [Text] Text in brackets is used to indicate a link or button that is clickable. TA 9

71 Other Resources Test Administrator Administration manuals and other related documents for administering the Smarter Balanced Pilot Test are available on the Smarter Balanced portal. Technology requirements are outlined on the Smarter Balanced website s Technology page. This page contains information about supported hardware and operating systems for accessing the Pilot and Training Tests. The Technical Specifications Manual for Online Testing contains information about installing the secure browser and configuring the school s network to ensure that students can access the secure Student Testing Site. This document is available on the Smarter Balanced portal. TA 10

72 Test Administrator Test Administration Policies and Procedures Section I. General Rules of Online Testing This user guide does not provide information regarding administrative policies and procedures. Refer to the Online Test Administration Manual to find the Directions for Administration and other information on test policies, including how to prepare for online tests. The Online Test Administration Manual is available on the Smarter Balanced portal. You will need to read the Directions for Administration to students before they begin their tests. About Test Settings and Accommodations Students test settings and accommodations must be checked prior to starting a test session. A student s test accommodations cannot be changed after he or she starts the test. A test has started (or resumed) when the student clicks the [Begin Test Now] button on the Test Instructions and Help page (the last login screen that students see). Caution: Once any student has started a test and realizes that a required test accommodation is incorrect or not available (e.g., text-to-speech), the test opportunity must be reset. Refer to the Online Test Administration Manual for information about requesting test resets. A student with incorrect information or accommodations should not test until his or her record has been updated in TIDE. For information on viewing test settings and accommodations, see Viewing and Editing Students Test Settings and Accommodations in this user guide. Basic Test Rules Students cannot skip test items. (Students may mark an item for review and return to it later.) Students must answer all test items on a page before going to the next page. Some pages contain multiple items. Students may need to use the vertical scroll bar to view all items on a page. Students may mark items for review and use the Pages drop-down list to easily return to those items, provided the test has not been paused for more than 20 minutes (see Pause Rules). Students may review past items and change their answers only if the test has not been paused for more than 20 minutes (see the Pause Rules section below for exemptions). Pause Rules The following pause rules apply regardless of whether the student or the Test Administrator pauses the test or there was a technical issue (e.g., power outage or network failure) that resulted in the student being logged out. When students have paused a test, they must log back in to resume testing. Upon resumption, students will automatically be directed to the first page that has an unanswered item. Students ability to review previously answered items depends on the assessment they are taking. Assessments with only computer-administered items have a 20-minute pause limit rule. Assessments that include performance tasks do not have a pause limit rule. In the event of a technical issue (e.g., power outage or network failure), students tests will be paused and the students will be logged out. TA 11

73 Assessments with Only Computer-Administered Items Test Administrator Students are not permitted to change answers after their test has been paused for more than 20 minutes even if they have marked an item for review. The only exception to this rule is if a student was in the middle of a page containing multiple test items when the test was paused and at least one item on that page had not yet been answered. If a test is paused and the student resumes testing within 20 minutes, the student is presented with the test item or passage and associated items he or she was working on when the test was paused or shut down; and permitted to answer previously shown items (both answered and unanswered). When a test is paused for 20 minutes or more, the student is presented with the test page containing the test item(s) he or she was working on when the test was paused (if the page contains at least one unanswered item) OR with the next test page (if all items on the previous test page were answered); and NOT permitted to change any previously answered test items (with the exception of items on a page that contain at least one item that was not answered yet). Assessments with Computer-Administered Items and Performance Tasks When computer-administered items and performance tasks are present in the same assessment, the computer-administered items are contained in one segment, and the performance task elements are contained in a separate segment. Once a segment has been completed, the student cannot return to the items or task(s) in that segment. These tests do not have the 20-minute pause limit rule applied. Test Timeout (Due to Inactivity) As a security measure, students are automatically logged out after 20 minutes of test inactivity. This timeout also results in the test being paused automatically. Activity is defined as selecting an answer or navigation option in the test (e.g., clicking [Next] or [Back] or using the Past/Marked Questions drop-down list to navigate to another question). Clicking an empty space on the screen is not considered activity. Before the system logs the student out of the test, a warning message will be displayed on the screen. If the student does not click [OK] within 30 seconds after this message appears, he or she will be logged out. TA 12

74 Section II. Accessing the Test Administrator Sites Test Administrator The Test Administrator sites, including the Test Administrator Interface and the TA Training Site, are accessed through the Smarter Balanced portal. To log into either site, you must have an authorized username and password. If you have not yet received your login information, contact your District or School Coordinator. The process for accessing the TA sites is the same although different paths are taken. Accessing the TA Interface for the Pilot Test 1. Open your web browser and navigate to the Smarter Balanced portal ( 2. Click the green button for the Secure Pilot Test. 3. To access the TA Interface, click either the [School] or [District] button. 4. Click the [TA Interface] button. You will be directed to the Common Login System page. The Common Login System allows you to log in to the systems provided by the American Institutes for Research (AIR), including TIDE, the TA Interface, TA Training Site, and Online Reporting System. After logging in, you can switch between systems without having to log in and out of each system. 5. Type your username and password in the respective text boxes and click [Log In]. You will be directed to the system you selected. If you have forgotten your password, refer to the TIDE for instructions on resetting it. TA 13

75 Test Administrator Accessing the TA Training Site for the Training Test 1. Open your web browser and navigate to the Smarter Balanced portal ( 2. Click the blue button for the Training Test. 3. To access the TA Training Site, click either the [School] or [District] button. 4. Click the [TA Training Site] button. You will be directed to the Common Login System page. The Common Login System allows you to log into the systems provided by the American Institutes for Research (AIR), including TIDE, the TA Interface, TA Training Site, and Online Reporting System. After logging in, you can switch between systems without having to log in and out of each system. 5. Type your username and password in the respective text boxes and click [Log In]. You will be directed to the system you selected. If you have forgotten your password, refer to the TIDE for instructions on resetting it. TA 14

76 Switching between Smarter Balanced Systems (Common Login System) Test Administrator The Common Login System (CLS) is designed to ease the login process and simplify navigation between Smarter Balanced Assessment systems provided by AIR. CLS integrates the following systems: Test Information Distribution Engine (TIDE) Test Administrator (TA) Interface TA Training Site Online Reporting System Reminder: Access to each system and its features is dependent on the access provided by your user role. The top left corner of your browser contains a drop-down menu listing the above applications. From this menu, select the application (e.g., TIDE) you want to switch to. You will be directed to the main page for that application and will not have to log in again. Figure 1. Sample CLS Drop-Down Menu Warning: Although navigating to another system is easy, it is important to understand how the system operates in order to avoid unintended consequences of switching systems. If you are using the TA Interface or TA Training Site and you navigate away from it, your session will stop, and all students in the session will be logged out. You cannot resume your session. You will have to create a new session, and your students will have to log in to the new session to resume testing. TA 15

77 Section III. Understanding the Test Administrator Interface Test Administrator This section applies to the test administration sites for Test Administrators. Test Administrators must use the TA Interface to administer the Pilot Test. Test Administrators must use the TA Training Site to practice setting up sessions and administering the training tests. Recognizing the Difference between the TA Sites The TA Interface and TA Training Site look almost identical. The primary difference is which tests are available. Both sites allow Test Administrators to create test sessions, approve students, and monitor their test progress but the test options (Pilot Tests or Training Tests) are different. There is also a visual reminder of which site you are in. The TA Interface will say Pilot Test and the TA Training Site will say Training Test. Figure 2. TA Interface Banner for Pilot Test Figure 3. TA Training Site Banner for Training Tests Warning: Do NOT use the Student Testing Site or TA Interface for practice. For all training test sessions, use the TA Training Site and the Training Tests. TA 16

78 TA Interface Layout Test Administrator After you log in, you will see the TA Interface (or TA Training Site). All features and functions are identical between the two, except for the list of available assessments. Figure 4. TA Interface for Pilot Test The header row includes the [Help], [Log Out], and [Alert] buttons. Please note that the alert button looks like this:. The row under the header includes the following buttons and sections: Before you create a session, this row will show the following: [Start Session] (which will be grayed out until you select tests, [Student Lookup], [Print], Session ID (which will be blank when you first log in), and [Approvals (0)]. After you create a session, this row will change and show the following: [Stop Session], [Student Lookup], [Print], [Refresh Now], Session ID (which will show the automatically generated Session ID), and [Approvals (#)]. The top panel includes the available tests to include in the session. The TA Interface includes the available assessments for the Pilot Test. TA Training Site includes the available training tests. The second panel contains instructions and other helpful information. Click the row to expand the panel and read the information. Click it again to close the panel. The third panel displays the Students in Your Session table and shows students testing progress. The column headers with links are clickable. You can click a column to sort the information in the table by that column (Student Name, State-SSID, Opportunity [Opp #], Test, Test Settings, Requests, Student Status, or Pause Test). Note: This table automatically refreshes every 60 seconds. To manually refresh the page, click the [Refresh Now] button in the header row. TA 17

79 TA Interface Quick Reference Test Administrator The following table provides descriptions of the various buttons and features that appear on the TA Interface. Table 3. TA Interface Features Sections and Buttons Approvals/Pending Approvals preview section Description The [Approvals (#)] button and Preview section show how many students are awaiting approval to begin testing. Expand/Collapse Help Log Out Print Refresh Now Session ID Start Session Test Selection Stop Session Student Lookup Students in Test Session Table Use this button to expand or collapse a specific viewable area of your screen. This feature can be applied to the area containing the Test Selection and Pending Approvals tables and on-screen instructions section. Click [Help] to access this TA at any time. Click [Log Out] to exit the TA Interface. You will be logged out of all online Smarter Balanced applications, and all students tests will be paused. This feature allows you to print the list of approved students and their test progress as it is displayed on the screen. To print, click the [Print] button. The regular print window will appear. Select the desired settings and click [OK]. Federal law (FERPA) prohibits the release of any student s personally identifiable information. Any printouts containing student information must be securely stored and then destroyed when no longer needed. Use this button to manually refresh your screen while monitoring student progress. (The list of students in the Test Session table automatically refreshes every 60 seconds.) The Session ID is used by students to log in to a test session. Session IDs are unique to each test session. The Session ID links the students who are requesting access to the test session to the TA, who then approves or denies their access requests. Because the Session ID is unique for each test session in the state, it provides an audit trail for students tests. The Session ID is typically the first four letters of the TA s last name followed by a hyphen and number (e.g., NAME-1234). After the TA has selected the test from the Test Selection table, the [Start Session] button will become active. Click this button to start the session and create the automatically generated Session ID. Select the assessment(s) to include in the test session. An assessment cannot be removed from the session after it has been added. Click this button to end the session. Any students who are still testing will have their tests paused and they will be logged out. You will not be able to resume the current session, and a new session will need to be set up for students to finish testing. The Student Lookup tool allows TAs to search for students. Use Quick Search to look up students by SSID. Use Advanced Search to find students by district, school, grade, and first/last name. This table displays all the students who have entered the test session, the test each student is taking, and his or her progress throughout the test. TA 18

80 Student Lookup: Quick Search and Advanced Search Test Administrator If a student is having trouble logging in, you can use the Student Lookup feature to search for that student by SSID or first or last name. Caution: Any incorrect student information in the required demographic fields must be updated in TIDE. After a student s record is updated in TIDE, he or she can begin testing Figure 5. Quick Search 1. Click the [Student Lookup] button in the top row of the TA Interface. 2. Enter a student s State-SSID. 3. Click [Submit State-SSID]. If the search results in a match, that student s information will be displayed. Figure 6. Advanced Search 1. Click the [Student Lookup] button, and then click the [Advanced Search] tab. a. Select a district and school from the drop-down lists. b. Select a specific grade or all grades. c. Enter a student s first name and/or last name. Partial names are allowed (e.g., enter Fi into the last name field to search for students whose last name begins with Fi ). 2. Click [Search]. Search results that match the parameters will appear in the second column. 3. To see more information about a student, click the binoculars icon next to his or her name. A third column showing the student s information will appear. TA 19

81 Alert Messages Test Administrator The Smarter Balanced Assessment Consortium (Consortium) and the American Institutes for Research (AIR) are able to send out alert messages to all Test Administrators. These alerts will be displayed on the TA Interface. To ensure that you have read these messages, you will need to click [OK] to close the alert. Figure 7. Sample Alert Message Viewing Past Alerts A record of alert messages that you have read and acknowledged can be viewed by clicking the Alert Center icon. This appears at the top right corner of the screen, next to the [Log Out] button. Click the icon to open a window that contains alert messages that have not yet expired (each message includes an expiration date). Figure 8. Sample Past Alert TA 20

82 Printing Session Information Test Administrator This feature allows TAs to print the screen as it currently appears. Doing so can help track which students did not complete their tests and may need to be scheduled for another test session. 1. To print, click the [Print] button. The computer s standard/default print window will appear. 2. Select the desired print settings and then click [OK]. Tip: Set the print options to landscape mode (horizontal). You can also use your web browser s Print Preview feature to scale content to fit on a single printed page. Caution: Federal law (FERPA) prohibits the release of any student s personally identifiable information. Any printouts must be securely stored and then destroyed when no longer needed. TA 21

83 Section IV. Administering Online Assessments Test Administrator This section contains information on how to start a test session, add tests to the session, verify students test accommodations, approve students for testing, and monitor their progress. Warning: Check students information and test accommodations before test sessions! Students who require test accommodations must have their settings updated in TIDE by the District or School Coordinator before testing begins. For information about accommodations, refer to the Online Test Administration Manual. If you have a student whose test accommodations are incorrect, do not approve him or her for testing. Contact your School or District Coordinator to have the student s accommodations updated in TIDE. Starting a Test Session You must create a test session before students can log in to the Student Testing Site (or Training Test site). In order for a student to take a specific assessment, that test must be included in your test session. Caution: A test session automatically ends when you manually stop the session or log out of the TA Interface. While a student can resume a test opportunity in a new session, the test session cannot be resumed. In order for students to resume testing, you will need to create a new test session and give them the new Session ID. Students cannot access previous (closed) test sessions. Selecting Assessments to Include in the Test Session The test selection box is located in the upper left corner of the screen. Assessments are automatically listed in order by grade level and then subject. Please identify and select all tests in the grade and subject you will be administering during your test session. Students will be taking only one assessment each and they will be pre-assigned to an assessment. The pre-assigned assessment will be the only assessment available to each student. Test Selection Figure 9. Assessments Sorted by Grade Level To sort by grade level, click the radio button next to Grade. The list of assessments will reorder automatically. To sort again by subject, click the radio button next to Subject. The list of assessments will reorder automatically. TA 22

84 Test Administrator Starting a Test Session 1. Go to the test selection box under the [Start Session] button in the top panel. 2. Click the checkbox next to each test you want to include in the test session. Once you have selected a test, the [Start Session] button will become active. 3. After selecting the test(s), click the [Start Session] button. The selected test(s) will be highlighted and grayed out. The [Stop Session] button will replace the [Start Session] button. The Session ID will be generated and appear below Session ID. 4. Provide the Session ID to your students. You may want to write this down clearly on a board or other place where all students can see it or provide it to the students along with their login information. Most Session IDs are made up of the first four letters of your last name, followed by a hyphen and at least one number. Note: You may want to write down your Session ID in case you accidentally close your browser or need to transfer your session to another computer. See the Closing the Browser/Unintentional Exit section later in this user guide for information about accidentally closing your browser and Appendix B for more information about transferring test sessions. Adding Assessments to the Test Session You may add assessments to a session at any time. This may be necessary if one of your students sees the Test not available in this session message on his or her Your Tests screen during the login process. Please identify and select only those assessments that you will administer during the current test session. This should avoid confusion about which assessment a student should be completing first if multiple tests are to be completed. 1. From the test selection box, click the checkbox next to the name of the assessment to be added to your session. (For security purposes, assessments must be individually added to an active session.) 2. A pop-up window will ask you to confirm your selection (see image below). 3. Click [Yes] to add the selected assessment to your session. Figure 10. Add Test to Session Confirmation Message Note: While assessments may be added to an active test session after it has started, they cannot be removed from the session. TA 23

85 Viewing Students Test Settings and Approving Students for Testing Test Administrator After you have started the test session and given the students your Session ID, they can begin the login process. (Refer to Section VI, Taking Online Assessments [Student View] in this user guide for additional information on the login and approval process from the student perspective.) You must approve students before they can begin testing. This process includes viewing each student s test settings (accommodations) and verifying that they are correct. Notification of Students Awaiting Approval (Approvals Preview) The right side of the top panel contains the [Approvals (#)] section, which displays the number of students awaiting approval and a preview list of students names and assessments. Once students begin requesting entry into your test session, the [Approvals (#)] preview table will become active. The table will display those students who are awaiting approval. You will see each student s name and the test he or she requested. Figure 11. No Students Awaiting Approval Approvals Notification and Preview Table Figure 12. Students Awaiting Approval Approvals button is not clickable Approvals button says [Approvals (0)] Preview table says No students awaiting approval Approvals button is clickable Approvals button says [Approvals (#)] Preview table lists each student and his or her selected assessment Viewing Students Awaiting Approval 1. Click the [Approvals (#)] button to access the Approvals and Student Test Settings screen. TA 24

86 Viewing and Editing Students Test Settings and Accommodations Test Administrator The Approvals and Student Test Settings screen displays each student who is awaiting approval for entry into your session. You will see each student s name, SSID, current opportunity for the selected assessment, whether the test settings are standard or custom, and the option to approve or deny each student. Important: This screen does not automatically refresh. Therefore, students logging into your session after you have already opened the Approvals Screen will not appear. To update the list of students awaiting approval, click the [Refresh] button in the top row of the Approvals Screen. Figure 13. Approvals and Test Settings Screen About the Test Settings column: Students with Standard test settings are students whose test settings are set to default. Students with Custom test settings are those who have at least one test setting (accommodation). Accommodations include color choices, a different print size than the default, or text-to-speech. See the next page for additional information about test accommodations. Viewing a student s accommodations: Click the [See/Edit Details] button for that student. The screen will change to show the student s test information. TA 25

87 About Test Settings (Accommodations) Test Administrator Most of the student s information on this screen is read-only. Students default test settings must be preset in TIDE by the District or School Coordinator. Figure 14. Approvals and Test Settings for Selected Student Review each student s information to ensure that he or she has the correct accommodation(s) set. If a student s accommodations are incorrect, he or she should not test. Warning: A student who is resuming a test will have the test settings that were established at the time the student began the assessment. If the accommodations are not correct when the student starts or resumes the assessment, the student s test will need to be reset. The only Pilot Test setting that can be changed on this screen is the print size. If a student requires a larger print size than the default, you may select the appropriate option. Changing/confirming a student s settings: 1. Only the print size setting can be changed on this screen. Select the appropriate option for the student. 2. Confirm the test settings. Click [Set] to confirm the selected test settings and return to the list of students awaiting approval. You will still have to approve the student for testing. Click [Set & Approve] to confirm the selected test settings and approve the student for testing. Accommodations for the Training Test: TAs may change the color choice setting in addition to the print size. TA 26

88 Approving Students for Testing Test Administrator After you have confirmed students test settings and accommodations, you may return to the list of students awaiting approval. On this screen, you can approve individual students or approve all waiting students at once. After all students in the list have been approved (or denied), whether individually or all at once, the Approvals Screen window will automatically close. Figure 15. Approvals and Student Test Settings Screen Approving students for testing: To approve individual students, click the green [Approve] button for each student. The student will be approved and will also disappear from the list. To approve all students currently displayed in the list, click the [ Approve All Students] button at the top right. This will approve those students for testing. Note: You may approve all students who appear in the list. However, subsequent students who log in to the test session after you have opened the Approvals Screen will still need to be approved. TA 27

89 Denying Students Entry into the Test Session Test Administrator Although Test Administrators can approve all students at the same time, students must be individually denied entry into the test session. TAs may deny students for one of the following reasons: The student is not supposed to enter the session. The student s demographic information is incorrect. The student s required accommodations are incorrect. To deny a student entry into the test session: 1. On the Approvals screen, click [Deny] for that student. 2. In the pop-up window that appears, enter a brief reason for denying the student. 3. Click the green [Deny] button. The student will receive a message explaining the reason he or she was denied entry into the session. The student will then be logged out and directed to the login page. TA 28

90 Monitoring Students Testing Progress Test Administrator After students have logged in and you have approved them to begin testing, the Students in Your Test Session table will display each student currently logged in to your session. Figure 16. Students in Your Test Session Table Note: If a student s row is grayed out, that indicates that the student is not actively testing. This occurs when the student s test is paused or the student has completed the test. The Students in Your Test Session table displays the following for each student in the test session. Table 4. Students in Your Test Session Column Descriptions Column Student Name SSID Opportunity # Test Test Settings Request Student Status Pause Test Description The first and last name of the student in the session. This column displays the State-SSID associated with the student s name. Each student s record indicates the opportunity number for that student s subject test. For the Smarter Balanced Pilot Test, each student has only one opportunity for each test. The full name of the test the student is taking. Each student s test will display one of the following settings: Standard Settings: Indicates that the default test settings are applied for this student s test opportunity. Custom Settings: Indicates that one or more of the student s test settings and/or accommodations are different from the default settings. The binoculars icon displayed in this column is clickable. Click the icon for a student to view his or her test settings and accommodations. When a student requests a printout of a reading passage or other test material, a [Print] button will appear in this column. Click the [Print] button to review and authorize or deny the student s request. For more information about print requests, refer to the Print on Request tool section. This column lists the current status for each student in the test session. The numbers (#/#) listed after the status shows the student s progress while he or she is taking the test. The first number is the number of items the student has answered. The second number is the total number of items that will be administered. See Table 5 for descriptions of each possible status. Click the [Pause] button to pause a student s test. The student will be logged out. Reminder: See the Pause Rules section for information on pause time limits and students ability to review answers. TA 29

91 Student Statuses During Testing Test Administrator The following statuses appear in the student status column in the Students in Your Test Session table. The following status types are listed chronologically as displayed during the testing process. Table 5. Statuses That Appear Chronologically during Testing Status Approved Started (#/#) Review Completed Scored Submitted Description The Test Administrator has approved the student for the session, but the student has not yet started or resumed the test. The student has started testing. The number (#/#) after this status indicates how many items the student has answered out of the total number of items on the test. This number does not indicate which item or item page the student is actively viewing. The student has answered all items and is currently reviewing his or her answers before submitting the test for scoring. Note: A test with a review status occurs only at the end of the test. A test is not completed until the student submits the test. The student has submitted the test. No additional action can be taken by the student. The Online Testing System has processed the student s answers to items on the test. Note: The Pilot Test will not actually be scored. The test has been submitted for quality assurance review and validation. The following status types may appear when a student is listed in the Students in Your Test Session table but is not actively answering items. Table 6. Other Statuses Status Denied Paused (#/#) Pending Suspended Description The Test Administrator denied the student entry into the session. If the student attempts to enter the session again, this status will change to Pending until the Test Administrator approves or denies the student. The student s test is currently paused. The following scenarios will result in a paused status: The student pauses his or her test by clicking the [Pause] button. The student has been idle longer than 20 minutes, and the test was paused. The Test Administrator pauses the student s test. The Test Administrator stops the session. A technical problem with the student s computer or browser has resulted in a loss of connection to the Online Testing System. The time listed with this status indicates how long the student s test has been in the paused status. The student is awaiting Test Administrator approval for a new test opportunity. The student is awaiting Test Administrator approval to resume a test opportunity. TA 30

92 Pausing a Student s Test Test Administrator Test Administrators can pause an individual student s test using the Pause Test column in the Students in Your Test Session table. Students whose tests are paused will be logged out and directed to the login page. If they want to reenter the session, they will have to log in and go through the approval process again. (If the session has been stopped, the student will have to obtain the new Session ID in order to resume testing.) Figure 17. Students in Your Test Session Table To pause an individual student s test: 1. In the Pause Test column, click the [Pause] button for that student. 2. Click [Yes] to confirm that you want the student s test to be paused. Note: When a student s test is paused, the status column will display how long the test has been paused (in minutes). Students taking assessments with only computer-administered items and who pause for more than 20 minutes will not be able to review previously answered questions. For more information, see the Pause Rules subsection in Section I, Overview of Online Testing in this user guide. TA 31

93 Test Administrator Stopping a Test Session and Logging Out Stopping the Test Session Although students tests can be resumed, test sessions cannot be resumed. Stopping a session will end the session and automatically pause all students tests in that session. The students will be logged out automatically. Figure 18. TA Interface Banner Containing Stop Session Button To stop the test session: 1. Click the [Stop Session] button in the upper left corner of the screen. An Important! box will appear, requesting verification to end the session and log students out. 2. Click [OK] to continue. Reminder: Because test sessions cannot be resumed, you will need to create a new session if your session has been stopped. When you start a new session, give the new Session ID to your students so that they can log in and resume testing. Exiting or Logging Out of the TA Interface Users should exit or log out of the TA Interface only after stopping the test session. Regardless of when or how users log out or navigate away from the TA Interface, student data will NOT be lost. Caution: As a security measure, TAs are automatically logged out after 20 minutes of user inactivity and student inactivity in the session, which will result in closing the test session. Reminder: Students whose CAT-only assessments are paused for more than 20 minutes will not be able to review previously answered questions. For more information, see the Pause Rules subsection in Section I, General Rules of Online Testing in this user guide. Closing the Browser/Unintentional Exit If you accidentally close the browser while students are still testing, your session will remain open until it times out. You can open the browser and navigate back to the TA Interface. You will be prompted to enter your active Session ID. (See Appendix B for more information about transferring a session to another computer or logging back into an active session. You must know your current Session ID.) If you do not return to the TA Interface and reenter the active session within 20 minutes, you will be logged out, and all your students tests will be paused. In the case of an unintentional exit from the TA Interface caused by a system or computer error (such as the web browser crashing or closing), a network or communication error, power loss, or other event, the 20-minute rule applies. TA 32

94 Test Session Timeout/Automatic Logout Test Administrator If you are automatically logged out, the status of your session will change to closed and all inprogress tests in the session will be paused. You will need to log back in to the TA Interface, start a new session, and provide the new Session ID to students who need to resume testing. Logging Out To log out of the TA Interface (and all other Smarter Balanced applications), click the [Log Out] button in the top right corner of the screen. You will be presented with a warning message. Figure 19. Log Out Warning Message Click [Log Out] to proceed. Your session will be closed, and you will be directed to the Smarter Balanced portal after you log out. You will not be able to resume the test session. Alert: This scenario also occurs when the TA navigates to another site from the TA Interface. If you need to access TIDE or another application, we encourage you to open it in a separate browser window. If you unintentionally log out of the TA Interface while students are still testing, all in-progress tests will be paused and the students will be logged out. You cannot resume the original session. You will need to log back in, start a new session, and provide the new Session ID to students who need to log back in and resume testing. TA 33

95 Section V. Understanding the Student Testing Site Test Administrator This section of the user guide is designed to familiarize Test Administrators with the students online testing environment. This section covers the following: Test layout Test tools Test Layout This sample image shows the primary features and tools available to all students. Figure 20. Sample Item Page TA 34

96 Test Administrator Test Tools This section provides information about the online tools available to all students. General Test Tools The following tools are available for all assessments: Highlight text in passages and test questions Zoom in and out of test pages (this makes the font look larger or smaller) Mark specific items for review Make notes about an item in the notepad (notes will be deleted when the test is paused or stopped) Strikethrough (cross out answer options) Note: If an answer option is an image, then the image will be grayed out. A strikethrough line will not appear. Access the Test Instructions and Help screen at any time Calculator Tool In addition to the above, students also have access to the calculators for mathematics assessments: Basic Calculator: grades 6 and 7 Scientific Calculator: grade 8 Graphing, Regression, and Scientific Calculators: grades 9, 10, and 11 Information about using these calculators is available in Appendix F. Stimulus Expansion Tool Some tests will have pages that display two panes. The left pane will contain either a reading passage or stimulus, and the right pane will display the items associated with the stimulus. Students can expand the stimulus section so that it takes up a larger portion of the screen. This action will cover a portion of the items in the right pane. Students will see an icon in the upper right corner of the left pane that shows a plus sign and a blue right arrow. Figure 21. Expand Stimulus Icon To expand and collapse the stimulus section: To expand the passage: Click the blue arrow icon. The pane will expand to the right and cover the items. To collapse the passage: Click the same button, which is now orange and shows a minus sign and a left arrow. The pane will collapse to its original size and the items will be visible. TA 35

97 Text-to-Speech Accommodation and Speak Tool Test Administrator Students who have the text-to-speech (TTS) accommodation can use the Speak tool to listen to passages and/or test items and answer options. Figure 22. Speak Tool Options for Items Warning: Students who require TTS must have the accommodation enabled in TIDE prior to starting a test opportunity. The TTS accommodation cannot be enabled after a student has started testing. Students who use the Speak tool must use headphones to listen to the audio. (AIR recommends that students use headphones with a built-in volume control for maximum audio adjustment capability.) Reminder: Text-to-speech settings should be tested and verified as working properly before students begin their tests. Students who have this accommodation can ensure that their settings work as part of their test login process. See Section VI, Taking Online Assessments (Student View) for additional information. To access the Speak tool: 1. Right-click an area that contains text. A pop-up menu will appear with Speak options. Students who select a portion of text and right-click will be presented with the option to listen to the selected test. This feature is primarily used with reading passages. 2. Select the desired Speak option and the text will be spoken aloud. TA 36

98 Print-on-Request Tool Test Administrator Students who are granted the print-on-request accommodation can request printing of reading passages or test items or both. Students who have this accommodation will see the Print Passage icon and/or printer icon for each item. Students who do not have a print-on-request accommodation will not see any print icons for passages or items. The print-on-request tool requires interacting with the TA, as students print requests are sent to the TA Interface first. After the TA reviews and approves the print requests, the passages or items can be sent to the printer. 1. To request that a reading passage or item be printed, the student must click the Print Passage and/or printer icon. Passages: The Print Passage icon appears in the footer, next to the Zoom In/Zoom Out buttons. Items: The printer icon appears in the top right corner of each item. Figure 23. Print Passage Icon Figure 24. Print Item Icon 2. Once the print request has been sent, the student will see a pop-up message indicating that the request has been sent to the TA for approval. Figure 25. Print Request Submitted Message 3. On the TA Interface, the [Print] button will appear in the Requests column. Click the button to view the student s request. Figure 26. TA Interface Print Button 4. Review the print request. If you approve the print request, click [Approve]. A cover sheet containing the student s name and SSID will display in a new browser window. Note: The requested test content will not be displayed on your screen at any time. 5. Click [Print] in the new window to complete the print request and view the printer dialog box. If necessary, adjust the print settings for your printer (e.g., fit to page). 6. Click [OK] to send the request to the printer. Figure 27. Print Request Preview (TA Interface) TA 37

99 Section VI. Taking Online Assessments (Student View) This section explains how students log in, begin and complete testing, and submit tests. Test Administrator Warning: Before students log in, their test settings and accommodations should be verified in TIDE. Once students select a test, their test settings and accommodations cannot be changed. Student Login and Test Selection Students must go through a five-step login process before they can start or resume a test. This process ensures that students verify their information, as well as their test and any accommodations they have. Students who will be using the text-to-speech accommodation will have an additional step that allows them to check their audio settings prior to beginning or resuming the test. Caution: At this time, students who require the text-to-speech accommodation should not use an ipad. They should use a computer that supports text-to-speech. They should use the Windows, Mac, Linux, or Android secure browser or Chromebooks to access the Student Testing Site.. The steps and images in this section are for students using a desktop or laptop computer with the secure browser installed. The process is very similar for students using a tablet or Google Chromebooks. TA 38

100 Step 1 Logging In When the secure browser is opened, it automatically connects to the student login page. Figure 28. Secure Browser Login Page Test Administrator Opening the secure browser and logging in 1. Launch the secure browser by double-clicking the icon on the student s desktop. 2. Students must enter the required login information in each of the three fields: a. In the First Name field, enter the first name as it exists in the student record in TIDE (e.g., Julie). b. In the State-SSID field, enter the two-letter state abbreviation, followed by a hyphen and SSID (e.g., ZZ ). c. In the Session ID field, enter the Session ID for the created session (e.g., DEMO-123). 3. Click [Sign In]. Common Student Login Errors The system will generate an error message and associated code if a student cannot log in. The following are the most common student login errors. Note: Test Administrators may need to watch the student to ensure that he or she is entering all information properly. Student s first name and SSID do not match. Verify that the student has correctly entered his or her SSID. If this does not work, use the Student Lookup tool to verify the first name associated with the student s State-SSID. The Student Lookup tool allows you to verify the spelling that appears in the system. (Sometimes the student will enter a variation of his or her first name, which is not accepted [e.g., Jon/Jonathan]. Also, students do not always realize that they must enter only their legal first name. Verify that they are not entering their last name.) This error can also occur when students do not enter their two-letter state abbreviation before their SSID. TA 39

101 Test Administrator Session ID does not exist. The student entered a Session ID that does not exist. Verify that the student entered the active Session ID correctly and that it does not contain any unnecessary spaces or characters. (Also verify that both you and the student are using the correct sites. For example, students logged into the Practice and Training Test Site cannot enter a session that was created in the TA Interface.) The testing session is closed. The Session ID entered corresponds with a session that is closed. Ensure that the student enters the correct Session ID for the active session. If this does not work, verify that your session is open. Reminder: Test Administrators cannot resume sessions. If a session is stopped, a new one will need to be created. Doing so will result in a new Session ID. (Also verify that both you and the student are using the correct sites. For example, students logged into the Practice and Training Test Site cannot enter a session that was created in the TA Interface. They may not realize they are attempting to access a training session that has since been closed, rather than accessing an operational test session.) The student is not associated with the school. The student is not associated with the Test Administrator s school, or the Test Administrator is not associated with the student s school. TA 40

102 Step 2 Verifying Student Information Test Administrator After logging in, students will see the Is This You? screen. At this point, each student must verify his or her personal information. Figure 29. Sample Is This You? Screen Verifying personal information: 1. Verify name, date of birth, school, State-SSID, and grade level. 2. Click [Yes]. The Your Tests screen will appear. If any of the information displayed is incorrect, the student should not proceed with testing. Have the student click [No]. He or she will be redirected to the login page. Tell your School or District Coordinator that the student s information needs to be updated. TA 41

103 Step 3 Selecting a Test Test Administrator After a student confirms his or her identity, the Your Tests screen appears, and all grade-level tests that the student is eligible to take are displayed. However, students will be able to select only those tests included in the test session (and those that the student has not yet completed). Figure 30. Sample Your Tests Screen Available tests are shaded green and indicate whether the student will be starting a new test opportunity or resuming an opportunity. Inactive tests are shaded gray and indicate that they were not included in the test session or that the student has already completed the assessment(s). Selecting an available test: Click the test name. The request will be sent to the TA for approval. If the test the student needs to take is inactive or not displayed, the student should click [Back to login]. The student will be logged out and returned to the login screen. The student s request will be sent to the TA. The student will see the following display while waiting for the TA to approve the request for entry into the session: Figure 31. Waiting for TA Approval TA 42

104 Step 4 Verifying Test Information Test Administrator After the TA has approved the student for testing, the student will need to verify the test information and settings on the Is This Your Test? screen. Figure 32. Sample Is This Your Test Screen Verifying test information: If the settings are correct, click [Yes, Start My Test]. The student will proceed to the Test Instructions and Help page. (Students who have a TTS accommodation will be prompted to check their audio settings immediately after this step.) If the settings are incorrect, the student should click [No]. He or she will return to Step 3, Selecting a Test. The student must select the test again and request approval from the TA. TA 43

105 Step 4b Audio Check Test Administrator Students who have the text-to-speech accommodation and who have headphones plugged into their computers must verify that they can hear the sample audio before continuing the login process. Figure 33. Text-to-Speech/Audio Check Page Checking audio settings: The student should click the green speaker icon and listen to the audio. If the voice was audible and clear, the student should click [Yes, I heard the voice]. The student will be directed to the Test Instructions and Help page. If the voice was not audible or clear, the student should adjust the settings using the Volume and Pitch sliders. Once the voice is clear, the student should click [Yes, I heard the voice] to continue. If the student still cannot hear the voice clearly, he or she should click [No, I did not hear the voice]. The student is then shown a message with instructions and offered the choice to continue without text-to-speech, try again, or log out. The student should either try again or log out. After a student logs out, he or she should close the secure browser. The TA can work with the student to adjust the computer s audio settings. The student can then reopen the secure browser and log back in. Selecting a Different Voice Pack: If a student wants to use a different voice that is available on the computer, he or she will have to log out, and you will need to help the student select another voice pack using the computer s speech properties interface. Contact your technology staff with questions. Once the student confirms the audio settings and starts the test, the audio settings cannot be changed. If a student wants to change the audio settings, he or she will have to pause the test and resume the login process to return to the Audio Check page. TA 44

106 Step 5 Viewing Test Instructions and Help and Starting the Test Test Administrator After the student has verified his or her test settings and clicked [Yes, Start My Test], the next page will show the Test Instructions and Help screen. Figure 34. Test Instructions and Help Page To proceed and begin the test: 1. Students may review the information on this screen to understand what test tools are available and how to navigate through the online test. 2. After the student has finished reviewing this screen, he or she should click [Begin Test Now]. When the student clicks the [Begin Test Now] button, he or she officially begins or resumes the current test opportunity. TA 45

107 Proceeding through the Test Test Administrator This section provides information on how students answer items and proceed through an assessment. Answering Test Items Students must answer each test item that appears on a page before they can proceed to the next page in the test. Some pages may have only one test item, and others may have more. The Smarter Balanced Pilot Test includes the following question types (though all tests may not contain all item types): Selected-response items: The student selects an answer option by clicking anywhere on the answer choice. Constructed-response items: The student types a response into a response box. Technology-enhanced items: The student uses the mouse or keyboard to manipulate items or draw responses in the response box. Performance tasks: The student completes an extended activity in preparation for answering questions. For constructed-response and technology-enhanced items, a [Save] button will appear in the bottom row next to the [Pause] button. Clicking this button is not required because students answers are automatically saved as they move to the next item. The [Save] button allows students to manually submit their response if they want to do so before continuing to the next item. If students do not click the [Save] button on pages with multiple items, they will receive a warning message saying that they have not answered all of the questions on the page. While it is not necessary to click the [Save] button, it is recommended after completing a response to a technologyenhanced question. That way, if students receive the warning message, they know they have an unanswered item on the page. After students have answered all items on a page, they must click [Next] to go to the next page. Marking Items for Review Students may mark items for review if they are unsure that they selected or provided the correct answer. The top right corner of each item has a flag icon. Figure 35. Sample Item with Flag To mark an item for review: Click the flag icon. The flag will turn blue and a check mark will appear. TA 46

108 Reviewing Past or Marked Items While students must answer all test items on a page before moving on to the next page, they may return to a previous item if the test has not been paused for more than 20 minutes (assessments with only computer-administered items) OR the previous item is not in a segment that was already completed (see below). Test Administrator Students can use either the [Back] button or the Pages drop-down list to navigate to the item(s) they want to review. Reaching the End of a Segment and Reviewing Items For segmented tests, students will see an End Segment/Review screen at the end of each segment. They can review items only within the current segment. (Note: Training Tests do not have segments.) After students click the [Next] button on the End Segment page, they have left the previous segment and started the new one. They cannot return to any questions in the previous segment(s). Alert: If a student has paused a test within a segment and returns to the test after the 20-minute pause limit has expired, he or she will NOT be able to review the previously completed items. Figure 36. Sample End Segment Screen To review items from the End Segment screen: Click a question number on the left. The student will automatically be directed to the page containing that item. TA 47

109 Pausing Tests Test Administrator Students are able to pause the test by clicking the orange [Pause] button in the top row. They can do so whether they are viewing a page with a single item or one with multiple items. To pause a test: 1. Click the orange [Pause] button. A confirmation message will appear. 2. Click [Yes] to acknowledge the message and pause the test. The student will be logged out and directed to the secure browser login page. Alert: If the student attempts to pause a test with unanswered questions on the page, a message will appear telling the student that the test may not be paused with unanswered questions on the page. When the student is ready to resume testing, he or she will need to log in again. You may want to remind students taking the CAT-only assessments that if their tests are paused for more than 20 minutes, they may be unable to change answers to previously seen items. TA 48

110 Reaching the End of the Test Test Administrator After students answer the last item on the test, the [End Test] button will appear in the upper right corner of the screen. The top of the screen will also display the following message: The test has been completed and is ready to be submitted when you are done reviewing your answers. Figure 37. Sample Item Page with End Test Button and Message After students click the [End Test] button, a pop-up message will appear as below. Students may select [Yes] if they are ready to finish the test and [No] if they are not. TA 49

111 Test Administrator End Test Review/Submit Page After students select [Yes], a new screen presents two options: Review answers Submit the test Figure 38. Sample End Test Review/Submit Page End Test screen options: 1. To review answers and go back to the test, students must select an item or test page from the list and then click [Review My Answers]. For segmented tests, students may review items only from the last segment. While students are reviewing their answers, the [End Test] button will remain on the screen. To return to the End Test screen, the student should click that button again. 2. To complete the testing process, students must click the [Submit Test] button. Alert: After the student clicks [Submit], the test is officially completed. The student cannot log back in and review his or her answers. TA 50

112 Test Submitted Confirmation Screen Test Administrator After the student submits the test for scoring, he or she will see the Test Submitted Confirmation screen. This screen will show the student s name, the test name, and the date the test was completed and submitted. Figure 39. Sample Test Submitted Confirmation Screen TA 51

113 Appendix A. About the Secure Browser Test Administrator Students must use the secure browser installed on the computer to log in to the Student Testing Site. The secure browser is designed to ensure test security by prohibiting access to external applications or navigation away from the test. Your school s Technology Coordinator is responsible for ensuring that the secure browser has been correctly installed on all computers to be used for testing at your school. If you are not sure that the secure browser was installed or you have questions, contact your Technology Coordinator. For information about installing the secure browser, refer to the Technical Specifications Manual for Online Testing. This document is available on the Smarter Balanced portal. While the secure browser is an integral component of test security, Test Administrators perform an equally important role in preserving test integrity. In addition to the guidelines put forth by the Smarter Balanced Assessment Consortium and individual districts or schools, TAs should be aware of the following and employ the necessary precautions while administering online assessments: Close External User Applications Prior to administering the online assessments, Test Monitors should check all computers that will be used and close all applications except those identified as necessary by the school s Technology Coordinator. After closing these applications, the Test Monitor should open the secure browser on each computer. The secure browser will not work if the computer detects that a forbidden application is running (see below). Prohibit Testing on Computers with Dual Monitors Students should not take online assessments on computers that are connected to more than one monitor. Systems that use a dual monitor setup typically display an application on one monitor screen while another application is accessible on the other screen. Forbidden Application Detection The secure browser and Student Testing Site automatically detect certain applications that are prohibited from running on a computer while the secure browser is open. When the secure browser is launched, the system checks all applications currently running on a computer. If a forbidden application is detected, the student will not be able to log in. A message will also be displayed that lists the forbidden application(s) that need to be closed. Warning: If a forbidden application is launched in the background while the student is already in a test, the student will be logged out and a message displayed. This typically occurs when a process such as Internet Explorer is triggered in the background in order for a software autoupdate to occur. AIR recommends checking all software auto-updates and ensuring that they are done outside of planned testing hours. Before administering tests, Test Administrators should ensure that all software applications are closed before opening the secure browser on student computers. Contact your school s technology staff if you need assistance in closing forbidden applications. TA 52

114 Secure Browser Error Messages Secure Browser Not Detected Test Administrator The Online Testing System automatically detects whether a computer is using the secure browser to access the Student Testing Site. Under no conditions may a student access the Pilot Test site using a non-secure browser. Unable to Establish a Connection with the Online Testing System If a computer fails to establish a connection with the Online Testing System, the message below will be displayed. This is most likely to occur if there is a network-related problem. The cause can be anything from a network cable not being plugged in to the school s firewall not allowing access to the site. Figure 40. Unable to Establish Connection Message Force-Quit Commands for Secure Browsers In the rare event that the secure browser or test becomes unresponsive and you cannot pause the test or close the secure browser, you have the ability to force quit the secure browser. To force the browser to close, use the following keyboard commands. (Reminder: This will log the student out of the test he or she is taking. When the secure browser is opened again, the student will have to log back in to resume testing.) We strongly advise against using the force-quit commands, as the secure browser treats this action as an abnormal termination. The secure browser hides features such as the Windows taskbar, and if the secure browser is not closed correctly, then the taskbar may not reappear correctly. These commands should be used only if the [Close Secure Browser] button does not work. Windows: [Ctrl] + [Alt] + [Shift] + [F10] Mac OS X: [Ctrl] + [Alt] + [Shift] + [F10] Linux: [Ctrl] + [Alt] + [Shift] + [Esc] Note for Windows and Mac Users: If you are using a laptop or netbook, you may also need to press the [FN] key before pressing [F10]. TA 53

115 Appendix B. Transferring Test Sessions between Computers Test Administrator Test Administrators can transfer an active test session from one computer/mobile device or browser to another without stopping the test session or interrupting in-progress tests. This feature is useful in scenarios in which a TA s web browser or computer encounters an issue while a test session is in progress or if the TA needs to change to a computer that is connected to a working printer. Warning: If you cannot remember your Session ID, you will be unable to transfer the session. Write down your Session ID BEFORE you transfer the session. The system ensures that a test session can be administered from only one browser at a time; therefore, when a session is moved to a new computer, the TA will no longer be able to administer the test session from the original browser or machine. The instructions on this page apply to both the TA Interface and TA Training Site. If you started a session on the TA Interface, ensure that you log into the TA Interface on the new computer or browser, and not the TA Training Site. To transfer a test session to a new machine or browser: 1. Log in to the TA Interface on the new machine or browser. Do NOT log out of or stop the test session on the original computer or browser; doing so will end the test session and pause all students tests. A Session ID prompt will appear (see Figure 41 below). 2. Enter the active Session ID into the text box and click [Enter]. When the Session ID is validated, you will see the TA Interface and be able to continue monitoring your students progress and take action on any pending print requests. 3. The test session on the previous computer or browser will automatically close. (This will not stop the session.) Figure 41. Enter Active Test Session ID TA 54

116 Appendix C. Accessing Training Tests Test Administrator Training tests are available to students and guest users so that they can become familiar with the online testing environment. These tests contain fewer items than the full-length Pilot Tests. Anyone can access the training tests using the guest login options. Students may also use their first name and SSID to log into a guest session or a practice test session with a Test Administrator who is using the TA Training Site. As a result, four possible login scenarios are available. The Training Tests must be accessed using either AIR s secure browser or a supported Web browser. If a student needs to use text-to-speech with the training tests, the secure browser must be used. Text-to-speech is not available when a Web browser is used. The secure browser can be downloaded from the Smarter Balanced portal (sbac.portal.airast.org). Accessing the Training Tests with the secure browser 1. Open the secure browser on the computer. 2. At the bottom of the Sign In screen, click the link that says [Go to the Training Tests Instead]. Options for Logging In A. Guest User in Guest Session 1. Make sure the checkboxes next to Guest User and Guest Session are checked. 2. Click [Sign In]. B. Guest User in Training Session with a TA 1. Uncheck the box next to Guest Session. 2. Enter the Session ID provided by the TA (e.g., DEMO-1234). 3. Click [Sign In]. C. Student in a Guest Session 1. Uncheck the box next to Guest User. 2. Enter your first name (as it appears in TIDE) and State-SSID. 3. Click [Sign In]. D. Student in a Training Session with a TA 1. Uncheck the boxes next to Guest User and Guest Session. 2. Enter your first name (as it appears in TIDE) and State-SSID. 3. Enter the Session ID provided by the TA (e.g., DEMO-1234). 4. Click [Sign In]. Accessing the Training Tests with a Web browser 1. Navigate to the Smarter Balanced portal (sbac.portal.airast.org). 2. Click the [Training Test] link. 3. Click the [Student] icon. 4. Click the [Training Tests] link. Training Tests Login Page (showing default Guest User/Guest Session) TA 55

117 Test Administrator About Guest Sessions Guest sessions do not require TA approval, so users can access the training tests directly and can also modify their own test settings (color choice and print size). Guest users will need to choose a grade level prior to selecting a training test. As with the regular login process, all students and guest users must go through a series of five login steps before they will see the first page of the test. Select a Grade Level (Guest Users) and Confirm Information (Students) 1. Guest users must select a grade level from the drop-down list; this will determine the item samplers you can access. Users should confirm the information on the screen. 2. Click [Yes] to continue. Select a Training Test (All Users) 1. Click the name of the training test you want to take. You will continue to the next step. 2. If you want to access tests from another grade, click [Back to Login]. Note: If you are a student who previously logged into a training session and have already started a test, the text will say Resume instead of Start. Choose Test Settings (Guest Sessions only) This page appears when you have logged into a guest session. It allows you to select options for background color, print size, and text-to-speech, if applicable. Click [Select] to continue. Note: If you log in into a training test session created by a TA, you will be unable to change test settings. If you log into a guest session, you will be able to change test settings. Reminder: For text-to-speech to be available, access the training tests using the secure browser. Confirm Selected Test and Settings (All Users) 1. Review the screen and confirm the test and settings. 2. Click [Yes, Start My Test] to proceed. TA 56

118 Test Administrator Audio Check (for students with accommodation) Audio for the text-to-speech accommodation can be accessed only when you are using the secure browser. When using the secure browser, you may be prompted to verify that you can hear the sample audio before starting the training test. Click the green audio button to listen to the sample audio. You can adjust the volume and pitch of the voice on this screen. Use the sliders to increase or decrease the volume and pitch. If the voice is clear, click [Yes, I heard the voice]. If you cannot hear the voice or it is not clear, click [No, I did not hear the voice]. You will be directed to a screen that will allow you to log out and adjust the computer s voice settings. Note: If your computer does not have audio or a voice pack correctly configured, you may see a page that says text-to-speech is not available. Check with your school s Technology Coordinator for assistance. The Test Instructions and Help page is next. Review the information on this page, and then click [Begin Test Now] at the bottom of the screen. The first page of the test will automatically appear. (If you resumed a training test, you will be directed to the first page that has unanswered questions.) TA 57

119 Appendix D. Global and Context Menus for Students Test Administrator The American Institutes for Research and Smarter Balanced encourage the use of keyboards and a mouse when students are accessing tests. This section provides an overview of the global and context menus available in the test. Global and context menus can all be accessed with a mouse or with keyboard commands. Note: Keyboard commands are not optimized for tablets. Students who are using tablets should use the device s touch-screen capability to access test tools. Text-to-speech is not available when mobile tablets are used. Global and Context Menus The Global and Context menus allow students to access on-screen tools. These can be accessed with a mouse or keyboard shortcuts. Global Menu The Global Menu contains all the visible tools displayed at the top of the student s test screen (save, pause, back, next, zoom in, zoom out, calculator, help, etc.). Figure 42. Sample Global Menu To access the Global Menu tools using keyboard commands: Press the [Ctrl] + [G] keys on the keyboard. The menu will appear on the screen. Use the Up or Down arrow keys on the keyboard to move between options in the menu. Each option will be highlighted as you arrow up or down. Press the [Enter] key to select the highlighted menu option. Press the [Esc] key to close the Global Menu. TA 58

120 Test Administrator Context Menus and Test Elements The Context menus contain the options available for each area of a test item on a page. These areas are called elements. Each element has its own Context Menu. Figure 43. Sample Test Elements Elements include reading passages or stimuli and test items, as well as answer options for selected-response question. For selected-response items, each answer option (A, B, C, and D) is a single element. Accessing an Element Context Menu with the Mouse To view the Context Menu for an element using a mouse, simply right-click in that area. The Context Menu for that element will appear. The options vary depending on the following: The element type (passage, question, or selected-response answer option) The test settings and tools available to students (e.g., only students with the text-to-speech accommodation who are using the secure browser can use the TTS Speak options) Figure 44. Context Menu for Questions Figure 45. Context Menu for Answer Options Accessing an Element Context Menu with Keyboard Commands Navigating to an Element Students who cannot use a mouse can use the keyboard to navigate to an element. Press the [Tab] key to navigate between test items (and the reading passage, if there is one). Press [Ctrl] + [Tab] to switch from a test item to each answer option. Opening a Context Menu for an Element Using the Keyboard Press the [Ctrl] + [M] keys on the keyboard. The Context Menu for that element will appear. Use the Up or Down arrow keys on your keyboard to move between options in the menu. Each option will be highlighted as you arrow up or down. Press the [Enter] key to select the highlighted menu option. Press the [Esc] key to close the Context Menu. TA 59

121 Context Menu: Highlighting Text with the Keyboard 1. Navigate to the element containing the text you want to select. 2. Press [Ctrl] + [M] to open the Context Menu. Test Administrator 3. Select Enable Text Selection from the list of available options. A flashing cursor will appear. 4. Use the arrow keys on the keyboard to move the cursor to the beginning of the text you want to select. 5. Hold [Shift] and use the arrow keys to select your text. The text you have selected will appear shaded. 6. Press [Ctrl] + [M] to access the Context Menu again. Select the feature you want to use for the selected text (e.g., Highlighter, Speak Passage). TA 60

122 Appendix E. Keyboard Commands for Students Test Administrator Students can use these keyboard commands to navigate between test elements, features, and tools. Button/ Image Open the GLOBAL MENU Description of Function Keyboard Commands + Go to the NEXT test page + (or use the Global Menu) Go to the PREVIOUS test page + (or use the Global Menu) Move to the NEXT ELEMENT (on a page containing multiple test items and/or a reading passage) Move to the PREVIOUS ELEMENT (on a page containing multiple test items and/or a reading passage) + Select OPTION A Select OPTION B Select OPTION C Select OPTION D PAUSE your test END TEST and submit it for scoring Open the HELP GUIDE Open the CALCULATOR (selected Math tests only) ZOOM IN (increase the size of text and graphics on a page) ZOOM OUT (decrease the size of text and graphics on a page) + to move between answer choices to select it as the answer + (via Global Menu) + (via Global Menu) + (via Global Menu) + (via Global Menu) + or use the Global Menu + or use the Global Menu SCROLL UP in an area of the test page SCROLL DOWN in an area of the test page SCROLL to the RIGHT in an area of the test page SCROLL to the LEFT in an area of the test page TA 61

123 Test Administrator Button/ Image Description of Function Keyboard Commands Open the CONTEXT MENU (for the selected passage, question or answer option) + MARK/UNMARK a question for review + (via Context Menu) Open NOTEPAD to provide feedback on an item + (via Context Menu) HIGHLIGHTER (highlight text on the page) STRIKE THROUGH an answer option Send a PRINT PASSAGE request Only available to students who have the Print-on- Request accommodation enabled) Send a PRINT request for questions and answer options Only available to students who have the Print-on- Request accommodation enabled) SPEAK (listen to a passage, question, answer choice, or specific portion of text) Available only to students who have the Text-to-Speech accommodation enabled. + (via Context Menu) + (via Context Menu) + (via Global Menu) + (via Context Menu) + (via Context Menu) Test Selection Screens and In-Test Pop-ups Use these keyboard commands to select options on the login pages or on pop-up messages that appear during the test. For example, if you see a screen with [No] or [Yes] buttons, you will need to navigate to those buttons to select them. Keyboard Command Function Move to the next option + Move to the previous option Select the shaded option TA 62

124 Test Administrator Keyboard Commands for Items with Add Point or Add /Arrow Tool Technology-enhanced items with an add point or add line tool may have up to three main sections: Answer Space (the large area that takes up the most space) Action button row (at least one action button will be present at the top) Object Bank (a section on the left that includes objects to move to the Answer Space) Note: Not all interactive items contain all three sections. Some items may contain only an Answer Space (with objects already in the Answer Space). Some contain only action buttons and the Answer Space. Some may contain only the Object Bank and Answer Space. Keyboard Command Function Press the [Tab] key to move between the Object Bank, the action buttons at the top of the screen (may include the following: [Delete], [Add Point], [Connect Line], [Add Arrow], and [Add Line]), and the main Answer Space. The active space will show a border to make it look different. The active button will be white. Press the [Enter] key to move between the objects (images, dots, lines, and arrows) in the Answer Space. The active object will show a border to make it look different. Select Object: Press the [space bar] to select the active object or button (the one that shows a border). If you are selecting an object or adding a point, line, or arrow, it will move to the Answer Space in the top left corner. It will also have a blue border to show that it is still active. Delete Object: Press the [space bar] to delete an object (after you have selected the [Delete Button] option and moved to the object you want to delete). or or Move the object to the left or right. Move the object up or down. For items in the Object Bank, use the or arrows to navigate between the available objects. The selected object will have a blue background. + [arrow key] Move the object a smaller distance (left, right, up, or down). TA 63

125 Appendix F. Calculators in the Online Testing System About Calculators in the Test Delivery System Test Administrator Students are able to use an online calculator for some mathematics assessments. Available calculator types include Basic, Scientific, Graphing, and Regression. Descriptions of each available calculator are provided in this appendix. Students can use a mouse or keyboard to use the calculators on desktop and laptop computers. For tablets, students can simply tap the keys on the calculator s keypad. Information about keyboard shortcuts for students who cannot use a mouse is also available in this section. Some calculators may be combined; that is, students may access both scientific and graphing calculators within the same calculator window. When multiple calculator types are available, a button will appear for each calculator type. Figure 46. Sample Combined Calculator TA 64

126 Accessing the Sample Calculators Test Administrator All sample calculators are available on the Smarter Balanced portal. We encourage bookmarking the sample calculators. Desktop/home screen shortcuts can also be created. Once the calculators are saved to the desktop or home screen, students can open them without needing a Wifi or 3G/4G connection. Open a Sample Calculator on Windows/Mac/Linux 1. Navigate to the Smarter Balanced portal > Training Test > Student > Calculators page. 2. Click on a [Calculator] link. The sample calculator you selected will open in the browser window. Note: The first time you load the sample calculator, you should see a pop-up message that says This website (tds.airast.org) is asking you to store data on your computer for offline use. 3. Click [Allow]. Create a Desktop Shortcut to the Sample Calculator Note: Ensure that the browser window does not take up the full monitor. 1. Use your mouse to hover over the lock icon in the address bar. 2. Click and drag the lock icon to the desktop. A shortcut will appear that says Calculator and have the browser icon. 3. Optional: Rename shortcut icon. a. Click in the icon text and it will become editable. b. Change the text to what you want (e.g., Graphing Calculator ). 4. Double-click the icon to open the sample calculator. TA 65

127 Test Administrator Open a Sample Calculator on a Mobile Tablet 1. Navigate to the Smarter Balanced portal > Training Test > Student > Calculators page. For ipads, use Safari. For Android tablets, use Google Chrome. 2. Tap on a [Calculator] link. The sample calculator you selected will open in the browser window. Note: You will see a pop-up message encouraging you to add the calculator to the tablet s home screen. Save a Sample Calculator to your Home Screen (ipad) 1. Tap the share icon [ ], which appears just to the left of the address bar. 2. Tap the [Add to Home Screen] icon. 3. Optional: Rename shortcut icon. (By default, all sample calculators are named Calculator. ) a. Tap in the box that says Calculator. b. Using the tablet keyboard, add or modify text (e.g., Graphing Calculator ). 4. Tap the blue [Add] button. The shortcut icon will appear on the Home screen. TA 66

128 Test Administrator Bookmark and Add a Sample Calculator to Your Home Screen (Android) Save the Sample Calculator as a Bookmark 1. Tap the star icon [ ], which appears on the right side of the address bar. The Add Bookmark screen will open. 2. Optional: Modify the bookmark name. a. Tap the text and then use the keyboard to change the name. b. Tap the down arrow to close the keyboard. 3. Tap [Save]. Add the Calculator Bookmark to the Home Screen 1. Tap the menu [ ] icon, which appears in the upper right corner. The menu will open. 2. Tap [Bookmarks]. The list of your bookmarks will appear. 3. Tap and hold the calculator bookmark. A list of options will appear. 4. Tap [Add to home screen]. The bookmark will be added to your tablet s home screen. TA 67

129 Test Administrator Available Calculators Basic (Four-Function) Calculator Available for the following assessments: Mathematics grades 6 and 7 The basic calculator includes a number pad and buttons for adding, subtracting, multiplying, and dividing. Figure 47. Basic Calculator Calculation keys: Division ( ) Multiplication (x) Subtraction ( ) Addition (+) Equals (=) Function keys: Backspace Clears the last numeral entered CE Clears the last numeric entry made; the previous operation is still current C Clears all numbers and operations TA 68

130 Test Administrator Scientific Calculator Available for the following assessments: Mathematics grade 8 In addition to the functions available on the basic/standard calculator, the scientific calculator includes exponential, logarithmic, and trigonometric functions. Figure 48. Scientific Calculator Calculation keys: Division ( ) Multiplication (x) Square root ( ) to find a square root, enter the number and then select Subtraction ( ) Sign (+/-) to enter a negative number, click +/-, and then select the number(s). Addition (+) Equals (=) Function keys: Backspace Clears the last numeral entered CE Clears the last numeric entry made; the previous operation is still current C Clears all numbers and operations ANS Retrieves last computed result M Indicates memory is full STO Stores displayed value in memory RCL Recalls stored value from memory C Clears stored value in memory Sin Displays sin( followed by expression: used to find sine values Cos Displays cos( followed by expression: used to find cosine values Tan Displays tan( followed by expression: used to find tangent values e^x Displays exp( followed by expression: used to find exponentials ln Displays ln( followed by expression: used to find natural logarithms log Displays log( followed by expression: used to find logarithms ( Left parentheses ) Right parentheses n! Finds factorial of displayed value 1/x Finds multiplicative inverse of displayed value x^y Displays carrot symbol to represent exponential notation x^2 Finds the square of the displayed value x^3 Finds the cube of the displayed value π Displays the value of pi as Abs Displays Abs( followed by expression: used to find absolute value Degrees Sets calculator in degrees mode Radians Sets calculator in radians mode TA 69

131 Test Administrator Graphing Calculator Available for the following assessments: Mathematics grades 9, 10, and 11 In addition to the function and calculation keys available on a scientific calculator, students can plot graphs and tables for up to four equations, as well as modify the graphing window parameters. Figure 49. Graphing Calculator (Default View) Graphing function keys: Expressions (Y=) Allows student to enter up to four (4) different expressions Window Allows student to set maximum and minimum axes values for graphing window Table Allows student to create a table of values for each entered expression Graph Shows graph for each entered expression using the window Reset Clears all expressions and resets window to default values x-var Inputs x-variable Expressions (Y=) By default, the [Expressions (Y=)] option is selected (shaded blue). Each expression can be an equality or inequality. From each drop-down list, select from the following: Equals (=) Greater than (>) shade above function Less than (<) shade below function Enter an expression in to each desired Y text box. To display the graph of the expression(s), select the [Graph] button. To change the parameters, click the [Window] button. Figure 50. Graphing Calculator: Expressions TA 70

132 Test Administrator Window View This section allows you to change the dimensions and scale for the graph output window. Click the [Window] button and verify or update the value in each text box. Xmin Sets the minimum x value displayed on the graph s x-axis Xmax Sets the maximum x value displayed on the graph s x-axis Ymin Sets the minimum y value displayed on the graph s y-axis Ymax Sets the maximum y value displayed on the graph s y-axis Trace Step Size This feature is comparable to the Xres feature on handheld graphing calculators and allows you to change the pixel resolution. This value does not need to be changed. Xscale Defines the distance between tick marks on the x-axis Yscale Defines the distance between tick marks on the y-axis Table View This section allows you to change the initial value of x based on the expressions entered in the [Expressions (Y=)] section. Changing the value of Init X will allow you to see the corresponding output values for each Y = expression. After you have verified or updated the value in the Initial X (Init X) text box, click the [Apply] button. Figure 51. Graphing Calculator: Window View Figure 52. Graphing Calculator: Table View Function keys: Apply Shows y-values for the inputted x-value Previous Shows y-values for the preceding 5 values of x Next Shows y-values for the next 5 values of x TA 71

133 Test Administrator Graph (Output) View This section allows you to view the graph output of the expressions entered in the [Expressions (Y=)] section. Figure 53. Graphing Calculator: Graph View In addition to the graphing window, four arrow buttons and two radio buttons (Scroll and Trace) are available on this section of the graphing calculator. Arrow Keys The arrow keys enable students to use the scroll and trace features. See below for more information. Scroll and Trace Features Scroll Allows students to pan (move) the viewing window up, down, left, and right. Select the Scroll radio button and then click an arrow: Up ( ) arrow pan upward Down ( ) arrow pan downward Left ( ) arrow pan to the left Right ( ) arrow pan to the right Trace Allows students to observe both the x and y coordinates of a point on a graph as the cursor moves along the graph of the function. Select the Trace radio button. The trace square will appear on the graph. (By default, the trace square will appear on the Y1 expression.) Select an arrow button to move the trace square. Left ( ) arrow move the trace square to the left on the selected graph Right ( ) arrow move the trace square to the right on the selected graph Down ( ) arrow move the trace square to the next graphed Y= (e.g., from Y1 to Y2 and from Y2 to Y3) Up ( ) arrow move the trace square to the previous graphed Y= (e.g., from Y2 to Y1 and from Y3 to Y2) Note: When the Xmin, Xmax, Ymin, and Ymax are set to values greater than 5 points from the center, the scale of tick marks will change. For example: If the values are ( 10, 10, 10, 10), then four tick marks for each quadrant will be visible, labeled in units of two (2, 4, 6, 8). The +/- 10 tick marks are the maximum and not labeled. If the values are ( 6, 6, 6, 6), then two tick marks for each quadrant will appear. These are also labeled in units of two (2, 4) and the +/- 6 tick marks are the maximum and not labeled. Other keys include: Zoom In Allows you to zoom in the viewing window Zoom Out Allows you to zoom out the viewing window Reset Clears all graphed expressions TA 72

134 Regression Calculator Available for the following assessments: Mathematics grades 9, 10, and 11 Test Administrator The regression calculator can be used to derive linear, quadratic, exponential, and power equations. Figure 54. Regression Calculator Enter values in the X column and at least one Y column and in at least two rows. Select a function key to derive the desired equation. (Note: Values can be entered in up to four Y columns. Use the internal horizontal scroll bar to access the Y4 column.) Regression Function keys: Linear Displays the equation for the x and y values entered for each Y column in the viewing window Quadratic Displays the equation for the x and y values entered for each Y column in the viewing window Exponential Displays the equation for the x and y values entered for each Y column in the viewing window Power Displays the equation for the x and y values entered for each Y column in the viewing window Clear Clears all x and y values from the regression table TA 73

135 Keyboard Shortcuts for Calculators Test Administrator This section provides information on using keyboard shortcuts to enter calculations and equations. The keyboard shortcuts provided in this section work for all supported operating systems (Windows, Mac OS X, and Linux). The functionality is similar to navigating between elements on a test page. The [Ctrl], [Shift], and arrow keys are used to navigate, and the space bar is used to select a value or variable. To open the calculator in a test environment using keyboard shortcuts: Press the [Ctrl] + [G] keys on the keyboard. This will open the Global Menu. Use the arrow up or down keys to navigate to the calculator tool. Press [Enter] to select and open the calculator. Note: Refer to Appendix E in this user guide for additional information about general keyboard shortcuts in a test. Navigating Within the Calculator Each calculator has several areas, including the display, number keypad, and function keypad (see sample image). You can navigate between each area and within each area using the following shortcut keys. Sample Calculator To navigate between areas: Press [Ctrl] + [Shift] + [ ] OR [ ]. To navigate within an area: Press [Shift] + any arrow key (up, down, left, right). To select a number or function to enter in the display: Press the space bar. The selected value or variable will appear in the display. TA 74

136 Test Administrator About Online Testing and Braille Appendix G. Using Braille with Online Testing Smarter Balanced Pilot Tests are available to students who use Braille. Students who have the Braille accommodation will use the same Student Testing Site as other students, but they will be presented with a Braille-friendly interface. This Braille interface is optimized to allow supported screen reading software and printing of passages and test items to Braille embossers. This appendix provides specific guidance for Test Administrators (TAs) administering Smarter Balanced Pilot Tests to students using the Braille interface. For the Pilot Test administration, the following assessments can be delivered to students with the Braille accommodation: ELA 4, 7, and 11 (Contracted or Uncontracted Braille) Mathematics 3, 7, and 11 (Nemeth Braille) The Braille interface of the Student Testing Site provides the following to students: A text-to-speech component for the ELA and Math assessments listed above. This is consistent with the text-to-speech accommodation. The Job Access with Speech (JAWS) screen reading software provided by Freedom Scientific can be used with the Braille interface. The Math assessments will present students with items in Nemeth Braille via a Braille embosser. The ELA assessments will present students with items in either contracted or uncontracted Literary Braille: Items that contain only text will be sent to a Refreshable Braille Display (RBD). Items that contain text and images that cannot be read by an RBD will be sent to a Braille embosser. Ability to use the Zoom tool. Students who have some vision can use the Zoom buttons on the Braille interface to increase the size of text and graphics. Students may request embossing for any item or reading passage as they progress through the test. District or School Coordinators may also designate a student to receive all items through the Braille embosser instead of through the Refreshable Braille Display as an accommodation based on the student settings specified in TIDE. This accommodation must be set in TIDE prior to the start of a given test opportunity (Refer to the Student Information section of the TIDE ). TA 75

137 Technology Requirements and Configuration Test Administrator Prior to administering assessments using the Braille interface, TAs must ensure that the technical requirements listed below are met. These requirements apply to the student s computer, the Test Administrator s computer, and the supporting Braille technologies used in conjunction with the Braille interface. Requirements for Student Computers The Student Testing Site currently supports the Braille interface on Windows 7 machines only. Windows Secure Browser 6.0 must be installed on all machines used for student testing, including tests administered using the Braille interface. JAWS Screen Reader (version 12 or 13). Braille display that is compatible with Windows 7 and JAWS. We recommend that the Braille display have a minimum of 40 cells. For more information about JAWS, including product download and purchase, go to The following JAWS configuration must be applied to each student computer prior to administering tests using the Braille interface: 1. Configure JAWS to recognize the Secure Browser. 2. Apply settings for Contracted/Uncontracted Braille through JAWS. Instructions for each requirement follows. Configure JAWS to Recognize the Secure Browser 1. Open the JAWS ConfigNames.ini file. This file is accessible via the start menu (/All Programs/JAWS 12.0/Explore JAWS/Explore Shared Settings/). 2. Locate the line of text that contains Chrome=Firefox. Create a line immediately following this text, and add the following string: SBACSecureBrowser6.0=Firefox 3. Save the file upon completion. If you receive an error that you do not have permission to save the.ini file to this location, you will first need to save the file to your desktop as ConfigNames.ini. After saving the updated.ini file, copy it to the folder containing the original.ini file (referenced in Step 1). You will need to confirm that you want to replace the original file with the file you created. TA 76

138 Applying Settings for Contracted/Uncontracted Braille Test Administrator In order for students to use Contracted or Uncontracted Literary Braille, the correct JAWS setting must be applied prior to launching the secure browser. 1. Open the JAWS Settings Center. The Settings Center is accessible via the JAWS Menu > Utilities. 2. Select Firefox from the Application drop-down menu. 3. From the panel on the left side of the window, go to the following option (as pictured): Braille > General > Translation > Contracted Braille Translation 4. For Uncontracted Braille, set the value to Off. For Contracted Braille, set the value to Input and Output. Additionally, ensure that the following three settings are checked (and only these settings are checked): Active cursor follows Braille display Enable Braille Auto Detection Enable Word Wrap 5. Click [Apply] and then click [OK]. In addition, the following optional JAWS settings may be adjusted for individual students based on student needs prior to administering their assessments. Adjust JAWS voice profile (Optional) Adjust JAWS speaking speed (Optional) Adjust JAWS punctuation (Optional) Instructions for each option follows. If adjusting these optional settings for a student, the steps described for each option must be taken prior to launching the secure browser. TA 77

139 Adjusting JAWS Voice Profile Test Administrator The JAWS voice profile refers to the voice used by JAWS. Users can adjust the JAWS voice profile by following the instructions below. 1. Go to JAWS Menu > Options. 2. Select Voices > Adjustment. 3. In the Profile section, select a Voice Profile from the Name drop-down menu. 4. Click [OK]. Adjusting JAWS Speaking Rate Users can adjust the rate of speed that JAWS speaks by following the instructions below. 1. Go to JAWS Menu > Options. 2. Select Voices > Adjustment. 3. In the Voice section, adjust the Rate using the slide-bar. 4. Click [OK]. Adjusting JAWS Punctuation The default JAWS punctuation setting for which the Braille Interface has been optimized is Most. This means that JAWS will read most punctuation that appears on the screen. However, users may adjust the JAWS punctuation based on an individual student s needs and preferences by following the instructions below. 1. Go to JAWS Menu > Options. 2. Select Voices > Adjustment. 3. In the Voice section, select a punctuation setting from the Punctuation drop-down menu. The options include None, Some, Most, and All. 4. Click [OK]. Warning regarding ELA assessments and text-to-speech and JAWS Because the text-to-speech accommodation is not fully approved for use with the ELA assessments (items only), the sound on the student s computer will be automatically muted when the student begins the first question on the Braille form of the ELA assessment. The sound will automatically turn on again when the student submits the ELA assessment or pauses the test and returns to the login screen. Some students may require assistance with JAWS navigation during the reading test because they will not be able to hear the JAWS commands when the sound is muted. JAWS will still output all commands and text to the refreshable Braille display, even with the sound on the computer muted. TA 78

140 Requirements for Test Administrator Computers Test Administrator TAs administering tests to students who require Braille must have the following software installed on their machine prior to testing. The software is necessary to process these students print requests. Tiger Max Embosser and the supporting ViewPlus Desktop Embosser driver The Desktop Embosser Driver can be downloaded from The download includes the Tiger Viewer software, which is needed to handle print requests for items and passages that contain tactile or spatial components. Duxbury Braille Translator 11.1 This software allows printing of items and reading passages (without images) and can be downloaded from For Oregon users: To download the Duxbury Braille Translator software and acquire a license, contact the BVIS fund administrator for the seat license code. Approvals and Student Test Settings for Braille The approval process is the same for tests administered using the Braille interface as for all other Smarter Balanced tests. A student s Braille accommodation must be set in TIDE before he or she can begin testing. This accommodation automatically applies Braille as the default language setting for all of that student s tests. When viewing students before approving them for testing, TAs should verify that students who require Braille have the following settings established: Language: Braille Braille Type: Nemeth (mathematics) or Contracted/Uncontracted (ELA) Emboss Request Type: Auto-Request (mathematics) or Stimuli & Items (ELA) For ELA assessments, students can request printing for individual passages and items as they go through the test. For math assessments, the test will automatically be delivered to the embosser. Figure 55. TA Interface: Test Settings for Student with Braille TA 79

141 Student Print Requests Test Administrator The embossed output for student print requests will vary depending on the type of file associated with a test item. There are two types of files: PRN files: Print requests containing tactile or spatial components such as images and diagrams. This file type is handled by the Tiger Viewer software. BRF files: Print requests for items containing only text, including formatted tables and poems. This file type is handled by the Duxbury Braille Translator software. Approving Print Requests Print requests will display on the TA Interface and must be approved by the TA in order to be embossed. Print requests will be sent automatically to the TA for Mathematics assessments items, as well as for ELA items that include graphics or other material that cannot be presented through the Refreshable Braille Display. For other ELA items, students must manually request embossing. To maintain the security of printed test materials, all print requests are sent to the TA for approval, whether sent automatically to the TA or initiated by the student. Caution: Printed materials are secure test information. Any printouts must be securely stored and then destroyed when no longer needed. Figure 56. TA Interface: Student Print Request(s) Screen Upon approving a print request, the TA must send the file to the embosser using either the Duxbury (for BRF files) or ViewPlus (for PRN files) software. The following section provides steps for embossing both types of files. TA 80

142 Configuring Default Printing Preferences on the TA Computer Test Administrator This section provides instructions to configure the software used to print each file type (BRF or PRN): BRF Files with the Duxbury Braille Translator Software 1. Click the Sample BRF File from the TA Interface Help Menu. 2. The File Download window displays and prompts the user to Open, Save, or Cancel the request. 3. Select Open. This will open a program selection window. 4. Select the radio button to Select a Program from a list of installed programs. Click [OK]. 5. Navigate to the Duxbury program and click Open. This will add this program in the program selection list. 6. Make sure to check the checkbox next to Always use the selected program to open this kind of file. 7. Click [OK]. This will open the BRF file. 8. You can now emboss this file by going in to Duxbury-Document option-embosser setup. Select the ViewPlus Tiger Max embosser from the drop-down list. Prior to continuing, you will need to adjust the margins. Change the Top Margin to 2. Change the Binding Margin to 5. Click [OK]. TA 81

143 Test Administrator 9. Go to the file menu and select the Emboss option. This will bring up File-Emboss window. 10. Click [OK]. TA 82

144 Test Administrator PRN Files with the Tiger View Software 1. Click the Sample PRN File from the TA Interface Help. 2. The File Download window displays and prompts the user to Open, Save, or Cancel the request. 3. Select Open. This will open a program selection window. 4. Select the radio button to Select a Program from a list of installed programs. Click [OK]. 5. Navigate to the Tiger Viewer program and click Open. This will add this program in the program selection list. 6. Make sure to check the checkbox next to Always use the selected program to open this kind of file. 7. Click [OK]. This will open the PRN file. 8. The file can now be printed by going to the Tiger Viewer-File menu and selecting the Print option. This will bring up the Print current PRN File window. 9. Select the ViewPlus Tiger Max embosser from the drop-down listing. 10. Click [Print]. TA 83