C A L I F ORN I A. Assessment of Student Performance and Progress. Test Operations Management System:

Transcription

1 C A L I F ORN I A Assessment of Student Performance and Progress Test Operations Management System: Winter/Spring 2015 Smarter Balanced Summative Assessments Smarter Balanced Interim Assessments Updated March 20, 2015 Published 18, 2014 Prepared by the Educational Testing Service

2 Contact Information California Technical Assistance Center 2731 Systron Drive Concord, CA Phone: Fax: Web site:

3

4 Table of Contents CAASPP System Introduction... 1 Assigning Student Test Settings... 1 Update Settings by Uploading a Template... 2 Update Settings One by One... 2 TOMS Requirements... 2 About This Manual... 2 Using the ISAAP Tool to Assign Test Settings... 3 Background... 3 About the ISAAP Tool... 3 About the ISAAP Excel File... 3 ISAAP Tool Components... 3 How to Assign Accessibility Resources in the ISAAP Tool... 4 Using an Excel Template to Assign Test Settings... 9 How to Assign Accessibility Resources in the Excel Template... 9 Reviewing and Updating Online Student Test Settings One by One How to View a Student Profile How to Update or Configure Settings in the Student Profile Appendix A Online Student Test Settings File Specifications Change Log... 1 File Specifications... 1 Acronyms and Initialisms Used in the TOMS Online Student Test Settings User Guide CAASPP CALPADS CalTAC CDE ELA ET IEP ISAAP LEA PT RLA SC SSID TA TOMS UAAG California Assessment of Student Performance and Progress California Longitudinal Pupil Achievement Data System California Technical Assistance Center California Department of Education English language arts/literacy extended time individualized education program Individual Student Assessment Accessibility Profile local educational agency performance task reading/language arts CAASPP Test Site Coordinator Statewide Student Identifier Test Administrator Test Operations Management System Smarter Balanced Usability, Accessibility, and Accommodations Guidelines i

5

6 Introduction Introduction The Test Operations Management System (TOMS) is a secure site that permits local educational agency (LEA) California Assessment of Student Performance and Progress (CAASPP) Coordinators to perform a number of tasks for the CAASPP System, which comprises the Smarter Balanced online summative assessments, the remaining paper-pencil tests in science, and the remaining paper-pencil primary language tests in reading/language arts (RLA). LEA CAASPP Coordinators will be able to perform the following tasks in TOMS: Manage the LEA s testing windows; Verify contact and address information, including delivery and addresses Indicate which students are taking which science and/or RLA paper-pencil tests Configure online student test settings (accommodations, designated s) Review orders for paper-pencil test materials Enter and manage CAASPP Test Site Coordinator (SC) and Test Administrator (TA) access to TOMS Assigning Student Test Settings The Smarter Balanced assessment system uses technology to deliver assessments that fit the needs of individual students. Student data from the California Pupil Achievement Data System (CALPADS) are uploaded into TOMS so LEA CAASPP Coordinators and CAASPP Test Site Coordinators can manage their CAASPP administrations. A variety of accessibility tools and accommodations for the online Smarter Balanced assessments can be delivered to students automatically based on their profile configured in TOMS. For information about the available accessibility tools and accommodations for the CAASPP assessments, please refer to Matrix One: Universal Tools, Designated Supports, and Accommodations for the CAASPP System which is linked on the California Department of Education (CDE) Student Accessibility Supports Web page at For details of recommended use of each universal tool, designated, and accommodation, refer to the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines which are linked on the CAASPP Instructions and Manuals Web page at instructions/. Configuring online student test settings in TOMS ensures that students receive the assigned accessibility s for the online Smarter Balanced assessments. There are two methods LEA CAASPP Coordinators and CAASPP Test Site Coordinators can use to set embedded and non-embedded designated s and accommodations for students in TOMS: 1. Spreadsheet upload 2. One by one Print-on-demand for stimuli only can be set through file upload or configured using the TOMS interface. Print-on-demand that includes items (either items only or items with stimuli) must be set by contacting the CDE. Stacked translations for mathematics items and turning off universal tools must be set in the test delivery system only. These s cannot be set in TOMS or the upload file. When setting a language, select Filipino for students requiring Ilokano and Tagalog glossaries. These students can subsequently select the Filipino glossary in the test delivery system and receive each of the available translations in the Tagal family of languages. Updated February TOMS Online Student Test Setting User Guide 1

7 Introduction Update Settings by Uploading a Template LEA CAASPP Coordinators and CAASPP Test Site Coordinators can use the California version of the Smarter Balanced Individual Student Assessment Accessibility Profile (ISAAP) Tool to facilitate the decision-making process for assigning accessibility s to students. The ISAAP Tool is a spreadsheet with specially designed formulas that facilitate selection of the designated s and accommodations that match student access needs for the Smarter Balanced assessments. 1 The ISAAP tool can be used to produce an online student test settings file that can be uploaded to TOMS. Use the CAASPP ISAAP Tool that is available on to assign designated s and accommodations to students. Do NOT use the version available on the Smarter Balanced Web site. LEA CAASPP Coordinators and CAASPP Test Site Coordinators can, alternatively, download a spreadsheet template from the TOMS Web page at or from TOMS itself, enter data, and upload the completed online student test settings assignment file into TOMS. Update Settings One by One LEA CAASPP Coordinators and CAASPP Test Site Coordinators can manually configure or edit the online settings in a Student Profile in TOMS. TOMS Requirements TOMS s the following Web browsers: Internet Explorer 9 and above Mozilla Firefox 2.0 and above Google Chrome 4.0 and above Safari 3.0 and above Google Android (all) ipad Safari (all) System functionality and screen displays may operate or appear differently due to different browser and operating system capabilities. The TOMS Web site is optimal when viewed using a resolution of 1280 x Please note that, because of the nature of multi-tab/window functionality, only one session of any module of the TOMS should be open for editing at one time. Data records may become inaccurate if, for example, one set of dates are updated from one open browser tab or window and another set of dates are updated from another open browser tab or window. About This Manual 1. Web site users may notice slight differences between what is displayed on the Web page and what is shown in this manual due to individual browser versions, monitor resolution, PC configuration, etc. 2. Data displayed on the Web pages or forms shown as examples in this manual are for demonstration purposes only. 3. Web pages may appear slightly different under Macintosh, using various versions of Windows, or because of differences in browsers or browser versions. 1 Smarter Balanced, Individual Student Assessment Accessibility Profile (ISAAP), retrieved November 14, 2014, from TOMS Online Student Test Settings User Guide Updated February 2015

8 Using the ISAAP Tool to Assign Test Settings Using the ISAAP Tool to Assign Test Settings Background About the ISAAP Tool Information in this section was adapted from the Smarter Balanced, Individual Student Assessment Accessibility Profile (ISAAP) Web document at Smarter Balanced developed the Individual Student Assessment Accessibility Profile (ISAAP) Tool to facilitate selection of the accessibility resources that match student access needs for the Smarter Balanced assessments, as ed by the UAAG. The ISAAP Tool should be used in conjunction with the UAAG as well as with state regulations and policies (see Matrix One) related to assessment accessibility as a part of the ISAAP process. LEA personnel, including individualized education program (IEP) and Section 504 plan teams, can use the ISAAP tool to facilitate the selection of designated s and accommodations a student will need for the online Smarter Balanced assessments. Instructions for downloading the ISAAP Tool and creating an upload file from the tool are included in the Assign Accessibility Resources in the ISAAP Tool section of this user guide. About the ISAAP Excel File The ISAAP Tool is a macros-enabled Excel workbook enriched with formulas that assist in setting ISAAP profiles for 15 students at a time and is compatible with any version of Microsoft Excel from 2010 to the most recent version. When opening the file, choose Enable this content or other enabling prompt to view the recommended use language included for the different resources. You also will need to enable macros. The ISAAP Tool file is locked to prevent errant changes to the formulas that determine the functionality of the ISAAP Tool. While you may change the naming convention of the file when using the Save As function, the file must be saved in.xlsm format saving to another Excel file format, such as.xls or xlsx, may result in corrupting or disabling many of the functionalities and features of the ISAAP Tool. The ISAAP Tool can be downloaded from the TOMS Web page at ISAAP Tool Components The following are the worksheet tabs found in the ISAAP Tool: [About] tab Description of the ISAAP Process and ISAAP Tool [Instructions] tab Instructions for using the CAASPP ISAAP tool 15 individual [Student #] tabs Facilitate creation of and store data for up to 15 ISAAPs [Report] tab A spreadsheet of the student data entered Updated February TOMS Online Student Test Setting User Guide 3

9 How to Assign Accessibility Resources in the ISAAP Tool Step 1. Download the ISAAP Tool. 1. Go to the TOMS Web page at Using the ISAAP Tool to Assign Test Settings 2. Select the linked file name with your right mouse button. 3. Select the download option from the pop-up menu. Step 2. Enter student information and accessibility settings in the ISAAP Tool. 1. Select a [Student #] tab and fill in the student information in the fields in rows 3 and 5 as shown in Figure 1. Figure 1. Sample student information Field names are as follows: Student Last Name Student First Name SSID (consistent with TOMS) Teacher of Record Grade School (ID or Name) Educator(s) Completing ISAAP Comments Notes: Statewide Student Identifiers (SSIDs) are required to create an upload file for TOMS. These fields are optional, but recommended, for LEA reference. The Comments field may be used for various purposes as determined by the school site (e.g., for directions to Test Administrator or other school procedure) TOMS Online Student Test Settings User Guide Updated February 2015

10 Using the ISAAP Tool to Assign Test Settings 2. In column B, Student Need(s), which starts at row 18 and is shown in Figure 2, select all values that apply. Figure 2. Set Student Need information For each, a specific set of recommended designated s will be populated in column D. Choices are as follows: Support for executive functioning: attention, cognition control, and processing Support for persistent calculation disability, dyscalculia Support for reading-related disabilities, print disabilities, struggling readers Support for students needing access in language(s) of translation Support for significant motor difficulties and recent injury Support for vision impairments/blind Support for hard-of-hearing/deafness 3. Next, select the Identification of Student Need(s) in column C (e.g., Individualized Education Program, 504 Plan, Educator(s) Recommendation, or some combination of these). This column signifies the documentation that is provided for the student access need. If one of the values is Individualized Education Program or 504 Plan, the ISAAP Tool will also populate recommended Accommodations in column F. Updated February TOMS Online Student Test Setting User Guide 5

11 Using the ISAAP Tool to Assign Test Settings To ensure student s unique access needs are met, please also review all available accessibility s in the CDE s Matrix One. 4. To select a or accommodation, find the row with the required designated or accommodation and select the corresponding cell in column E (Select Designated Supports) or column G (Accommodations), shown in Figure 3. Select from the items in the drop-down list. Figure 3. Selecting designated s and accommodations 5. Designated s and accommodations that also require separate settings or extra time are marked with an asterisk (*); the specific recommendation appears above column D when the value is in column E. Select the recommended value (separate setting or extra time) in column E to implement the recommendation. 6. To learn more about suggested options, hover over the red corner of each cell to read recommended use language from the UAAG. 7. Download a new ISAAP Tool and enter information for additional batches of 15 students. Repeat the process as needed. All embedded and non-embedded designated s and accommodations may be assigned through the ISAAP Tool. However, turning off a universal tool or stacked translation must be done through the test delivery system, not TOMS TOMS Online Student Test Settings User Guide Updated February 2015

12 Using the ISAAP Tool to Assign Test Settings Step 3. Create an upload file in the [Report] tab. The [Report] tab, which is located in the rightmost tab position in the ISAAP Tool, compiles all of the selections from the [Student #] tabs up to 15 into one comprehensive spreadsheet so users may view all students accessibility profile data in a single view. 1. Enable macros in the file. a b c Figure 4. [Options] button Figure 5. Security Options alert box a. Select the [Options] button between the worksheet and the tool Ribbon (shown in Figure 4). b. Select the Enable this content radio button in the Security Options alert box, shown in Figure 5. c. Select [OK] to enable macros (or [Cancel] to cancel). 2. If you will require more than 15 student tabs, you may create multiple files by using the following procedure and then completing step 3. Save your completed ISAAP file using the following parameters: File type is Excel Macro-Enabled Workbook with an.xlsm file extension. Include isaap in the filename; this will help the ISAAP Tool identify all of your ISAAP files and consolidate the student data when you are done. Save all ISAAP files into the same directory. 3. Take the following steps to consolidate multiple ISAAP files to create a single upload file for TOMS: a. Open any saved ISAAP file from the directory. b. Open the worksheet in the [Report] tab. c. Select the [Select this button to produce a Smarter Balanced accommodations upload file for TOMS.] button at the top of the worksheet and is shown in Figure 6. d. Select [Yes] at the prompt. This will create a single online student test settings file that can be uploaded Figure 6. Button to create a file to TOMS to assign designated s and accommodations for students for online testing. 4. Save the student test settings file that was created as a.csv file using the File > Save As option in Excel. Updated February TOMS Online Student Test Setting User Guide 7

13 Using the ISAAP Tool to Assign Test Settings Step 4. Upload the student test settings assignment file into TOMS. 1. Select the [Students] button in the left navigation bar. 2. Select the [Online Test Settings] button. 3. Upload your completed.csv file. a. Select the [Browse] button. b. Locate and select the file. c. Confirm that the correct file is, and then select [Upload] to upload your LEA s online student test settings assignment file into TOMS. Step 5. Check the status of an uploaded file 1. Select the [Students] button in the left navigation bar. 2. Select the [Online Test Settings] button in the left navigation bar. 3. Look for the file in the Uploaded Files section (labeled Step 4 in Figure 7). Data shown are as follows: # Row number of the file in the Uploaded Files section Date Date the file was uploaded Filename Name given to the file by the LEA CAASPP or CAASPP Test Site Coordinator Status Status of the file; statuses are: Icon Icon name Description [Processing] A file upload is in process. [Complete] A file upload was successful. Uploads Errors Actions [Processing Error] A file upload failed. Number of students (spreadsheet rows) successfully updated Number of students/rows with data errors (Select the link for more details on the errors.) Available actions that can be taken; actions are: Icon Icon name Description [Delete File] Delete the uploaded file. [Download Errors] Download the report of file errors. 4. If the file upload failed (that is, if you see the [Processing Error] icon in the Status column), the cause could be invalid data in the spreadsheet. a. Validate the file against the file specifications in Appendix A, fix the data in error, and try again. b. If the error persists, CAASPP Test Site Coordinators should contact their LEA CAASPP Coordinators, and LEA CAASPP Coordinators should contact the California Technical Assistance Center (CalTAC) for. 5. If your upload was successful but there are errors in the file (that is, if you see the [Download Errors] icon), select this icon to download a.csv file of errors in the file. a. Fix the file according to the generated error. b. Validate the file against the file specifications in Appendix A and try again. c. If the error persists, CAASPP Test Site Coordinators should contact their LEA CAASPP Coordinators, and LEA CAASPP Coordinators should contact CalTAC for TOMS Online Student Test Settings User Guide Updated February 2015

14 Using an Excel Template to Assign Test Settings Using an Excel Template to Assign Test Settings Student data from CALPADS are uploaded into TOMS so LEA CAASPP Coordinators and/or CAASPP Test Site Coordinators can manage their CAASPP administrations. Use TOMS to set embedded and non-embedded designated s and accommodations for students. The online student test settings template is available to download from the TOMS Web page at as well as the Upload Online Student Test Settings Web form itself in TOMS. Use the template when you do not require the assistance of the ISAAP Tool to identify required designated s and accommodations. The file that is submitted should be in.csv format. LEAs can submit more than one file. Use SSIDs to configure online test settings in the file for students in your LEA. Use the specifications in Appendix A for each test setting in the appropriate fields when you create your file. The completed file is converted to a.csv file and then uploaded to TOMS. You may upload as many files as you wish. SSIDs in the online student test settings file are matched with CALPADS data that have been imported into TOMS. Previously assigned test settings will be overridden if the student s data are included with a newly uploaded online student test settings file. Step 1 Step 4 Step 3 Figure 7. Upload Student Test Assignments Web form How to Assign Accessibility Resources in the Excel Template Take the following steps to create your online student test settings file using the form shown in Figure 7. Step 1. Download the online student test settings template. 1. Open an Internet browser. 2. Open TOMS by going to and selecting the [Test Operations Management System] button to access the TOMS Sign In Web form. 3. When you have logged on and TOMS has opened, select the [Students] button in the left navigation bar. 4. Select the [Online Test Settings] button. Updated February TOMS Online Student Test Setting User Guide 9

15 Using an Excel Template to Assign Test Settings 5. On the Upload Online Student Test Settings Web form (shown in Figure 7), select the [Download Spreadsheet Template] link to download the Excel template. or 6. Download the test settings Excel template from Step 2. Create and save your LEA s online student test settings. 1. Open the template and enter data: Student SSID (mandatory; consistent with TOMS) Values, listed in Appendix A, to enable designated s or accommodations 2. Repeat for additional students. 3. When you are finished, save as a.csv file using the File > Save As option in Excel. Step 3. Upload the student test settings assignment file into TOMS. 1. Select the [Students] button in the left navigation bar. 2. Select the [Online Test Settings] button. 3. Upload your completed.csv file. a. Select the [Browse] button. b. Locate and select the file. c. Confirm that the correct file is, and then select [Upload] to upload your LEA s online student test settings assignment file into TOMS. Step 4. Check the status of an uploaded file 1. Select the [Students] button in the left navigation bar. 2. Select the [Online Test Settings] button in the left navigation bar. 3. Look for the file in the Uploaded Files section (Figure 7). Data shown are as follows: # Row number of the file in the Uploaded Files section Date Date the file was uploaded Filename Name given to the file by the LEA CAASPP or CAASPP Test Site Coordinator Status Status of the file; statuses are: Icon Icon name Description [Processing] A file upload is in process. [Complete] A file upload was successful. Uploads Errors Actions [Processing Error] A file upload failed. Number of students (spreadsheet rows) successfully updated Number of students/rows with data errors (Select the link for more details on the errors.) Available actions that can be taken; actions are: Icon Icon name Description [Delete File] Delete the uploaded file. [Download Errors] Download the report of file errors. 4. If the file upload failed (that is, if you see the [Processing Error] icon in the Status column), the cause could be invalid data in the spreadsheet. a. Validate the file against the file specifications in Appendix A, fix the data in error, and try again. b. If the error persists, CAASPP Test Site Coordinators should contact their LEA CAASPP TOMS Online Student Test Settings User Guide Updated February 2015

16 Using an Excel Template to Assign Test Settings Coordinators, and LEA CAASPP Coordinators should contact CalTAC for. 5. If your upload was successful but there are errors in the file (that is, if you see the [Download Errors] icon), select this icon to download a.csv file of errors in the file. a. Fix the file according to the generated error. b. Validate the file against the file specifications in Appendix A and try again. c. If the error persists, CAASPP Test Site Coordinators should contact their LEA CAASPP Coordinators, and LEA CAASPP Coordinators should contact the CalTAC for. Updated February TOMS Online Student Test Setting User Guide 11

17 Reviewing and Updating Online Student Test Settings One by One Reviewing and Updating Online Student Test Settings One by One In the View & Edit section of the Students area, you can search, view, and edit, individual student data. In this way you can also submit student test settings individually. How to View a Student Profile 1. Select the [Students] button in the left navigation bar (or, if the Students section is already active, select the [Search] button). Figure 8. Search for Students Web form 2. Enter details about the student in the search fields in the Search for Students Web form (shown in Figure 8); or 3. Select the LEA(s) the user is associated with by selecting the [Select Organization] link. a. To pull up all students in an associated organization, do not specify any search criteria. b. To view students from a particular school, enter the first part of the school s name; select the school from the drop-down list that appears. 4. Select the [Search] button. Check your CALPADS student records if students are not listed TOMS Online Student Test Settings User Guide Updated February 2015

18 Reviewing and Updating Online Student Test Settings One by One Figure 9. Student search results 5. Select a magnifying glass [View] icon shown in Figure 9 to access the Student Profile screen in Figure 10. The Student Profile opens with the [Demographics] tab. Note that student demographic data were imported from CALPADS and cannot be edited in TOMS. Any change to student demographic data must be made in CALPADS. 6. Use the [Back] button to return to the Search screen. How to Update or Configure Settings in the Student Profile 1. Search for a student using the instructions in the previous subsection, How to View a Student Profile. 2. Select the [Test Mode] tab to see the tests a student will take; select the [Update] button to save any changes made. 3. Select the [Test Settings] tab, shown in Figure 10, to view and edit the student s online test settings (designated s and accommodations). Updated February TOMS Online Student Test Setting User Guide 13

19 Reviewing and Updating Online Student Test Settings One by One Figure 10. Student Profile Test Settings 4. Configure or update the student s online test settings by selecting the appropriate settings in the drop-down menus or radio buttons. 5. Select [Update] to save changes TOMS Online Student Test Settings User Guide Updated February 2015

20 Appendix A Online Student Test Settings File Specifications Appendix A Online Student Test Settings File Specifications Stacked translations for mathematics items and turning off universal tools must be set in the test delivery system only. These s cannot be set in TOMS or the upload file. These specifications provide more information about the values in the Excel spreadsheet template. For more information about each universal tool, designated, and accommodations refer to the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines, which are linked on the caaspp.org Instructions and Manuals Web page at Col Display Name Value Value Definition Test TOMS Type Setting Definition Type A Student SSID 10 digits all numeric State-assigned student identifier which is unique within that state. Every student should have a unique SSID. B Abacus Blank (default) Abacus is not This tool may be used in place of scratch paper for NEA_Abacus Abacus is students who typically use an abacus. C Alternate Response Blank (default) Alternate Response is Options (including any not external devices/ assistive technologies) D American Sign Language for ELA Listening and Math Items NEA_AR Blank (default) TDS_ASL0 TDS_ASL1 Alternate Response is Do not show ASL videos Do not show ASL videos Show ASL videos: Alternate response options include but are not limited to adapted keyboards, large keyboards, StickyKeys, MouseKeys, FilterKeys, adapted mouse, touch screen, head wand, and switches. Test content is translated into ASL video. An ASL human signer and the signed test content are viewed on the same screen. non-embedded accommodation non-embedded accommodation embedded accommodation Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) Updated February TOMS Online Student Test Setting User Guide 15

21 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type E Bilingual Dictionary for Blank (default) Bilingual Dictionary is ELA Full Writes (ET) not NEDS_BD Bilingual Dictionary is F Language ENU (default) English ENU-Braille Braille ESN Spanish (Math only) G Calculator Blank (default) Calculator is not H Closed Captioning for ELA Listening Items NEA_Calc Blank (default) TDS_ClosedCap0 TDS_ClosedCap1 Calculator is Closed Captioning not available Closed Captioning not available Closed Captioning available drop-down A bilingual/dual-language word-to-word dictionary is a language. All tests are presented in English. Students who qualify for a Spanish language translation will view items in both English and Spanish (stacked format). Students who require tests in braille should have the braille option. A calculator can be accessed for calculatorallowed items. The student may use the calculator offered with assistive technology devices (such as a talking calculator or a braille calculator). Printed text that appears on the computer screen as audio materials are presented. non-embedded designated embedded accommodation non-embedded accommodation embedded accommodation Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) TOMS Online Student Test Settings User Guide Updated February 2015

22 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type I Color Contrast (EMBEDDED) Blank (default) Color Contrast is not drop-down TDS_CC0 TDS_CCInvert TDS_CCMagenta TDS_CCMedGrayLt Gray TDS_CCYellowB Black on White Reverse Contrast Black on Rose Medium Gray on Light Gray Yellow on Blue By default, tests are presented with black text on a white background. Students who require a different combination of text and background should be assigned the appropriate setting. embedded designated J Color Contrast (NON- EMBEDDED) Blank (default) NEDS_CC Color Contrast is not Color Contrast is K Color Overlays Blank (default) Color Overlays is not NEDS_CO Color Overlays is L Magnification Blank (default) Magnification is not NEDS_Mag Magnification is M Masking Blank (default) Masking is not TDS_Masking1 TDS_Masking0 Masking is available Masking is not available N Multiplication Table Blank (default) Multiplication Table is not NEA_MT Multiplication Table is Test content of online items may be printed with different colors. Color transparencies are placed over a paper-based assessment. The size of specific areas of the screen (e.g., text, formulas, tables, graphics, and navigation buttons) may be adjusted by the student with an assistive technology device. Masking involves blocking off content that is not of immediate need or that may be distracting to the student. Students are able to focus their attention on a specific part of a test item by masking. A paper-based single-digit (1 9) multiplication table. non-embedded designated non-embedded designated non-embedded designated embedded designated non-embedded accommodation Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) Updated February TOMS Online Student Test Setting User Guide 17

23 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type O Noise Buffers Blank (default) Noise Buffers is not NEA_NoiseBuf Noise Buffers is P Print On Demand Blank (default) Print on Demand is not TDS_PoD0 TDS_PoD_Stim None Stimuli drop-down Ear mufflers, white noise, and/or other equipment used to block external sounds. Print-on-demand for test stimuli and items, stimuli only, or items only must be set by contacting CalTAC. Configuring this accommodation in the upload file will not automatically activate it for the assigned student. All requests must be approved by CalTAC and the CDE. non-embedded designated non-embedded accommodation Q Read Aloud for ELA Blank (default) Read Aloud for ELA is not NEA_RA_Stimuli Read Aloud for ELA is Text is read aloud to the student by a trained and qualified human reader who follows the administration guidelines provided in the Smarter Balanced Test Administration Manual. All or portions of the content may be read aloud. non-embedded accommodation R Read Aloud (for Math and ELA Items) (NON- EMBEDDED) Blank (default) NEDS_RA_Items Read Aloud for Math and ELA Items is not Read Aloud for Math and ELA Items is Text is read aloud to the student via embedded text-tospeech technology or by a trained and qualified human reader. The student is able to control the speed as well as raise or lower the volume of the voice via a volume control. non-embedded designated Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) TOMS Online Student Test Settings User Guide Updated February 2015

24 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type S Scribe Blank (default) Scribe is not T Scribe (for ELA nonwriting items and Math items) NEA_SC_WritItem s (ELA only) Blank (default) NEDS_SC_Items Scribe is Scribe for items is not Scribe for items is U Separate Setting Blank (default) Separate Setting is not NEDS_SS Separate Setting is V Speech-to-text Blank (default) Speech-to-text is not NEA_STT Speech-to-text is Students dictate their responses to a human who records verbatim what they dictate. The scribe must be trained and qualified, and must follow the administration guidelines provided in the Smarter Balanced Test Administration Manual. Students dictate their responses to a human who records verbatim what they dictate. The scribe must be trained and qualified, and must follow the administration guidelines provided in the Smarter Balanced Test Administration Manual. The test location is altered so that the student is tested in a setting different from that made available for most students. Voice recognition allows students to use their voices as input devices to the computer, to dictate responses or give commands (e.g., opening application programs, pulling down menus, and saving work). Voice recognition software generally can recognize speech up to 160 words per minute. Students may use their own assistive technology devices. non-embedded accommodation non-embedded designated non-embedded designated non-embedded accommodation Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) Updated February TOMS Online Student Test Setting User Guide 19

25 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type W Text-to-speech for Blank (default) Text-to-speech for ELA drop-down ELA Reading reading passages is Passages Grades 6 8 not and 11 TDS_TTS0 None X Y Z Text-to-speech for Math and ELA items Translated Test Directions Translated Test Directions for Math Items TDS_TTS_Item TDS_TTS_Stim TDS_TTS_Stim&TD S_TTS_Item Blank (default) TDS_TTS0 TDS_TTS_Item TDS_TTS_Stim&TD S_TTS_Item TDS_TTS_ALL Blank (default) NEDS_TransDirs Blank (default) NEDS_TransDirs Items Passages Passages and Items Text-to-speech for math and ELA items is not None Items (ELA) Stimuli and Items (Math) Items (ELA) AND Stimuli and Items (Math) Translated Test Directions is not Translated Test Directions is Translated Test Directions for Math Items is not Translated Test Directions for Math Items is Mathematics drop-down Text is read aloud to the student via embedded text-tospeech technology. The student is able to control the speed as well as raise or lower the volume of the voice via a volume control. Text is read aloud to the student via embedded text-tospeech technology. The student is able to control the speed as well as raise or lower the volume of the voice via a volume control. PDF of directions translated in each of the languages currently ed. A bilingual adult can read to student. Translation of test directions is a language available prior to beginning the actual test items. Students can see test directions in another language. embedded accommodation embedded designated non-embedded designated embedded designated Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) TOMS Online Student Test Settings User Guide Updated February 2015

26 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type AA Translation Glossaries Blank (default) Translation Glossaries drop-down Sets student s glossary for Math Items (ET) for math is not accommodation. Students (EMBEDDED) TDS_WL_Glossary English can open a glossary to view TDS_WL_ArabicGl Arabic terms presented on the test oss that may be unfamiliar to TDS_WL_Cantones Cantonese them. egloss By design, all students can TDS_WL_ESNGloss Spanish access the English glossary ary word list as a universal tool, TDS_WL_KoreanGl Korean unless this is disabled oss ( None ) or overridden by TDS_WL_Mandarin Mandarin another language. Gloss If a combination glossary is TDS_WL_PunjabiG Punjabi (e.g., English and loss Arabic or English and TDS_WL_RussianG Russian Russian), then the student loss will have access to both. TDS_WL_TagalGlo Filipino If a single glossary is ss (e.g., Mandarin), TDS_WL_Ukrainia Ukrainian then the student will only ngloss have access to that TDS_WL_Vietname glossary. The English Vietnamese segloss glossary will not be available. TDS_WL_ArabicGl Arabic & English oss&tds_wl_glos Select Filipino for students sary requiring Ilokano and TDS_WL_Cantones Cantonese & English Tagalog glossaries. These egloss&tds_wl_g students can subsequently lossary select the Filipino glossary TDS_WL_ESNGloss Spanish & English in the TDS and receive ary&tds_wl_glos each of the available sary translations in the Tagal family of languages. TDS_WL_KoreanGl oss&tds_wl_glos sary Korean & English embedded designated Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) Updated February TOMS Online Student Test Setting User Guide 21

27 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type AB Translation Glossaries for Math Items (ET) (NON-EMBEDDED) TDS_WL_Mandarin Gloss&TDS_WL_Gl ossary TDS_WL_PunjabiG loss&tds_wl_glo ssary TDS_WL_RussianG loss&tds_wl_glo ssary TDS_WL_TagalGlo ss&tds_wl_gloss ary TDS_WL_Ukrainia ngloss&tds_wl_g lossary TDS_WL_Vietname segloss&tds_wl_ Glossary TDS_WL0 Blank (default) Mandarin & English Punjabi & English Note: The English glossary is available for both ELA and mathematics tests. Translated glossaries are available for mathematics tests only. Russian & English Filipino & English Ukrainian & English Vietnamese & English None NEDS_TCantonese Cantonese NEDS_TSpanish NEDS_TKorean NEDS_TMandarin NEDS_TPunjabi Translation Glossaries for math items is not Spanish Korean Mandarin Punjabi drop-down Translated glossaries are a language. Translated glossaries are provided for construct-irrelevant terms for math. Glossary terms are listed by item and include the English term and its translated equivalent. non-embedded designated Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) TOMS Online Student Test Settings User Guide Updated February 2015

28 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type NEDS_TFilipino Filipino Select Filipino for students NEDS_TUkrainian Ukrainian NEDS_TVietnamese Vietnamese requiring Ilokano and Tagalog glossaries. These students can subsequently NEDS_TRussian Russian select the Filipino glossary in the TDS and receive NEDS_TArabic Arabic each of the available English English translations in the Tagal family of languages. NEDS0 None AC Permissive Mode TDS_PM0 (default) Permissive Mode disabled AD Print Size TDS_PM1 TDS_PS_L0 (default) TDS_PS_L1 1.5X TDS_PS_L2 1.75X TDS_PS_L3 2.5X TDS_PS_L4 Permissive Mode enabled No default zoom applied 3X drop-down Permissive mode should be enabled for students who require access to accessibility software in order to interact with the test (e.g., screen readers, magnifiers, etc.). When permissive mode is disabled, the only application that can be open on the computer is the secure browser. Sets student s print size accommodation. This is the print size the student should have when starting a test. The print size becomes the default for all items in that student s test. The default print size for all tests is 14 pt. The default font for ELA tests is Times New Roman. The default font for mathematics tests is Verdana. embedded designated embedded designated Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) Updated February TOMS Online Student Test Setting User Guide 23

29 Appendix A Online Student Test Settings File Specifications Col Display Name Value Value Definition Test TOMS Type Setting Definition Type AE Streamlined Interface TDS_SLM0 (default) Standard AF Special Lighting or acoustics (NON- EMBEDDED) Designated Supports AG Translated Test Directions for Math (Non-Embedded) Designated Supports AH Individualized Aids (Non-Embedded) Accommodation TDS_SLM1 Y N (default) Y N (default) Y N (default) Streamlined Special Lighting or acoustics is Special Lighting or acoustics is not Translated Test Directions for Math is Translated Test Directions for Math is not Individualized Aids is Individualized Aids is not By default, all tests use the standard interface. This interface is compatible with all ed desktops and tablets. The streamlined interface presents the test in an alternate, simplified format in which the items are displayed below the stimuli. All tool and navigation buttons are on the bottom of the screen. Important: The streamlined interface is not intended to be tablet compatible. embedded accommodation non-embedded designated PDF of directions translated in each of the languages currently ed. Bilingual adult can read to student. A designated and/or accommodation that is neither offered nor available and has been approved by the California Department of Education. non-embedded designated non-embedded accommodation Legend: English language arts/literacy (ELA) extended time (ET) performance task (PT) Statewide Student Identifier (SSID) TOMS Online Student Test Settings User Guide Updated February 2015

30 Change Log Change Log Application Features New Former Section Date CAASPP Test Site Coordinators may upload student test setting files and change student test setting. File Specifications [CAASPP Test Site Coordinators did not have this ability in TOMS.] Throughout 2/05/15 New Former Section Date NEA_RA_Stimuli NEDS_RA_Stimuli Value of Column Q, Read Aloud for ELA 2/05/15 Print-on-demand for test stimuli and items, stimuli only, or items only must be set by contacting CalTAC. Configuring this accommodation in the upload file will not automatically activate it for the assigned student. All requests must be approved by CalTAC and the CDE. Paper copies of passages/ stimuli and/or items are printed for students. Print-on-demand for stimuli only can be set using file upload. Print-on-demand that includes items (either items only or items with stimuli) must be set by contacting the CDE. Definition of Column P, Print On Demand 3/02/15 Blank (default) TDS_TTS0 TDS_TTS_Item TDS_TTS_Stim TDS_TTS_Stim&TDS_T TS_Item Blank (default) TDS_TTS0 TDS_TTS_Stim Value of Column W, Text-to-speech for ELA Reading Passages Grades 6 8 and 11 3/19/15 Text-to-speech for ELA reading passages is not None Items Passages Passages and Items Text-to-speech for ELA reading passages is not None Passages Value Definition of Column W, Text-tospeech for ELA Reading Passages Grades 6 8 and 11 3/19/15 Blank (default) TDS_TTS0 TDS_TTS_Item TDS_TTS_Stim&TDS_T TS_Item TDS_TTS_ALL Blank (default) TDS_TTS0 TDS_TTS_Item TDS_TTS_Stim&TDS_T TS_Item Value of Column X, Text-to-speech for Math and ELA items 3/19/15 Updated February TOMS Test Administration Setup Manual 1

31 Change Log New Former Section Date Text-to-speech for math and ELA items is not None Items (ELA) Stimuli and Items (Math) Items (ELA) AND Stimuli and Items (Math) Text-to-speech for math and ELA items is not None Items Passages and Items Value Definition of Column X, Text-tospeech for Math and ELA items 3/19/ TOMS Test Administration Setup Manual December 2014