Assessment Management System. Edusoft LAUSD. Training Guide. title

Transcription

1 Assessment Management System Edusoft LAUSD title Training Guide Release: 3.7 LAUSD_

2 Copyright The Riverside Publishing Company. All rights reserved. ProductCoreLong, Edusoft, and Riverside are registered trademarks of Houghton Mifflin Company. All other trademarks and tradenames are the property of their respective owners. Information in this document is subject to change without notice. School districts, names, and data used as examples in this document are fictitious unless otherwise noted. No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording by any information or retrieval system, for any purpose, without prior written permission of The Riverside Publishing Company. Address inquiries to Permissions, Riverside Publishing, 208 Utah Street, Second Floor, San Francisco, CA If you have comments or suggestions about ProductCoreLong documentation, please send us an at Important contact information: Assessment Web site: assessment.lausd.net LAUSD Help Desk: (Option 0) Edusoft Help Desk: (Option 2) The Riverside Publishing Company 208 Utah Street, Second Floor San Francisco, CA Tel EDUSOFT

3 contents Table of Contents Chapter 1 Welcome to Edusoft Chapter 2 Grading Assessments Viewing grading results Resolving scanning problems Chapter 3 Managing Assessments About the Benchmark Assessment Locker Setting up and managing your Assessment Locker Administering assessments Chapter 4 Creating Benchmark Reports About Benchmark reporting Creating a Performance Band report Creating a Class List report Creating a Student Performance report Creating a School Comparison report set Chapter 5 Analyzing Assessment Items About Item Analysis reports Selecting items for analysis Viewing and interpreting Item Analysis reports About Item Response reports Creating an Item Response report Chapter 6 Defining Intervention Groups About intervention groups Defining an intervention group Refining membership in an intervention group Creating a custom group from an intervention group assessment.lausd.net Contents iii

4 Edusoft LAUSD Chapter 7 Generating Instructional Worksheets About creating instructional worksheets Instructional Tool has a new look Creating instructional worksheets Chapter 8 Managing Edusoft Settings Managing your account and password information Creating administrator accounts Managing users, passwords, and schools Looking up a user Changing your user name Setting underperforming thresholds Chapter 9 Creating Custom Groups About custom groups Creating a custom group Editing a custom group Index iv Contents LAUSD Help Desk:

5 chapter 1 Welcome to Edusoft The ProductCoreLong (Edusoft) is an easy-to-use student assessment platform that helps you make decisions about student instruction based on real performance data at the district level and all the way through to the classroom. With better access to data, you can answer questions like these: Where can I focus my instructional resources most effectively? How can I pull together scores from high-stakes exams, interim benchmarks, and classroom-based quizzes to look at the big picture? How can I tell if my after-school programs are paying off? Where do I place each student? Who goes into the gifted and talented program? Who might go there next year with a little extra attention now? What am I going to teach tomorrow based on the test results from today? How do I give each of my students the homework assignments that will help them the most? Who is going to summer school? Who might be able to avoid summer school with just a little more work in a specific area? How do I target the students who need intervention and make sure that they are getting the help they need? Edusoft helps you answer all these questions and more, with confidence and the data to back it up. Edusoft helps you administer large-scale assessment programs easily, efficiently, and economically and get immediate results. You can print answer sheets on plain paper, score them with an inexpensive home scanner, and start viewing the results online within minutes. With easy-to-use tools for analyzing your performance data, Edusoft helps you to keep classroom instruction aligned to your state standards and the needs of your students. assessment.lausd.net Welcome to Edusoft 1

6 Edusoft LAUSD A modular approach Modular in design and in approach, Edusoft gives teachers and administrators an array of tools right at their fingertips. All you need is an Internet connection and a browser. Benchmark Exams Throughout the year, you administer benchmark exams designed to determine how well students are developing the skills they need at each grade level. The Edusoft Benchmark Exams module helps you develop and administer school-wide or districtwide assessment programs with equal ease. Within hours of completing a large-scale assessment, you can start analyzing the results and deciding what actions to take. State Analysis Step-by-step support State-administered assessments contain a wealth of information about how well students are doing in a variety of subject areas if one could only pry that information loose. The Edusoft State Analysis module provides the tools you need to analyze state assessment results across populations and over time and take action on them. The Edusoft paper-to-web solution supports teachers at each step as they teach, test, analyze, and reteach. Customized instructional materials let you pinpoint specific areas where students are struggling. Automatic scoring of plain paper tests lets you continue to use familiar testing methods and existing test materials. Almost instant online access to results, and tools to interpret them, let you identify students who are at risk and provide immediate feedback. Real-world instructional tools and access to customizable resources let you target instruction where it is needed most. 2 Welcome to Edusoft LAUSD Help Desk:

7 chapter 2 Grading Assessments After you scan and upload a batch of answer sheets you can view the results on the Edusoft Web site. Depending on the number of answer sheets you are uploading, there may be a small delay before your scanning results are available. During large assessment waves, results might not be available immediately. Edusoft can display the results of scanning sessions for the past hour, for today, for the last week, the last month, or the last two months. You can view sessions based on whether you scanned the answer sheets yourself, or by the type of answer sheets scanned. You can also view answer sheets for all schools you have access to or just for one school. Other options allow you to target the specific scanning sessions for custom groups or just those that contain unresolved answer sheets. For each scanning session, you see the number of students successfully graded, as well as the failed scans. From there, you can identify and resolve scanning errors. You can also view results for multiple scanning sessions for the same test. This allows you to see how many scores you have and determine if some scores are missing. These are the topics in this chapter: Viewing grading results on page 4 Resolving scanning problems on page 9 assessment.lausd.net Grading Assessments 3

8 Edusoft LAUSD Viewing grading results The Grading Status page gives you access to information about scanning sessions. Edusoft automatically displays today s scanning sessions listed in chronological order. You can also view the results for a single test, even though answer sheets might have been scanned during more than one session. See Viewing results for a test on page 7 for more information. If the session you re interested in isn t listed in the Grading Status page, you can display other scanning sessions. See Choosing a scanning session on page 6. Once you ve located the session you want to view, you can attempt to resolve some types of scanning errors. See Resolving scanning problems on page 9. To view grading results: 1 Click the Admin tab. Click the Grading link or icon. These are today s scanning sessions. Click a scanning session to see its details. Tip: If there are no sessions for the today, the Grading Status: Session Summary page displays a message: No data meet these criteria. To view a different time period, see Choosing a scanning session on page 6. 4 Grading Assessments LAUSD Help Desk:

9 Training Guide 2 To view the results for a specific session, click the session s date/time link. Click a scanning session to see its details. The Grading Status: Session Detail page shows which answer sheets were scanned successfully and which were not. You can treat this page as a check list of actions to take in resolving scanning errors. See Resolving scanning problems on page 9 for more information. Click the link for a test to list all scanning sessions for that test. Answer sheets were scanned for this exam. If there is more than one test in a batch of answer sheets, the successes and failures are listed by exam name. These answer sheets were scanned successfully. This section shows information about the scanning session. Students in red have partial scores. This column indicates This column how many indicates of a student s how total answer sheets many were of a scanned: student s All, total Some, or None. Some means answer a sheets teacher were score sheet or additional student scanned: answer All, sheets Some, have or not been scanned. None. These answer sheets failed. Click to resolve the failure. assessment.lausd.net Viewing grading results 5

10 Edusoft LAUSD Choosing a scanning session Edusoft automatically lists today s scanning sessions in the Grading Status page. However, you can display other scanning sessions based on the time period, the type of answer sheet that was scanned, and the location of the scanner. For some types of answer sheets, you can display scanning session by school or by custom group. You can also display only the sessions that contain unresolved scanning problems. To choose a scanning session: 1 Use the options at the top of the Grading Status: Summary page to select different sessions. To show sessions For answer sheets that you scanned Do this Choose Answer sheets that I scanned in the Show Sessions By list. With period-specific or school-wide generic answer sheets With custom group answer sheets For a different time period For a specific scanner 1 Choose the type of answer sheet in the Show Sessions By list. 2 Choose a school in the School(s) list. 1 Choose Custom group answer sheets in the Show Sessions By list. 2 Choose a custom group in the Custom Groups(s) list. Choose the time period in the Time Period list. Choose the scanner location in the Site(s) list. With unresolved scanning problems Click the View unresolved only check box. 2 Click View. 6 Grading Assessments LAUSD Help Desk:

11 Training Guide The Grading Status: Session Summary page displays all sessions for the options you selected. The summary now shows all session with periodspecific answer sheets for one school. Scanning occurred from a specific scanner during the last week, and the sessions contain unresolved answer sheets. Click to view the details for a specific session. Viewing results for a test The Grading Status: Test Detail View lets you track the results for a specific test, regardless of how many scanning sessions are involved. Edusoft provides two ways to display this page: from your Assessment Locker or from a Grading Status: Session Detail page. From the Grading Status: Test Detail View page, you can drill down to see the teachers and periods or classes for which you have scores, and which students are missing scores. To view results for a test: 1 Open the Grading Status: Test Detail View page. From the Assessment Locker, view the test details page for an exam, and click the View Grading Status link. Click this link to view grading status for this test. From the Grading Status: Session Summary page, click the link for a grading session that includes the test. In the Session Detail page, click the link for the exam. Click this link to view grading status for this test. assessment.lausd.net Viewing grading results 7

12 Edusoft LAUSD The Grading Status: Test Detail View page displays a list of teachers and periods for which answer sheets have been graded. This teacher has answer sheets scanned for this test. This period has unresolved answer sheets. Click a teacher link to view scanning results for a specific teacher and test. 2 Click the link for a teacher or custom group to see the scanning status. The Grading Status: Teacher Test Detail page shows how many students were graded, the number of unresolved scanning failures, the names of students who were graded, and the names of those who are missing scores. Click this link to return to the Test Detail View page. This is information about the test and when it was administered. This is the number of unresolved scanning failures. These are the numbers of students with All, Some, or No scores. These are the details of the grading status for each student. These are the failed scans for this test. Click the View Image link to resolve failures. 8 Grading Assessments LAUSD Help Desk:

13 Training Guide 3 Click the test name link to retrace your steps. Resolving scanning problems There are a number of reasons that could cause a scanning failure, but they all boil down to recognition problems: can Edusoft identify both the student and the exam? Student recognition failures occur when the student fails to bubble his or her name clearly or bubbles more than one name. Another source of student recognition errors is students who have enrolled since the last time your Student Information System was updated at Edusoft. You can generally resolve this type of failure without much difficulty. You can think of these as the good failures they are relatively easy to fix. Failure to recognize the exam is a more serious problem. If you can identify the student and exam based on the answer sheet, you can print a new answer sheet, transfer the student s answers, and scan in the replacement. If you can t identify the student or the exam, the failure remains unresolved. These are the bad failures they are more difficult to fix. Anyone who scans answer sheets both teachers and administrators can resolve scanning failures. However, a teacher cannot resolve scanning errors for answer sheets scanned by another teacher, even if the students are in the first teacher s class. assessment.lausd.net Resolving scanning problems 9

14 Edusoft LAUSD Edusoft lists scanning failures in two categories, student recognition failures and exam recognition failures. These are student recognition failures. These are test recognition failures. Edusoft can identify the exam for these scanning failures. If you resolve them all, this section of the page goes away. Resolving student recognition problems When you resolve scanning failures, you start by looking at an image of the answer sheet. The action you take depends on the type of problem. If the student name is not bubbled, for example, but you can see whose answer sheet it is, you can assign the answer sheet to the student and regrade it. The same may be true if the student has bubbled two names. Tip: You can set the Grading Status: Session Summary page to show only the sessions that have unresolved answer sheets. Then, you can click the # of Unresolved link for each session to see the answer sheets that are still unresolved. You can also resolve answer sheets from the Grading Status: Session Detail page. 10 Grading Assessments LAUSD Help Desk:

15 Training Guide To resolve student recognition problems: 1 From the Grading Status: Session Detail page, click the View Image link for a failed scan. Click to select the student and regrade the answer sheet. Because the student s name has been written in, you can resolve this failure by assigning it to the correct student and regrading it. 2 Check to see the reason for the failure. 3 In the Instructions area, click the Click here link to look up the correct student. Select the student. If the student is not listed, you can search for the student by name or student ID. Click to continue resolving the failure. 4 If the student name is listed, click the bubble beside it and click Continue. assessment.lausd.net Resolving scanning problems 11

16 Edusoft LAUSD Click to return to the Grading Status page. Edusoft assigns the answer she to the student you selected. 5 Click the Back link to return to the list Grading Status: Session Detail page. This student now has a score. 6 Continue to examine and resolve student recognition failures. When you resolve all student recognition failures, that section of the Grading Status page goes away. Resolving test recognition failures Test recognition failures cannot be resolved as easily as student recognition failures. If the answer sheet is not defaced or damaged, you may be able to resolve the failure by rescanning and uploading the answer sheet. Or, if the only problem is stray marks on the block code or registration marks, you may be able to resolve the failure with a replacement answer sheet. Likewise, if the answer sheet is skewed or otherwise unreadable, the only solution is to replace it. 12 Grading Assessments LAUSD Help Desk:

17 Training Guide Test recognition failures appear in their own section of the Grading Status page. Unlike the student recognition failures, test failures remain on the list even after you resolve them. This is because you must resolve them manually by scanning a new answer sheet, and Edusoft has no way to connect the new answer sheet with the old scanning failure. important! You don t resolve a test recognition error until after you have successfully scanned and uploaded a replacement answer sheet. You resolve this failure by creating and scanning in a new answer sheet. The failure remains in the Grading Status list as a to do list until you resolve it. The student has played connect-the-dots with the block code, making it impossible for Edusoft to grade the answer sheet. To resolve test recognition failures: 1 From the Grading Status: Session Detail page, click the View Image link for a failed scan. Click this link after you ve taken the appropriate steps to resolve the scanning failure. 2 Read the reason for failure and follow the instructions on your screen for resolving it. assessment.lausd.net Resolving scanning problems 13

18 Edusoft LAUSD 3 After you have scanned in a replacement answer sheet, click the Mark as Resolved link. Edusoft marks the failure as resolved. When you return to the Grading Status page, your name is listed as the person who resolved the failure. 14 Grading Assessments LAUSD Help Desk:

19 chapter 3 Managing Assessments Edusoft benchmark assessments are school-wide or district-wide standards-based assessments that help teachers and administrators evaluate student progress toward overall and per-standard proficiency. Any assessment, whether created by your district or purchased, can be aligned to standards and administered using Edusoft. Using Edusoft, you can organize and store benchmark assessments in your Benchmark Assessment Locker. From here, you can add or remove the folders used to organize assessments, move assessments between folders, and archive assessments that are no longer in use. After an assessment is administered, you can evaluate the performance of individual students, classrooms, grades, schools, or any group that you select. You can also view and define performance bands for each assessment to further help you analyze student performance. These are the topics in this chapter: About the Benchmark Assessment Locker on page 16 Setting up and managing your Assessment Locker on page 17 Administering assessments on page 22 assessment.lausd.net Managing Assessments 15

20 Edusoft LAUSD About the Benchmark Assessment Locker The Benchmark Assessment Locker is a hierarchy of folders used to organize assessments. Assessments can be tests you ve created in Edusoft, or existing tests that you ve aligned in Edusoft. You can think of the contents of your Assessment Locker as folders in a file drawer. Each folder can contain assessments and other folders. Folders appear on the left and assessments appear on the right. You can create as many nested folders as it takes to organize your alignments in a useful way. Top level and subfolders appear in alphabetical order. The assessments in each folder also appear in alphabetical order. This is a top level folder. These are subfolders inside the top level folder. Each of these subfolders contains assessments. Click a folder to open it and see its contents. A + on the folder means it contains other folders. The number next to the folder indicates the number of assessments it contains. The highlight indicates this is the currently selected folder. This is the current folder. The aligned assessments in each folder appear in alphabetical order. Private assessments are red, and are marked private. Click to view or edit the details of the selected assessment. The assessments in your locker can be either public or private. Public means that all Edusoft users in your district teachers and administrators can see the assessment. Private means that only other administrators can see the assessment and its scores. The names of private assessments appear in red. You can print answer sheets for any assessment that appears in your Assessment Locker. Edusoft lists top level folders in your Assessment Locker in alphabetical order. All nested folders also appear in alphabetical order. Therefore, it s important to plan your folder hierarchy before you start adding folders. The easiest way to do this is to sketch the plan first on paper to make sure that you have included all the folders you need and the hierarchy is easy for teachers and administrator to use. Although you can create and remove folders as you like, the folders always appear in alphabetical order. 16 Managing Assessments LAUSD Help Desk:

21 Training Guide Setting up and managing your Assessment Locker The first step in organizing your Assessment Locker is to plan how it will be organized. Next, you add test folders and subfolders to flesh out the structure you planned. If you decide to change the structure, you can rename, move, or delete folders. At the end of an assessment cycle or at the end of the school year, you can archive assessments that will no longer be in use. For example, if you organize your folders by testing cycle, you can archive the first quarter s assessments before adding assessments for the second quarter. important! Some important points to remember: If you delete a test that has been scored, you will also delete the scores associated with it. If you delete a folder that contains one or more tests, you also delete the tests (and their scores). Creating a test folder These are the topics in this section: Creating a test folder on page 17 Managing test folders on page 18 Archiving a folder on page 19 Restoring an archived folder on page 20 Copying an assessment on page 20 Moving an assessment to a different folder on page 21 Deleting an assessment on page 22 Changing the security for an assessment on page 22 You use folders to organize the contents of your Assessment Locker. You can place folders within other folders to create a hierarchy. When you create a folder, you specify the folder name and whether it is a top-level folder or a subfolder. Note: Once you ve named a folder, you can easily rename it at any time. In the Assessment Locker, select the folder and click Rename. assessment.lausd.net Setting up and managing your Assessment Locker 17

22 Edusoft LAUSD To create a test folder: 1 Click the Benchmarks Exam tab. Click the link or icon for Assessments. Click to create a new folder. This is a top level folder. This is a subfolder within a top level folder. This is an aligned assessment. 2 On the Assessments page, click Create New Folder. 3 Type a name for the folder in the New Folder Name area. Tip: When naming folders by grade, use a zero before single-digit grades so that they can be sorted in the correct order. For example, Grade 09, Grade 10, Grade Click an existing folder to choose a location for the new folder. To place the folder at the top level, choose At the Top Level. To place the folder within another folder, select the folder where you want to place it. 5 Click OK. Managing test folders After you create folders, you can rename them, delete them, or move them to different locations. In each case, you begin by selecting the folder you want to manage. Then you select the appropriate folder option: move, rename, or delete. important! If you remove a folder that contains assessments that have been administered and scored, you will lose the scores. To retain the scores, you must move all assessments with scores associated with them to another folder before removing the original folder. See Moving an assessment to a different folder on page Managing Assessments LAUSD Help Desk:

23 Training Guide Archiving a folder To manage test folders: 1 Click the Benchmarks Exam tab. Click the link or icon for Assessments. 2 On the Assessments page, select the folder you want to move, rename, or delete. 3 Click the appropriate folder options button. To move a folder, click Move and choose where to move the folder. Click OK. To rename a folder, click Rename and type the new name. Click OK. To delete a folder, click Delete and click Yes to confirm that you want to delete it. Your Assessment Locker is divided into two major sections Current and Archives each of which can contain folders, subfolders, and assessments. The Current section is designed to house the assessments that are live in your district right now. The Archives section is where you store assessments that have already been administered and scored, and should not be administered again. This is the Current section of your Assessment Locker. This is the Archive section of your Assessment Locker. Archiving is a shortcut for moving entire folders with their subfolders and assessments from the Current section of your Assessment Locker to the Archives section. It s important to remember that archiving is not the same as deleting folders. Instead, archiving simply moves the folders and their contents out of the current section. You can continue to generate reports on scores for archived assessments, but you can no longer print answer sheets for them. Tip: To archive individual assessments, simply move them to a folder that has been archived. assessment.lausd.net Setting up and managing your Assessment Locker 19

24 Edusoft LAUSD Note: If you had folders in your Assessment Locker prior to August 1, 2004, Edusoft duplicated your Current folder structure in the Archived section as part of our migration to version 2.7. We did this to prevent the loss of archived assessments or folders. Now that the migration is complete, you may want to look at your Archives section and remove any folders you no longer need. To archive a folder: 1 Click the Benchmarks Exam tab. Click the link or icon for Assessments. 2 On the Assessments page, select the folder you want to archive and click Archive. 3 Choose where in the Archives section to move the folder. Click OK. Restoring an archived folder Whenever you wish, you can move a folder from the Archives section to the Current section and print answer sheets for the restored assessments. You choose the location for the folder when you restore it. There s no need to move it back to its previous location. To restore a folder: 1 Click the Benchmarks Exam tab. Click the link or icon for Assessments. 2 On the Assessments page, choose Archives from the Show list. 3 Select a folder and click Restore. 4 Select a location for the restored folder and click OK. You can place the restored folder wherever you like. Copying an assessment Edusoft can store only one set of scores for each benchmark assessment. This means that if you were to administer the same assessment for a second time, the scores from the second administration would over-write the previous scores for the same students. If you want to administer an assessment for a second (or subsequent) time, you can make an exact copy of the assessment. Edusoft recognizes the copy as a separate assessment and scores it accordingly. This way, you can administer the assessment twice without losing the scores from the first administration. 20 Managing Assessments LAUSD Help Desk:

25 Training Guide The assessment copy is an exact duplicate of the original, including any uploaded test files. The copy has the same number of sections, the same questions per section, and the same answer key for multiple choice questions. Questions are aligned to the same standards. However, you can place the copy in a different folder, give it a new name, and change the administration date. important! Although the copy is an exact duplicate of the original assessment, you must print new answer sheets that are identified with the copy, rather than with the original. If you were to use old answer sheets, Edusoft would assume that you were re-administering the original assessment and not the copy. To copy an assessment: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. 2 In the Assessment Locker, select the assessment and click View Details. 3 Click Copy to create a duplicate of the assessment. 4 Give the assessment a name, and enter the new administration date. Choose whether to allow the new assessment to be copied. 5 Select a folder for the assessment. 6 Click OK. If the original assessment had a test attached to it, the copy has the same test file attached. Moving an assessment to a different folder When you add an assessment to your Assessment Locker, you select the test folder where the assessment will be located. If you change your mind, you can move assessments to a different folder. Note: Depending on how your district has been set up, you might not have the permissions to move a folder. To move an assessment to a different folder: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. 2 Select the assessment you want to move and click Move in the Test options area. 3 Select a location for the assessment and click OK. assessment.lausd.net Setting up and managing your Assessment Locker 21

26 Edusoft LAUSD Deleting an assessment You can delete assessments you no longer need from your Assessment Locker. important! If the assessment has been administered and graded in Edusoft, deleting the assessment also deletes any scores associated with the assessment. If the scores are deleted, you can no longer run reports that include this assessment. To delete an assessment: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. 2 Select the assessment you want to delete and click Delete in the Test Options area. 3 Click Yes to confirm that you want to delete the assessment. Click OK to confirm again. Changing the security for an assessment When you align a Benchmark assessment, Edusoft assumes that you want to keep the assessment private until you are ready to share it with teachers users in your district. Therefore, all newly aligned assessments are private available only to other administrators in your district. When you are ready to share the assessment with the rest of the district, you change its security setting to Public. To change the security for an assessment: 1 Click the Benchmark Exams tab, and then click the link for Assessments. 2 In the Assessment Locker, select the assessment and click View Details. 3 To make an assessment public, click the Make Public link. 4 To make an assessment private, click the Make Private link. The assessment still appears in the Assessment Locker of administrator users, but teachers can no longer print answer sheets or view the results of this assessment. Administering assessments Edusoft makes it easy to administer benchmark exams. Preparation includes: Printing the answer sheets for the assessment. See Viewing and printing answer sheets on page 24. Printing the corresponding questions. If the test document is attached to the assessment, you can download and print it from Edusoft as well. See Downloading exam questions on page Managing Assessments LAUSD Help Desk:

27 Training Guide After you administer the assessment, you collect the test materials from the students, and scan and upload the answer sheets to Edusoft. See the Edusoft Scanning and Grader Guide (click the Library link from any Edusoft page) for information about scanning answer sheets, resolving scanning problems, and viewing results. Once the answer sheets have been successfully uploaded, you can run reports that include the data from this assessment. Viewing assessment details Each Benchmark assessment in your Assessment Locker has a details page that includes information about the assessment, as well as links that allow you to: Edit the assessment (see Editing an aligned assessment on page 62) Copy the assessment (see Copying an assessment on page 20) Attach a file or view an attached file (see Uploading a test file on page 61 and Downloading exam questions on page 26) View questions and standards View grading status Print exam labels that show students how they performed on an assessment (see Printing exam labels on page 27) View or create performance bands Change the security setting for the exam (see Changing the security for an assessment on page 22) Print answer sheets (see Viewing and printing answer sheets, next) The details page also shows the number of answer sheets that have been graded for this assessment. (For more information, see Chapter 4, Grading Exams with Edusoft in the Edusoft Scanning and Grader Guide.) After grading an assessment, a link appears on the details page that you can click to view the grading status. To view assessment details: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. assessment.lausd.net Administering assessments 23

28 Edusoft LAUSD 2 In the Assessment Locker, select a folder, and then select an assessment. Click View Details to view its details page. This is the number of answer sheets that have been graded for this assessment. Click to view questions and standards. Click to view the definition for a specific standard. Click to view the current performance bands. Click to view test questions. Click to replace the file containing test questions. If the test was created in Edusoft, you see View Test Document here. 3 To view information about questions and the standards they are aligned to, click the View Question Details link. The Question Details page shows the number and types of questions, the point value for each question, the correct answers for multiple choice questions, and the standards each question is aligned to. 4 To view the definition of a standard, click the standard link. Click the Back link to return to the Question Details page. Tip: You can also hold the mouse pointer over a standard to view the definition in a pop-up box. Viewing and printing answer sheets Before you administer an exam, you print the answer sheets that students will use to bubble their answers. If the exam has short or long answer questions, teachers need to grade those answers before the answer sheets can be scanned and scored by Edusoft. Long answer exam sections can also optionally use teacher score sheets. Teachers use these to score questions for all students on one sheet instead of on each student s answer sheet. Edusoft creates answer sheets in PDF files that you can view and print using Adobe Reader. You must have Adobe Reader installed on your computer before you can view and print an answer sheet. If you don t already have Adobe Reader installed, you can download it at no cost from the Adobe Web site: 24 Managing Assessments LAUSD Help Desk:

29 Training Guide There are three types of answer sheets: Per Period Period-specific answer sheets are identified by teacher and period, and include a list of the students in the period.you can print them for specific courses, teachers, and periods. The PDF file also includes a generic page for each period that is also identified by teacher and period. But instead of a list of student names, the periodgeneric answer sheet contains spaces where students can bubble their student IDs. School-wide Generic School-generic answer sheets are not associated with a teacher or period. They can be used by any student taking the assessment. If you have a choice, we recommend you use period-specific answer sheets. Custom Group Answer sheets for students in one or more custom groups. Student names for the custom group appeain addition,. Before you distribute answer sheets to students, make sure the answer sheets are good, crisp copies and are square on the page. Here are some tips that will make scanning easier after students complete the answer sheets: When you print answer sheets, be sure to use a high-quality laser printer to print the master answer sheet. Do not create answer sheets on an ink-jet or dot-matrix printer. When you copy answer sheets, be sure to use a high-quality copier to make copies. Do not use a high-capacity, low-quality duplication system such as risograph. When you copy answer sheets, make sure that the copies are the same size as the original (not reduced or enlarged) and are not distorted in any way. The Edusoft Grader relies on the four squares in the corners of the answer sheet (registration marks) for orientation. If they are in the wrong position or are distorted in any way, scanning may fail. Note: You should not use answer sheets printed more than a year in the past. If you try to scan answer sheets that more than a year old, Edusoft displays an error message. Then you will have to print new answer sheets and transfer all entries from the old answer sheets to the new ones before rescanning. To view and print answer sheets: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. 2 In the Assessment Locker, select an assessment and click Print Answer Sheets. assessment.lausd.net Administering assessments 25

30 Edusoft LAUSD 3 Choose a school if necessary. Select the type of answer sheet and click Continue. To print Answer sheets for one or more periods School-wide generic answer sheets Answer sheets for custom groups Do this 1 Choose Per Period, and click Continue. 2 On the Select Courses page, click the check boxes for one or more courses and click Continue. 3 On the Select Periods page, click one or more check boxes to select teachers or periods. Click Continue. If you select a teacher, you get answers sheets for all the teacher s periods for the courses you selected. You can also select individual periods. Tip: Click the View link to see which students are in a period. Choose School-wide Generic, and click Continue. 1 Choose Custom Group, and click Continue. 2 Select one or more custom groups and click Continue. After a brief pause, Adobe Reader starts in your browser window and Edusoft displays the PDF file containing all the answer sheets you selected. 4 To print this document, click the Print icon and follow the instructions on your screen. The Print icon is part of the Adobe Reader toolbar toward to the top of the page. important! Tip: If you are working with a large number of answer sheets, you might want to save the PDF file to your computer before printing. To save this PDF file to your computer, click the Save a Copy icon. You can return to this file later to resume printing. Downloading exam questions Use the Print icon from the toolbar. Do not use Print from the File menu or the Ctrl-P shortcut. If the test was created in Edusoft, or the person who aligned the test attached a file containing the exam questions, you can open that file and print it out. Tip: Although you can attach any sort of file to an assessment, the most common contents of the file are the exam questions. It s a good idea to check the file in advance to make sure it contains the questions. For an aligned test, you can quickly tell if a file has been attached to an assessment by looking at the assessment details page. A Download Test button indicates there is a file attached. For a test created in Edusoft, a View Test Document button appears instead. 26 Managing Assessments LAUSD Help Desk:

31 Training Guide Printing exam labels Note: In most cases, you must have the application that was used to create the file in order to open it. For a PDF file, you need Adobe Reader to open and print the file. To download exam questions: 1 Click the Benchmark Exams tab, and then click the link or icon for Assessments. 2 In the Assessment Locker, select an assessment and click View Details to view its details page. 3 Click Download Test or View Test Document to open the file or save it on your computer. To open the file, click Open. To save the file to your computer, click Save, select the location where you want the file to be stored, and click Save. 4 Click the Back link to return to the Assessment Locker. Edusoft makes it easy to print labels that show how each student performed on recent assessments. Labels show the student s name, the test score in raw numbers and percentages, a list of the questions missed, and a list of standards. You can print labels from the Assessment Locker or the Test Details page. Student s point/total possible points. Correct multiple choice answer. Question number. This is a short answer question, so there s no correct answer shown. Student s name. Raw score/total possible points (Percent score). Guide for students on how to read this label. Standards covered in the missed questions. Tip: You can print the labels on Avery 5164 label sheets and then affix them to each student s answer sheet or test. You can also print labels onto plain paper and staple them onto answer sheets. To print labels from the Assessment Locker or Test Details: 1 In the Assessment Locker, select an assessment, and click Print Labels. assessment.lausd.net Administering assessments 27

32 Edusoft LAUSD You can also select the assessment, click View Details, then click Print Labels on the Test Details page. 2 Select a School Group and School, and click Continue. 3 Select a period, and click Continue. 4 Choose whether to include correct answers on the labels, and click Continue. After a brief pause, Edusoft displays the first page of labels. The labels are in a PDF file that you can print or save to disk. About defining performance bands When you align an assessment, Edusoft automatically creates your district s default number of performance bands for overall scores, per standard, and per question group. You can use the default performance bands as is, or you can create new bands that may more accurately model the rubrics in use in your school or district. You can create performance bands for: Overall scores. See Defining overall performance bands on page 28. Each standard covered in the assessment. See Defining per standard performance bands on page 29. For a group of related questions that you define as a question group. See Defining performance bands for question groups on page 30. Defining overall performance bands Overall performance bands are a way of looking at results for an entire assessment. They give you a sense of how students are performing on the test as a whole rather than in specific areas. Depending on your settings, you can define each performance band by a percent range or by point values. For each band, you specify the low end of the range and Edusoft uses that number to calculate the top value for the prior range. When you view points and percents side by side, you can adjust either set of values to get the results you want. To define overall performance bands: 1 In the Benchmark Assessment Locker, select an assessment and click View Details to view its Test Details page. 2 Click the Create New Bands link in the Performance Bands area to define performance bands for this assessment. 3 Choose the type (Overall) and number of performance bands you want to create. Click Continue. 28 Managing Assessments LAUSD Help Desk:

33 Training Guide To create performance bands for standards or for question groups, see Defining per category performance bands on page 29. You can create up to 30 bands. 4 If performance bands already exist, Edusoft asks you to confirm that you want to replace the existing performance bands with new ones. You only replace the performance bands of the type you selected. Click Continue to overwrite the existing performance bands. Bands are listed from lowest to highest and use your district s default band names. 5 Type a name for each performance band. Click Continue. For overall bands you must create new bands to change their names. 6 Type a point value or percent for the bottom of each performance band range. Tip: You might start with a percent and then adjust the points to a round number. 7 (Optional) Select an At Level band from the drop-down list. If you set an At Level band, you ll see the percent of students scoring at this level or above on the Performance Band Report. 8 Click Continue. Tip: To reset customized performance bands, click the Reset to Default link. 9 To create additional bands, click the Create link at the top of the page. Otherwise, click the Back link to return to the Test Details page. The assessment details page shows the number of overall, per standard, and question group performance bands. Defining per category performance bands In addition to overall performance bands, you can also define performances bands for each standard covered in the exam. You can also select a group of related questions and identify them as a question group, which you can use later in reports. Depending on your settings, you can define each performance band by a percent range or by point values. For each band, you specify the low end of the range and Edusoft uses that number to calculate the top value for the prior range. When you view points and percents side by side, you can adjust either set of values to get the results you want. See Defining per standard performance bands, next. See Defining performance bands for question groups on page 30 Defining per standard performance bands When you create performance bands per standard, you can set a single range that applies to all standards, or define a separate range for each standard. assessment.lausd.net Administering assessments 29

34 Edusoft LAUSD To create per standard performance bands: 1 In the Assessment Locker, select an assessment and click View Details to view its Test Details page. 2 Click the Create New Bands link in the Performance Bands area to define per standard performance bands for this assessment. 3 Click Per Standard to create bands for each standard. Choose the number of bands you want to create. Click Continue. Bands are listed from lowest to highest. 4 Type a name for each performance band. Choose whether to use the same performance bands for all standards. Click Continue. If you choose to use the same performance bands across the board, you start with your district s default values and enter percents that apply to all performance bands. You can then review and edit the ranges for each standard separately. If you set ranges separately, you can enter either percents or points for each standard in turn. 5 Type percents for the bottom of each performance band range. If necessary, choose whether you want to edit ranges for individual standards. Click Continue. Tip: You may want to adjust the ranges for a performance band based on the number of points available for a question group. 6 If you chose to edit ranges, adjust the points or percentages for each standard. Click Continue. After you complete the final standard, Edusoft displays the performance bands you created. 7 To create additional bands, click the Create link at the top of the page. Otherwise, click the Back link to return to the Test Details page. Defining performance bands for question groups The steps for creating performance bands per standard and for question groups are almost identical. If you re creating question groups there is an extra step where you enter a name for each question group and designate the questions in the group. To create performance bands and question groups: 1 In the Assessment Locker, select an assessment and click View Details to view its Test Details page. 2 Click the Create New Bands link in the Performance Bands area to define question groups with performance bands for this assessment. 3 Click Question Groups and select the number of question groups you intend to create. Choose the number of bands you want to create. Click Continue. 30 Managing Assessments LAUSD Help Desk:

35 Training Guide Bands are listed from lowest to highest. 4 Type a name for each performance band. Choose whether to use the same performance bands for all question groups. Click Continue. If you choose to use the same performance bands across the board, you start with your district s default values and enter percents that apply to all performance bands. If you set ranges separately, you can enter either percents or points for each standard or question group in turn. 5 Type percents for the bottom of each performance band range. Choose whether you want to edit ranges for specific question groups. Click Continue. Tip: You may want to adjust the ranges for a performance band based on the number of points available for a question group. 6 If you choose to edit ranges, adjust the points or percentages for each standard or question group as the opportunity occurs. Click Continue. Repeat for each standard. 7 Type a name for the question group and click the check box for each question to be included. Click Continue. 8 Click Continue to name and select questions for all other question groups. Note: If you chose to edit ranges for question groups, this is when you get the chance to change the name. After you complete the final question group, Edusoft displays the question groups and performance bands you created. To delete performance bands for question groups, click the Delete link. To edit performance bands for question groups, click the Edit link and make any changes you need. 9 To create additional bands, click the Create link at the top of the page. Otherwise, click the Back link to return to the Test Details page. assessment.lausd.net Administering assessments 31

36 Edusoft LAUSD 32 Managing Assessments LAUSD Help Desk:

37 chapter 4 Creating Benchmark Reports Reports are an important tool in understanding and analyzing the results of student assessments. Edusoft provides a variety of reports that you can base on any Benchmarks assessment that has been graded in Edusoft. These are the reports: Performance Band reports show you the big picture either average scores distributed by performance band or the number and percent of scores that fall into each band. Class List reports show you how each student in a class or group performed on an assessment. This report is like a gradebook. A Student Performance report shows you an individual student s performance on one or more exams. School Comparison reports show you overall, per standard, or per question group scores for each school in a district or school group. In addition to these reports, you can also use the Edusoft Report Builder to look at the results of up to four Benchmark assessments in a single report, disaggregated by school, by teacher, by ethnicity, or by any available demographic data. See Using the Edusoft Report Builder on page 115 for more information about creating reports. These are the topics in this chapter: About Benchmark reporting on page 34 Creating a Performance Band report on page 40 Creating a Class List report on page 42 Creating a Student Performance report on page 44 Creating a School Comparison report set on page 45 assessment.lausd.net Creating Benchmark Reports 33

38 Edusoft LAUSD About Benchmark reporting When you create a Benchmarks report, there are a series of choices you can make: Step 1 You start by choosing which type of report to run: a Performance Band report, Class List report, or Student Performance report. For descriptions of these report formats, see About Performance Band reports on page 36, About Class List reports on page 37, and About Student Performance reports on page 38. Other options include using the Edusoft Report Builder (see About Report Builder reports on page 116) and running School Comparison reports (see About School Comparison reports on page 39). Step 2 Next, you choose the test or tests you want to report on. You can report on any Benchmark exam that has been graded and scored in Edusoft. Your report can contain data for the students you teach or students in your school or district. Performance Band Report for: A., Santiago Exam: Benchmark #3 Narrative Analysis (Spring 2005) April 14, 2005 Page 1 of 1 Report Options Schools: All Grades: All Courses: All Gender: All Ed Programs: All Ethnicities: All Custom Groups: All Roster: School Year, Spring # Students: 73 Performance Band Report for: Edusoft Public School District Exam: Benchmark #3 Narrative Analysis (Spring 2005) April 14, 2005 Page 1 of 1 Report Options Schools: All Grades: All Teachers: All Courses: All Gender: All Ed Programs: All Ethnicities: All Custom Groups: All Roster: School Year, Spring # Students: 222 Overall Performance: Average Performance: Score: 29.8/42 (71%) Band 3 Per Band Performance: Overall Performance: Average Performance: Score: 29.7/42 (71%) Band 3 Per Band Performance: Band Range # Students % ) Band % 2) Band % 3) Band % 4) Band % Band Range # Students % ) Band % 2) Band % 3) Band % 4) Band % This report shows what teachers would see the results for just the students they teach. This report shows what an administrator would see the results for all students in the school or district. Step 3 Then, you choose options for your report, including how to aggregate or group the data, which types of scores to include, and how to display the data. Data aggregation determines how data is summarized in Performance Band reports. Data grouping determines how student data is organized on Class List reports. You can view data for all students in a group, by class or period, or individually (on Performance Band reports). If you view data for All students Each period Each student You get A single (usually one page) report that shows the results for all students in the group you select. A separate report page for each class or period you select. A separate report page for each student in the group you select. 34 Creating Benchmark Reports LAUSD Help Desk:

39 Training Guide Score types are overall scores, scores by standard, and scores for questions groups. All reports display overall scores for exams that are set to show overall performance on reports. Performance Band reports can display both per standard and question group scores. Class List reports can display either per standard or question group scores, but not both. Class List Report Performance Band Report Performance Band Report for: Edusoft Public School District Benchmark #1 Geometry (September) December 15, 2005 Page1of1 Report Options: School Groups: All Schools: All Grades: All Teachers: All Courses: All Gender: All Ed Programs: All Ethnicities: All Custom Groups: All Roster: School Year, Spring # Students: 239 Overall Performance: Per Band Performance: Average Performance: Band Range # Students % Score: 22.1/30 (74%) Far Below Basic % Proficient Below Basic % Basic % Proficient % Advanced % Per Standard Performance: Standards: Far Below Below Basic Basic Proficient Advanced Basic Geometry: (1%) 32 (13%) 61 (26%) 86 (36%) 58 (24%) Geometry: (0%) 3 (1%) 35 (15%) 147 (62%) 54 (23%) The band with the most students is highlighted. Standards: CCS--Math--Geometry - Geometry: Students demonstrate understanding by identifying and giving examples of undefined terms, axioms, theorems, and inductive and deductive reasoning. Section 1: 1, 2, 7, 9 Section 2: 14, 15, 13 Section 1: 3 - Geometry: Students write geometric proofs, including proofs by contradiction. Section 1: 1 Section 2: 11 Section 3: 16 Section 2: 13, 12 Section 1: 10, 8, 4, 5, 6 Overall scores Per standard scores Class List Report for: Edusoft Public School District Exam: Benchmark #4 Reading Comprehension (Spring 2005) April 13, 2005 Page 1 Report Options Schools: All Grades: All Teachers: All Courses: All Gender: All Ed Programs: All Ethnicities: All Custom Groups: All Roster: School Year, Spring # Students: 222 Student Performance Student Overall Performance Grade 9/10Reading:2.1(2, Grade 9/10Reading:2.3(7, Grade 9/10Reading:2.4(5, Grade 9/10Reading:2.5(1, 3, 4, 12, 16) 8, 10, 13, 15, 18, 19) 6, 9, 14, 21) 11, 17, 20) GROUP AVERAGE Meets 15/21 (71%) Mastered 5/5 (100%) Needs 2/7 (29%) Mastered 5/5 (100%) Mastered 4/4 (100%) Expectation Improvemen A., Aaron Meets 15/21 (71%) Mastered 4/5 (80%) Needs 5/7 (71%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Abigail Meets 14/21 (67%) Needs 3/5 (60%) Needs 3/7 (43%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Adriana Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Adrianna Meets 15/21 (71%) Mastered 4/5 (80%) Mastered 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) A., Alejandro Exceeds 20/21 (95%) Mastered 4/5 (80%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Alicia Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Amber Exceeds 18/21 (86%) Needs 3/5 (60%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Araceli Meets 14/21 (67%) Mastered 5/5 (100%) Needs 5/7 (71%) Needs 2/5 (40%) Needs 2/4 (50%) A., Brennen Exceeds 18/21 (86%) Mastered 5/5 (100%) Needs 4/7 (57%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Brittney Underperformi 12/21 (57%) Needs 2/5 (40%) Mastered 6/7 (86%) Needs 2/5 (40%) Needs 2/4 (50%) A., Cassandra Underperformi 12/21 (57%) Needs 2/5 (40%) Needs 4/7 (57%) Mastered 4/5 (80%) Needs 2/4 (50%) A., Chris Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Christina Meets 15/21 (71%) Mastered 4/5 (80%) Mastered 6/7 (86%) Needs 2/5 (40%) Mastered 3/4 (75%) A., Christopher Meets 16/21 (76%) Mastered 4/5 (80%) Needs 5/7 (71%) Mastered 5/5 (100%) Needs 2/4 (50%) A., Ciasha Underperformi 13/21 (62%) Needs 2/5 (40%) Mastered 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) A., Cody Underperformi 13/21 (62%) Needs 3/5 (60%) Needs 5/7 (71%) Needs 2/5 (40%) Mastered 3/4 (75%) A., Daniela Meets 14/21 (67%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) A., Deryk Meets 17/21 (81%) Mastered 4/5 (80%) Needs 5/7 (71%) Mastered 4/5 (80%) Mastered 4/4 (100%) A., Erica Meets 14/21 (67%) Mastered 4/5 (80%) Needs 4/7 (57%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Erika Underperformi 12/21 (57%) Needs 2/5 (40%) Needs 5/7 (71%) Needs 3/5 (60%) Needs 2/4 (50%) Question Group Performance: Question Group: Below Mastery At Mastery Above Mastery Deductive Reasoning 28 (12%) 99 (41%) 112 (47%) Proofs 1 (0%) 71 (30%) 167 (70%) The band with the most students is highlighted. Question group scores Display options include how to display per standard or question group scores, whether to include item analysis, and how to highlight or color code scores. Step 4 Finally, you choose the students to be included in the report by school, by class, or by any of a variety of demographic options. Note: Edusoft produces reports in the form of PDF files that you can view from your browser using Adobe Reader. You can print a report or save it to your hard drive for later reference. You must have Adobe Reader installed on your computer before you can view reports. You can download it from For more detailed information about each type of report, see: About Performance Band reports, next. About Class List reports on page 37. About Student Performance reports on page 38 About School Comparison reports on page 39. assessment.lausd.net About Benchmark reporting 35

40 Edusoft LAUSD About Performance Band reports Performance Band reports show you the big picture either the number and percent of students in each performance band, or the average scores in each performance band. You can display overall scores, plus scores for standards and question groups, and you can display them for a group of students you select, for classes or periods, or for individual students. The title shows the type of report. These are the options selected for this report. This is the average overall score for all students who took the exam. This only appears for tests set to show overall performance. You also see At Level performance if it s set for and exam. These sections can show the number and percent of students in each performance band, or the performance band of the average score for each standard or question group. Performance Band Report for: Edusoft Public School District Benchmark #1 Geometry (September) December 15, 2005 Page1of1 Report Options: School Groups: All Grades: All Courses: All Ed Programs: All Custom Groups: All # Students: 239 Overall Performance: Average Performance: Score: 22.1/30 (74%) Proficient Schools: All Teachers: All Gender: All Ethnicities: All Roster: School Year, Spring Per Band Performance: Band Range # Students % Far Below Basic % Below Basic % Basic % Proficient % Advanced % Per Standard Performance: Standards: Far Below Below Basic Basic Proficient Advanced Basic Geometry: (1%) 32 (13%) 61 (26%) 86 (36%) 58 (24%) Geometry: (0%) 3 (1%) 35 (15%) 147 (62%) 54 (23%) The band with the most students is highlighted. Standards: CCS--Math--Geometry - Geometry: Students demonstrate understanding by identifying and giving examples of undefined terms, axioms, theorems, and inductive and deductive reasoning. Section 1: 1, 2, 7, 9 Section 2: 14, 15, 13 Section 1: 3 - Geometry: Students write geometric proofs, including proofs by contradiction. Section 1: 1 Section 2: 11 Section 3: 16 Section 2: 13, 12 Section 1: 10, 8, 4, 5, 6 Question Group Performance: Question Group: Below Mastery At Mastery Above Mastery Deductive Reasoning 28 (12%) 99 (41%) 112 (47%) Proofs 1 (0%) 71 (30%) 167 (70%) The band with the most students is highlighted. Question Groups: Deductive Reasoning: Section 1: 2, 3, 7, 9 Section 2: 13 Proofs: Section 1: 6 Section 2: 11 Section 3: 16 Section 2: 12 This is the aggregate group (here, it s the district, but it could also be a period or student). This is the name of the exam and when it was administered. This graph shows the percentage of students in each performance band based on their overall scores. These are average per standard scores. These are descriptions of the standards. These are average per question group scores. These are descriptions of the question groups. When would I use this report? You can use this report to get a one-page snapshot of the recent third grade reading benchmark exam with the percentage of students is each performance band for overall scores, per standard scores, and question group scores. You might use this report if you re the district curriculum coordinator and you need a snapshot of how all seventh graders in the district performed on the latest math benchmark exam. You want a report that shows per standard performance, question group performance, and item analysis for the entire group. If there is an At Level performance band set for an exam, you can run this report to see the percentage of students scoring at this level and higher. See Defining overall performance bands on page 28 for how to set an At Level performance band. 36 Creating Benchmark Reports LAUSD Help Desk:

41 Training Guide Performance Band reports can also include an item analysis section that shows you the average student score for each question and the incorrect multiple choice answer students selected most often. # is the item number. Average Points Received (AV) is the average raw score for all students who took the exam. Possible Points (PP) is the total number of points a student could score on this exam. Correct Answer (CA) is the correct response for multiple choice questions. Most Frequent Incorrect Responses (IR) is the incorrect answer that students selected most often on multiple choice questions. About Class List reports See Creating a Performance Band report on page 40 for more information. The Class List report is a gradebook view that shows scores for the group as a whole and for individual students. You can see overall average raw and percentage scores and performance bands, plus scores by standard or by question group. Customizable highlighting of performance bands let you spot high or low performance on standards or question groups. Optional color coding of all performance bands shows you at a glance how students are performing. The title shows the type of report. These are the options selected for this report. The top row shows average scores for the students you selected for this report. These are the overall scores (raw and percentage) and performance bands for individual students. Class List Report for: Edusoft Public School District Exam: Benchmark #4 Reading Comprehension (Spring 2005) April 13, 2005 Page 1 of 11 Report Options Schools: All Grades: All Teachers: All Courses: All Gender: All Student Performance Student Overall Performance GROUP AVERAGE Meets Expectation Grade 9/10Reading:2.1(2, 3, 4, 12, 16) 15/21 (71%) Mastered 5/5 (100%) Needs Improvemen Grade 9/10Reading:2.3(7, 8, 10, 13, 15, 18, 19) Ed Programs: All Ethnicities: All Custom Groups: All Roster: School Year, Spring # Students: 222 Grade 9/10Reading:2.4(5, 6, 9, 14, 21) Grade 9/10Reading:2.5(1, 11, 17, 20) 2/7 (29%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Aaron Meets 15/21 (71%) Mastered 4/5 (80%) Needs 5/7 (71%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Abigail Meets 14/21 (67%) Needs 3/5 (60%) Needs 3/7 (43%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Adriana Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Adrianna Meets 15/21 (71%) Mastered 4/5 (80%) Mastered 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) A., Alejandro Exceeds 20/21 (95%) Mastered 4/5 (80%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Alicia Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Amber Exceeds 18/21 (86%) Needs 3/5 (60%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Araceli Meets 14/21 (67%) Mastered 5/5 (100%) Needs 5/7 (71%) Needs 2/5 (40%) Needs 2/4 (50%) A., Brennen Exceeds 18/21 (86%) Mastered 5/5 (100%) Needs 4/7 (57%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Brittney Underperformi 12/21 (57%) Needs 2/5 (40%) Mastered 6/7 (86%) Needs 2/5 (40%) Needs 2/4 (50%) A., Cassandra Underperformi 12/21 (57%) Needs 2/5 (40%) Needs 4/7 (57%) Mastered 4/5 (80%) Needs 2/4 (50%) A., Chris Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Christina Meets 15/21 (71%) Mastered 4/5 (80%) Mastered 6/7 (86%) Needs 2/5 (40%) Mastered 3/4 (75%)...the aggregate group (here, it s the district, but it could also be a period or student), and the name of the exam and when it was administered. These are the raw scores, percentage scores, and performance bands per standard for individual students. Class List Report for: Edusoft Public School District Exam: Benchmark #4 Reading Comprehension (Spring 2005) A., Christopher Meets 16/21 (76%) Mastered 4/5 (80%) Needs 5/7 (71%) Mastered 5/5 (100%) Needs 2/4 (50%) April 13, 2005 Page 1 of 11 (40%) Mastered A., Ciasha Underperformi 13/21 (62%) Needs 2/5 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) (60%) Needs 5/7 (71%) Report Options A., Cody Underperformi 13/21 (62%) Needs 3/5 Needs 2/5 (40%) Mastered 3/4 (75%) A., Daniela Meets 14/21 (67%) Needs 3/5 (60%) Mastered Schools: All 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) Ed Programs: All (80%) Grades: Needs All Ethnicities: All A., Deryk Meets 17/21 (81%) Mastered 4/5 5/7 (71%) Mastered 4/5 (80%) Mastered 4/4 (100%) Teachers: All Custom Groups: All Roster: School A., Erica Meets 14/21 (67%) Mastered 4/5 (80%) Needs Courses: All 4/7 (57%) Needs 3/5 (60%) Mastered 3/4 (75%) Year, Spring (40%) Gender: Needs All # Students: 222 A., Erika Underperformi 12/21 (57%) Needs 2/5 5/7 (71%) Needs 3/5 (60%) Needs 2/4 (50%) This report shows highlighting for specific performance bands. This report shows color-coded highlighting for overall scores and per standard scores. Student Performance Student Overall Performance GROUP AVERAGE Meets Expectation Grade 9/10Reading:2.1(2, 3, 4, 12, 16) 15/21 (71%) Mastered 5/5 (100%) Needs Improvemen Grade 9/10Reading:2.3(7, 8, 10, 13, 15, 18, 19) Grade 9/10Reading:2.4(5, 6, 9, 14, 21) Grade 9/10Reading:2.5(1, 11, 17, 20) 2/7 (29%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Aaron Meets 15/21 (71%) Mastered 4/5 (80%) Needs 5/7 (71%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Abigail Meets 14/21 (67%) Needs 3/5 (60%) Needs 3/7 (43%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Adriana Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Adrianna Meets 15/21 (71%) Mastered 4/5 (80%) Mastered 6/7 (86%) Needs 3/5 (60%) Needs 2/4 (50%) A., Alejandro Exceeds 20/21 (95%) Mastered 4/5 (80%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Alicia Meets 15/21 (71%) Needs 3/5 (60%) Mastered 6/7 (86%) Needs 3/5 (60%) Mastered 3/4 (75%) A., Amber Exceeds 18/21 (86%) Needs 3/5 (60%) Mastered 7/7 (100%) Mastered 5/5 (100%) Mastered 3/4 (75%) A., Araceli Meets 14/21 (67%) Mastered 5/5 (100%) Needs 5/7 (71%) Needs 2/5 (40%) Needs 2/4 (50%) A., Brennen Exceeds 18/21 (86%) Mastered 5/5 (100%) Needs 4/7 (57%) Mastered 5/5 (100%) Mastered 4/4 (100%) A., Brittney Underperformi 12/21 (57%) Needs 2/5 (40%) Mastered 6/7 (86%) Needs 2/5 (40%) Needs 2/4 (50%) assessment.lausd.net About Benchmark reporting 37

42 Edusoft LAUSD The top row in the Student Performance area shows average scores for the students you selected for this report. The remaining rows show the scores for individual students and the percent of students in each performance band. When would I use this report? You might use this report aggregated by period if you re a department chair about to meet with first year teachers to review the benchmark results for their classes. You might use this report to get a grade book view of how all your students are performing with average and individual scores side by side, broken down by standard. You might use this report with highlighting to focus on students within one or more performance bands. You might use it with overall color coding to see at a glance the distribution of students in each performance band. See Creating a Class List report on page 42 for more information. About Student Performance reports Student Performance reports let you see how a single student is doing across multiple assessments. Depending on the type of exam, you can see percent scores, raw scores, and performance bands for the overall assessment, for individual standards, and/or for question groups on exams that you select. You can choose to display the report as a web page, a printer-friendly (PDF) format, or save it as an Excel spreadsheet. This area shows information about the individual student. If you selected State exams, you see the scores for them here. If you selected Benchmark exams, you see the scores for them here. Aldo Dow Student Performance Report Date: May 23, 2006 Student ID: School: Grade: State Tests Pine Grove Elementary 3 Benchmark Assessments ELA Grade 3 Reading Diagnostics 1 ELA Grade 3 Reading Diagnostics 2 Admin Date Admin Date Last Score Date Performance Band September 03/29/2006 Meets Expectations October 03/29/2006 Exceeds Expectations Score CST - Mathematics (Grade 3) STAR Scaled Score Mathematics 380 Proficient Raw Score % Correct % % For State assessments, you see the scaled score, and in some cases, performance bands. For Benchmark exams, you can choose to see these score types for the overall assessment, for standards, and/or for questions groups. When would I use this report? In a parent-teacher conference, you can use this report to identify strengths and weaknesses, show progress from one exam to another, and explain grades. You might use this report to track progress on critical goals, such as passing a highstakes exam or to detect patterns of performance in different subject areas. At the beginning of the year you might use this report to place students based on their strengths and weaknesses. 38 Creating Benchmark Reports LAUSD Help Desk:

43 Training Guide See Creating a Student Performance report on page 44 for more information. About School Comparison reports School Comparison reports show you overall, per standard, or per question group scores for each school in a school group. You can schedule these reports for one or more assessments that occur during a given time frame. Note: Edusoft creates a default school group that consists of all schools in your district. Your district may have other school groups defined. If you selected State assessments, you see the student s scores for them here. The title shows the test name, administration date, and the type of scores. The first row of each report displays a summary for all students in the district. The second row shows scores for the current school group. The remaining rows show scores for each school in the school group. Notes at the bottom of the page describe the contents of the report as well as the standards covered in the exam. This is the current school group. This is the location of the test in the Assessment Locker. These are overall scores. This is a summary of students in the district who took the exam. These are the scores for a school in the school group. This is a summary of all students in the school group who took the exam. When would I use this report? You might use this report to compare the performance of different schools on a district-wide assessment. You might use this report to get a snapshot of how all the students in your district or in a school group performed on an assessment. See Creating a School Comparison report set on page 45 for more information. assessment.lausd.net About Benchmark reporting 39

44 Edusoft LAUSD Creating a Performance Band report Performance Band reports show you the big picture either the number and percent of students in each performance band, or the average scores and performance bands broken out for standards or question groups. You can create Performance Band reports for all students, for each period, or for individual students. In addition to overall scores, Performance Band reports can display scores by standard and by question group. You can also display item analysis and select the percentage of items to highlight as underperforming. To create a Class Test Detail or Performance Band report: 1 Click the Benchmark Exams tab. Click the link or icon for Reports. 2 Click the Performance Band Report link or icon. The Select an Exam for Reporting page lists all benchmark assessments from your Assessment Locker. 3 Choose a folder and an exam to use as the basis for this report. Click Continue. 4 In the General Report Options area, choose the level of aggregation for this report. Choose All students Each school group Each period Each student To create A single report that shows scores for all students in the group you select who took the test. One report page for each school group you select, if you have access to more than one group. One report page for each period you select. One report page for each student in the group you select. 5 Click check boxes to display per standard and question group scores. If the test is not set to Show Overall Performance on Reports, you must check at least one of these boxes. If you display per standard or question group scores, you can choose how to display them. 6 Choose a display option for per standard and question group scores. Choose this option Show the number of students in each band Show the average score for each category To display The number and percent of students that fall into each performance band. This is the classic Performance Band report. The performance band for the average scores for each standard or question group. This is similar to the old Test Detail report. 40 Creating Benchmark Reports LAUSD Help Desk:

45 Training Guide 7 In the Item Analysis area, turn on the Item Analysis and highlighting display if you wish. If you include highlighting, choose the percentage of questions to highlight. Click Continue. Click to turn on Item Analysis. Click to highlight selected questions. Choose which questions to highlight. Note: If necessary, you can choose school groups the same way you choose schools. 8 To choose schools, click a button to choose All schools, One school, or Multiple schools. For a specific school, choose it from the list. For multiple schools, click Select Schools, click check boxes for the schools you want to include, and click Continue. 9 To choose periods, click Select Periods in the Choose Periods area. Click check boxes for the periods you want to include. Click Continue. Administrators can choose from a list of all teachers and their class periods. Teachers can select from their own class periods. 10 Use the Select Students Based On links to select a group of students. Click a link in the Select Students Based on area. Select one or more options. Click Continue to save your selection. Or, click Continue without selecting any check boxes to select all options on the page. Tip: Click the Tell Me More link for more information about selecting students using these options. After a brief pause, Edusoft displays your report in the form of a PDF file you can view using the Adobe Reader. important! Be sure to use the Print icon in the Adobe Reader toolbar, and not your browser s menu commands, to print PDF files. Do not use the Print command from your browser s File menu or the Control-P shortcut. You can save the PDF file to your computer before printing. To save this PDF file, click the Save icon. assessment.lausd.net Creating a Performance Band report 41

46 Edusoft LAUSD Creating a Class List report A Class List report displays individual scores for the group of students you select all on one page. In addition to overall scores, this report can display scores by standard or by question groups. You can choose one of three levels of highlighting: no highlighting, highlighting for specific performance bands that you select, or overall color coding for your performance bands. Tip: Highlighting of specific bands is best for grayscale printers and for focusing on specific performance bands. Color coding is best for on-screen viewing when you want to see at a glance how your students are doing, and for color printers. To create a Class List report: 1 Click the Benchmark Exams tab. Click the link or icon for Reports. 2 Click the Class List Report link or icon. The Select an Exam for Reporting page lists all benchmark assessments from your Assessment Locker. 3 Choose a folder and an exam to use as the basis for this report. Click Continue. 4 In the General Report Options area, choose the grouping for this report. If you choose All students Each period You get A single report that shows overall and category scores (by standard or question group) for all students in the group you select who took the test. One report page for each period you select. 5 Choose how to sort the report: by student last name or by overall performance (from lowest overall score to highest). 6 To display either per standard or question group scores, click the In addition check box and choose the type of scores. If the test is not set to Show Overall Performance on Reports, you must select one of these options. Choose either scores by standards or question groups (but not both). 7 Verify that the score types you want to appear on the report are checked. Click to clear the check marks for any score type you do not want shown on the report. Click to clear the check mark next to any score type you do not want to appear on the report. 42 Creating Benchmark Reports LAUSD Help Desk:

47 Training Guide 8 Choose your report highlighting, and click Continue. Choose this option None Specific Bands Color Coded To see No highlighting. Highlighting for just the bands you choose. Click check boxes to select the bands you want to highlight. Color coding for each performance band. Note: If necessary, you can choose school groups the same way you choose schools. 9 To choose schools, click a button to choose All schools, One school, or Multiple schools. For a specific school, choose it from the list. For multiple schools, click Select Schools, click check boxes for the schools you want to include, and click Continue. 10 To choose periods, click Select Periods in the Choose Periods area. Click check boxes for the periods you want to include. Click Continue. Administrators can choose from a list of all teachers and their class periods. Teachers can select from their own class periods. 11 Use the Select Students Based On links to select a group of students. Click a link in the Select Students Based on area. Select one or more options. Click Continue to save your selection. Or, click Continue without selecting any check boxes to select all options on the page. Tip: Click the Tell Me More link for more information about selecting students using these options. After a brief pause, Edusoft displays your report in the form of a PDF file you can view using the Adobe Reader. important! Be sure to use the Print icon in the Adobe Reader toolbar, and not your browser s menu commands, to print PDF files. Do not use the Print command from your browser s File menu or the Control-P shortcut. You can save the PDF file to your computer before printing. To save this PDF file, click the Save icon. assessment.lausd.net Creating a Class List report 43

48 Edusoft LAUSD Creating a Student Performance report Student Performance reports let you see how a single student is doing across multiple assessments. For exams that you select, depending on the type of exams, you can see percent scores, raw scores, and performance bands for the overall assessment, for individual standards, and/or for question groups. Teachers can see scores for State, Benchmark, and Teacher Tools exams for students they have access to. Administrators can see scores for State and Benchmark exams for the students and schools they have access to. You can choose to display the report as a web page, a printer-friendly (PDF) format, or save it as an Excel spreadsheet. To create a Student Performance report: 1 Click the Benchmark Exams tab. Click the link or icon for Reports. 2 Click the link or icon for Student Performance Report. The next page lets you search for a single student or select multiple students to create individual reports for. 3 To run a report for a single student, enter the student s first and/or last name, and/or student ID, and click Search. Otherwise, click Multiple Student Performance Reports. 4 Select the student or multiple students: If you re searching for a single student, click the student you want to select. If you don t find the student you re looking for, enter more criteria and click Search Again. If you re selecting multiple students, choose the school(s), period(s), and students. You can select students in several ways. Select this All students Choose individual students Choose students based on demographic options To Create reports for all students in the selected periods, schools, and districts. To choose specific students from the selected periods, schools, and districts. Click Continue and check the boxes next to the students you want to create reports for. To create reports for students from the selected periods, schools, and districts who meet specific demographic criteria. Click one or more links to choose demographic options, then click Continue after each one. 5 Click Continue to select assessments. 6 Select State or Benchmark assessments by clicking the tab for each type of assessment. 44 Creating Benchmark Reports LAUSD Help Desk:

49 Training Guide If you don t see the exams you re looking for, select another time interval from the drop-down list: 3 months, 6 months, 12 months, or 24 months. 7 For each exam type, check the box next to the exams you want to include, and the scores and score types you want to show on the report. The scores and score types vary depending on the type of exam. 8 Click Next to review your selections, then click Finish. 9 Click an icon to choose a report format: Web page, Spreadsheet, or Printer-friendly. Note: If your browser has pop-up blocking, you will have to temporarily disable it to see the spreadsheet or printer-friendly format. Creating a School Comparison report set A School Comparison report set is a series of reports that show results for a set of exams that you select, during a specific time interval. When you create a report set, you give it a name, select starting and ending dates, and select the tests to be included. Each exam in the set will have a series of reports available on the days you schedule. You can select up to ten tests to include in the report set. Note: Unlike other Benchmark reports, you don t create and view a School Comparison report at the same time. Instead, you define a School Comparison report set that Edusoft runs on the dates you specify. After the report set is run, you can view the reports or download them for later viewing or distribution. See Viewing a School Comparison report on page 46 and Managing report sets on page 47 for more information about working with report sets. To create a School Comparison report set: 1 Click the Benchmark Exams tab. Click the icon or link for Reports. 2 Click School Comparison Reports. Tip: You can also start from the Admin tab and scroll down to the Reporting Options area. Click the View or configure School Comparison Reports link. 3 Click Create New Report Set. 4 Type a name for the report set. 5 Enter or choose starting and ending dates. The ending date must be after today s date. Tip: The end date is the last time this report set will be updated. It s a good idea to choose an end date one week after the last date that any exam from the report set will be administered. 6 Click the check boxes to include assessments in the report set. assessment.lausd.net Creating a School Comparison report set 45

50 Edusoft LAUSD 7 When you have finished selecting exams, click Finish. 8 Choose one or more days for each report set you want to schedule. You can only schedule one report set to be available each day. 9 Click Finish. Viewing a School Comparison report You can view School Comparison reports from within a browser window in the Edusoft Web site or in a Microsoft Excel spreadsheet that you download. To view a School Comparison report: 1 Click the Benchmark Exams tab. Click the link or icon for Reports. 2 Click the School Comparison Reports link or icon. 3 Click a link for the report set you want to view. The report set page lists a separate report for each exam in the report set. Select a school group. These labels may be different for your district. Links for overall scores appear if the exam is set to show overall performance. Each exam in the testing wave appears in its own row. You can view scores for one exam at a time. Click to view this report. Click to download this report. 4 Click a link to view or download a report. To view scores in your browser window, click the View link for a report. To view scores in an Excel worksheet, click the Download link for a report, choose where to save the report, and open the report in Microsoft Excel. 46 Creating Benchmark Reports LAUSD Help Desk:

51 Training Guide There are three types of School Comparison reports. Each one has the performance band that contains the most students highlighted, and shows the total number of students who took the exam, as well as the number of students in each performance band. Choose this report Overall To view Overall scores by performance band for the district as a whole, for the school group you selected, and for each school in that school group. These are overall scores. Standard This is the total number of students with scores. The highlight shows the performance band with the most students. Scores by performance band for each standard, for the district, the school group, and each school. These are scores for one standard. Other columns show scores for additional standards. Question Groups Scores by performance band for each question group (defined by your district), for the district, the school group, and each school. Managing report sets 5 To view this report for a different school group, select one in the School Group list. For more information, see About School Comparison reports on page 39. You can view the details of the report set, edit the report set, or change the scheduling whenever you wish. You can also delete report sets you no longer need. To manage report sets: 1 Click Benchmark Exams, click Reports, and click School Comparison Reports. 2 To delete a report set, click the trash can icon to the left of the report name. Edusoft warns you that there may be reports associated with the report set. assessment.lausd.net Creating a School Comparison report set 47

52 Edusoft LAUSD 3 To edit scheduling for report sets, click Edit Scheduling. Add or remove days of the week. Click Save Scheduling. 4 To edit a report set, click the Details link for the report set you want to work with. 5 Click Edit. Make any necessary changes, and click Continue. Adjust the scheduling if necessary and click Finish. 48 Creating Benchmark Reports LAUSD Help Desk:

53 chapter 5 Analyzing Assessment Items For the results of an assessment to be meaningful, educators must have confidence in the quality of the questions asked in the assessment. For this reason, Edusoft lets you analyze the validity of benchmark assessments as a whole and of specific items using standard measurements for reliability, difficulty, and discrimination. The Item Analysis report helps you identify items that are too easy, too challenging, or possibly misleading. You can identify specific areas where students are struggling. Or, you can compare the performance of different groups of students to determine, for example, if there is ethnic bias in certain questions, or how a specific group is doing relative to the school as a whole or district-wide grade level. In addition to gauging the validity of tests, Edusoft helps you evaluate the instructional relevance of each item in an assessment and understand the strengths and weaknesses of individual students. The Item Response report, designed primarily for teachers, shows you how individual students responded to each item on a test and highlights areas where students are experiencing difficulty. This report also highlights the most commonly selected distractors for multiple choice items. These are the topics in this chapter: About Item Analysis reports on page 50 Selecting items for analysis on page 51 Viewing and interpreting Item Analysis reports on page 53 About Item Response reports on page 57 Creating an Item Response report on page 58 assessment.lausd.net Analyzing Assessment Items 49

54 Edusoft LAUSD About Item Analysis reports An Item Analysis report serves two basic purposes: to help you determine the validity of an assessment and to identify both the concepts students are struggling with and why they misunderstood. To determine the validity of an assessment and its items, Edusoft calculates item difficulty, discrimination, P-Biserial, and KR-20 values. To determine the areas where students are struggling, Edusoft lets you drill down to the list of students who gave each answer for an assessment item. The Options Dashboard shows the current student selection criteria. Item Analysis reports contain answer breakdown areas for each type of question on the exam. You can use the answer choice breakdown area to drill down to a list of students who chose specific answers. For multiple choice questions, you can see how many students selected each possible answer. The answer breakdown choices for short answer questions are correct and incorrect. The answer breakdown choices for long answer questions are the possible point values. The item analysis report is interactive: you can group questions in the order in which they appear on the exam, by the standards they cover, or by any question groups defined for the assessment; you can show raw numbers or percents in the answer choice breakdown; and you can sort the report by any of the columns it displays. 50 Analyzing Assessment Items LAUSD Help Desk:

55 Training Guide See Selecting items for analysis on page 51 for instructions on creating this report. See Viewing and interpreting Item Analysis reports on page 53 for a description of how to work with an Item Analysis report. Selecting items for analysis When you select items for analysis, you begin by selecting the assessment. You can use any benchmark exam in your Assessment Locker that has scores associated with it. Next, you select the students whose items you want to see. You can view items for all students who took the assessment or select a group of students based on teachers and periods. In either case, you can filter your choices by grades, ethnicities, Ed programs, genders, courses, and rosters. To select items for analysis: 1 Click the Benchmark Exams tab. Click the link or icon for Item Analysis. The Item Analysis page appears. 2 Click the Item Analysis Report link or icon. The Item Analysis Report page lists all benchmark assessments from your Assessment Locker. 3 Choose a folder and an assessment, and click Continue. Note: If necessary, you can choose school groups the same way you choose schools. 4 To choose schools, click a button to choose All schools, One school, or Multiple schools. For a specific school, choose it from the list. For multiple schools, click Select Schools, click check boxes for the schools you want to include, and click Continue. Tip: To generate an item analysis report quickly, simply click Continue to view the results for all students who took the exam. You can refine the group of students later, if you want. See Viewing and interpreting Item Analysis reports on page To choose periods, click Select Periods in the Choose Periods area. Click check boxes for the periods you want to include. Click Continue. Administrators can choose from a list of all teachers and their class periods. Teachers can select from their own class periods. 6 If needed, use the links in the Select Students Based On area to select grades, ethnicities, Ed programs, custom groups, genders, courses, or rosters. assessment.lausd.net Selecting items for analysis 51

56 Edusoft LAUSD You can choose as many or as few demographic options as you need. As you choose demographic options, you can see the number of students that currently match your choices in each of the Select Students Based On pages. You can clear all of your choices at any time. Tip: Click the Tell Me More link for more information about selecting students using these options. 7 When you have finished selecting options, click Continue. Edusoft processes your request and, after a brief pause, displays the Item Analysis report. See Viewing and interpreting Item Analysis reports, next, for more information. 52 Analyzing Assessment Items LAUSD Help Desk:

57 Training Guide Viewing and interpreting Item Analysis reports The item analysis report consists of the options dashboard at the top, and an item analysis section for each type of question (multiple choice, short answer, and long answer). It also displays values for quality measurements that Edusoft calculates. Administrators can view item analysis for multiple teachers classes. You can use the Options Dashboard to view results for other students. Click to view definitions of terms used in this report. You can sort a section using its sort by link. The correct answers for multiple choice questions are bolded and marked with an asterisk (*). Select how to group items. This is the number of students in the current sample. You can use the answer choice breakdown area to drill down to a list of students who chose specific answers. The answer breakdown choices for short answer questions are correct and incorrect. The answer breakdown choices for long answer questions are the possible point values. When viewing an Item Analysis report, you can: Display questions numerically by test section as they appeared on the exam, by the standards they cover, or by question groups. See Changing item grouping on page 54. Sort by each of the columns in the report: item, difficulty, discrimination, and specific answer choices. See Sorting item columns on page 55. View the answer choice breakdown by raw number, percent, or P-Biserial discrimination. See Changing the display of answer breakdown data on page 55. assessment.lausd.net Viewing and interpreting Item Analysis reports 53

58 Edusoft LAUSD Drill down for each item to view lists of students who made each possible answer choice. See Drilling down to student lists on page 56. Once you generate a report, you can use the Options Dashboard at the top of the page to select a different group of students for analysis. You might, for example, view students of a particular ethnicity to look for unexpected trends. Or, you might compare the results for one group of students against all students who took the exam. What constitutes quality items? There are a number of ways to evaluate assessment items, all of which work together to provide a profile of specific items and the assessment as a whole. This table summarizes the measurements that Edusoft makes. For this measure Look for a value of Kuder-Richardson 20 (reliability) At least 0.6, preferably 0.8 or more. The higher the value, the more reliable the exam. % Correct Between 20% and 80%. The higher the value, the easier the question. For an exam designed to measure broad skill areas, look for an average of 50%. For an exam designed to identify subject mastery, look for an average 70% or higher. Discrimination 0.3 or higher. This indicates a good correlation between success on a question and success on the assessment as a whole. A negative value indicates a level of ambiguity or irrelevance in the question. Questions with a value of between 0.0 and 0.15 could benefit from an editorial review. P-Biserial discrimination 0.2 or higher for the correct answer. Expect incorrect answers to have negative values. Available for multiple choice questions only. Changing item grouping You can group the items in the item analysis area by section, by standards, or by question groups. Group by Section lists items in numerical order, divided into the same sections in which they appear in the assessment. 54 Analyzing Assessment Items LAUSD Help Desk:

59 Training Guide Group by Standard lists items by the standards they cover. Group by Question Groups lists items by the question groups that were defined for the assessment. You can group by question group only if question groups have been defined for the assessment by an administrator. The item analysis report is initially grouped by section. You might find it more valuable, however, to view the list by question group or standard. These choices are likely to segment the list into logical pieces or reporting categories. To change item grouping: In the item analysis report, select a grouping in the Group By list. Click Go. Note: The Group by Question Group option appears only if question groups have been defined for the assessment. Edusoft displays the grouping you selected. Items grouped by section show the section name and item number in the Item column. Items grouped by standards show the standard number in the Standards column to the left of the Item column. Items grouped by question group show the name of the question group in the Question Groups column. Sorting item columns You can sort items by any of the columns in the Item Analysis list. Edusoft remembers your sorting selections. If you sort by difficulty and then by discrimination, the results are sorted first by discrimination (the last choice you made) and then by difficulty (the previous choice). To sort item columns: 1 To sort the contents of the items analysis list by the contents of a column, click the column s sort by link. 2 To sort items in the reverse order, click the column s sort by link a second time. Note: Selecting a new Group By setting automatically re-sorts the list by section, standard, or question group. Changing the display of answer breakdown data Answer breakdown data displays the choices that students made on the benchmark exam. Edusoft displays three types of answer breakdown data for assessment items one for each type of question that can appear in a benchmark exam all on the same page. assessment.lausd.net Viewing and interpreting Item Analysis reports 55

60 Edusoft LAUSD While viewing answer breakdown data, you can view scores as raw numbers or as percents whichever you prefer. For multiple choice questions, you can also view the P-Biserial discrimination value for each item. Edusoft initially displays raw numbers. To change the display of answer breakdown data: Click the Raw Number, Percent, or P-Biserial link to display data in that format. Drilling down to student lists Edusoft helps you drill down into the details behind the answer breakdown data to identify the reasons for anomalous results. Using this information, you can pinpoint flawed questions or students who are struggling with specific material. Each score in the answer breakdown area is a link that displays the names of the students who selected that choice or received that score. The student list displays the student s name, school, teacher, grade, and score. You can sort the list by any of these columns. From the student list, you can drill down even deeper, to see test data for any one student with incorrect answers highlighted. To drill down to student lists: 1 Click the link for a value in the answer breakdown area. Edusoft displays a list of students who selected that answer or received that score. You can sort the contents of the list using any of the sort by links. This area lists the number of students who answered the question with the selected answer and the item difficulty. This area lists the students who selected the specified answer or received that score. Click a link to display a list of students who chose this answer. Click a link to sort the list by the contents of a column. 2 To see the details for any student in the list, click the link for the student s name. Edusoft displays the test data (answers and scoring) for the student you selected. Incorrect answers are highlighted in orange. 3 Use the Back links to return to the item analysis report. 56 Analyzing Assessment Items LAUSD Help Desk:

61 Training Guide About Item Response reports Like an Item Analysis report, an Item Response report focuses on the choices students made on tests. But unlike the Item Analysis report, which focuses on the validity of items for a group of students, an Item Response report displays the responses that each student has given for each item on an exam. The Item Response report is designed to allow teachers to assess both the item s usefulness and each individual student s performance. It also provides insight into what students were thinking when they took the exam and provides the information you need to formulate reteaching strategies and start targeted remediation. And for multiple choice questions, the Item Response report also helps with distractor analysis. assessment.lausd.net About Item Response reports 57

62 Edusoft LAUSD Highlighting allows you to see patterns in student responses by period or for all students who took a test. The Dashboard shows the current student selection criteria. Orange highlighting shows the questions where students scored below the threshold you set. The summary shows the percent of students who answered correctly, the total possible points, and the correct answer for multiple choice items. The per-student breakdown shows each student s raw score, percent correct, and responses to each question. Raw scores and percent correct appear only for tests set to show overall performance on reports. The legend shows what the symbols and highlighting mean. The standards covered in the exam appear at the bottom of the report. Blue highlighting shows the most commonly selected incorrect multiple choice answer for the period or group of students. For short answer items, a indicates a correct answer. An x indicates an incorrect answer, and a dash (-) indicates no answer. For long answer items, you see the points each student received. These are the questions aligned to this standard. See Creating an Item Response report, next for instructions on running this report. Creating an Item Response report When you create an Item Response report, you can make a number of formatting choices that affect the content and organization of the report. For example, you can choose the type of questions to include, whether to group data by periods, and how to sort both students and questions. You also have a choice of three different formats for displaying the completed report: in a web browser, as a PDF report for printing, or as an Excel spreadsheet for downloading. 58 Analyzing Assessment Items LAUSD Help Desk:

63 Training Guide To create an Item Response report: 1 Click the Benchmark Exams tab. Click the link or icon for Item Analysis. 2 Click the Item Response Report link or icon. 3 Choose a folder and an assessment, and click Continue. 4 In the General Report Options area, choose the level of aggregation for this report. Choose All students Each period To create A single report that shows responses for all students who took the test in the group you select. One report section for each period you select. If you highlight incorrect answers, you ll see the commonly-selected distractors for each period. 5 Choose how to sort students and how to sort or group questions. Click check boxes to display multiple choice, short answer, and long answer responses. You can sort students by last name or by overall performance. For example, if you want to focus on response patterns, you might sort by overall performance. Sorting by last name gives you more of a gradebook view. You can sort by item number, by standard, or by question group. 6 To display a student ID, click the Include check box and choose the type of ID. 7 In the Choose Highlighting area, click the check box to include highlighting and choose the highlighting threshold. Click Continue. The highlighting threshold sets the percent of correct answers that serves as the cut-off for highlighting. For example, if you choose 70%, you see highlighting on all items where the fewer than 70% of the students answered correctly. For multiple choice questions, highlighting also identifies the most commonly selected distractor. Note: If necessary, you can choose school groups the same way you choose schools. 8 To choose schools, click a button to choose One school or Multiple schools. For a specific school, choose it from the list. For multiple schools, click Select Schools, click check boxes for the schools you want to include, and click Continue. 9 To choose periods, click Select Periods in the Choose Periods area. Click check boxes for the periods you want to include. Click Continue. Administrators can choose from a list of all teachers and their class periods. Teachers can select from their own class periods. assessment.lausd.net Creating an Item Response report 59

64 Edusoft LAUSD Administrators can choose from a list of all teachers and their class periods. Teachers can select from their own class periods. 10 If needed, use the links in the Select Students Based On area to select grades, ethnicities, Ed programs, custom groups, genders, courses, or rosters. When you have finished selecting options, click Continue. You can choose as many or as few demographic options as you need. As you choose demographic options, you can see the number of students that currently match your choices in each of the Select Students Based On pages. You can clear all of your choices at any time. Tip: Click the Tell Me More link for more information about selecting students using these options. 11 In the Choose a Report Format page, choose how you want to display the completed report. Click Web page Spreadsheet Print-friendly To see the report In your browser window. This format is good for online viewing. As a Microsoft Excel spreadsheet. This format is useful when you want to do more sophisticated data analysis or printing. For example, you might want to graph the most common distractors or do additional pattern analysis. When you choose this option, you choose whether to view the spreadsheet file or save it to your computer. If you save the file, you specify a location. You can then open the file in Excel and work with the report contents. As a PDF file in your browser window. If you create the report for periods, each period appears on a separate page. This format is useful for printing reports to distribute to teachers or for per-period analysis. Edusoft processes your request and, after a brief pause, displays the Item Response report in the format you selected. See About Item Response reports on page 57, for more information. 60 Analyzing Assessment Items LAUSD Help Desk:

65 chapter 6 Defining Intervention Groups The ability to quickly identify a group of students who require intervention of some type is a powerful tool for educators. Intervention might be in the form of additional instruction or student support services that address barriers to improved academic performance. Or, you may simply want to identify top-performing candidates for an after-school peer-tutoring program. For this reason, Edusoft makes it easy to identify groups of students based on their overall, per-standard, or question group assessment scores. Then, you can use demographic criteria such as gender, ethnicity, or educational programs to further refine membership in the group. Once you identify an intervention group, you can create a custom group. Edusoft custom groups are similar to educational programs you can use the custom group any time you select students for reports. And for even more in-depth analysis, you can copy the contents of an intervention group report and paste them into a spreadsheet. These are the topics in this chapter: About intervention groups on page 62 Defining an intervention group on page 62 Refining membership in an intervention group on page 66 Creating a custom group from an intervention group on page 66 assessment.lausd.net Defining Intervention Groups 61

66 Edusoft LAUSD About intervention groups Edusoft lets you isolate a group of students who meet customizable performance criteria so that you can take action. Educators use Edusoft intervention groups for a variety of reasons. For example, you might want to locate students: Who need assistance for an after-school tutoring program. Who qualify for a Title I-funded math intervention program. Who are on the bubble of a performance band and who could, with a little help, break through into the next higher performance band. Whose performance makes them candidates for accelerated instruction or next year s gifted and talented program. The criteria you use to select students for an intervention group are highly flexible. You can identify students based on their performance on a single assessment or on a combination of two assessments. For each assessment, you can look at overall scores, per standard scores, or scores for any question groups that may have been defined. For example, you might want to identify students who are struggling with a specific group of math concepts or students who are consistently just below grade-level in reading comprehension. When you are satisfied that you have identified the correct group of students for intervention, you can create a custom group to track the progress of those students in the same way that you use educational programs or other demographic criteria. Defining an intervention group Defining an intervention group is similar to creating a benchmark-based Edusoft report. You define the group by: Selecting an exam. Deciding whether to analyze data from one exam or two. Selecting which scores to use as the basis for analysis (overall scores, standards, or question groups). Selecting any demographic options to further pinpoint the students who would benefit from intervention. Specifying the intervention criteria in the form of a percentage range or performance band if you are basing this group on one exam. If you are using two exams, you select the second exam and the criteria for both exams. To define an intervention group: 1 Click the Benchmark Exams tab. Click the link or icon for Intervention Groups. 62 Defining Intervention Groups LAUSD Help Desk:

67 Training Guide The Select Exam page lists all benchmark assessments from your Assessment Locker that have been administered and scored. 2 Choose the exam to use as the basis for the intervention group. Click Continue. 3 If you have access to data at more than one school, choose one or more schools. Depending on your access, you can choose one school, multiple schools, or all schools. To choose one school or all schools, choose an option in the School list. To choose more than one school, click the Select Multiple Schools link. Click the check boxes for the schools you want to include and click Continue. 4 Choose whether to analyze the scores from one exam or two. If you select two exams, Edusoft selects the students who match the criteria you specify for both exams. 5 Select which scores to use as the basis for this intervention group in the Analyze Based On list. Note: You can display performance by question groups only if question groups have been defined for the assessment. 6 Select the type of score you want to include in the analysis. You can choose to include the raw score, percent correct, performance band, or all three. 7 If you want to include the student ID on the report, click Student ID and then choose the type of ID you want to show. This is particularly useful if you plan to copy data from the intervention group and paste it into a spreadsheet. If you are not sure which ID your district uses, contact your district administrator. 8 To filter the list of students, use the links in the Select Students Based On area to select grades, ethnicities, Ed programs, custom groups, genders, courses, or rosters. Tip: Click the Tell Me More link for more information about selecting students using these options. You can choose as many or as few demographic options as you wish. Edusoft remembers your choices as you move from one option to another. As you choose demographic options, you can see the number of students that currently match your choices in each of the Select Students pages. You can clear all of your choices at any time. 9 When you have finished selecting options, click Continue. The next step depends on the number of exams and the type of scores you selected. If you are basing the intervention group on scores from one exam, go to Selecting intervention criteria for one exam, next. assessment.lausd.net Defining an intervention group 63

68 Edusoft LAUSD If you are basing the intervention group on overall scores from two exams, go to Selecting intervention criteria for two exams on page 64. Selecting intervention criteria for one exam If you are basing the intervention group on one exam, the Intervention Criteria page appears. The page you see depends on the type of scores you are using. For per standard or question group scores, you select the standards or question groups, and then you select the percentage or performance bands for each standard or question group. Start with step 1. For overall scores, you select the percentage or performance bands. Skip step 1 and start with step 2, below. To select criteria for one exam: 1 For per standard scores or question group scores, click the check boxes for the standards or question groups you want to include, and then click Continue. 2 Enter two numbers that define a range of scores, or click the check boxes for scores that fall within performance bands. Selecting a range of points gives you flexibility to select scores anywhere in the spread. If you selected more than one standard, enter the percentage range or performance band for each standard. Selecting performance bands is a fast way to pull scores that align to a grading rubric. 3 Click Continue. After a brief pause, Edusoft displays the intervention group report. Selecting intervention criteria for two exams If you are using scores from two exams, the next step is to select the second exam. Then, you select the intervention criteria. Remember, the intervention group will contain only those students who match your criteria for both exams. To select criteria for two exams: 1 In the Select Exams page, choose the second exam to be considered and click Continue. The Intervention Criteria page appears. The page you see depends on the type of scores you are using. For per standard or question group scores, you select the standards or question groups, and then you select the percentage or performance bands for each standard or question group. Continue with step 2. For overall scores, you select the percentage or performance bands. Skip step 2 and continue with step 3, below. 64 Defining Intervention Groups LAUSD Help Desk:

69 Training Guide 2 For per standard scores or question group scores, click the check boxes for the standards or question groups you want to include for each exam (you can click as many check boxes as you need), and then click Continue. The second Intervention Criteria page appears. You use this page to specify the scores you want to use. 3 For each exam, enter two numbers that define a range of scores, or click the check boxes for scores that fall within performance bands. Selecting a range of points gives you flexibility to select scores anywhere in the spread. For example, you could select a range of scores that falls at the top of a performance band to identify students on the bubble for the next higher band. Selecting performance bands is a fast way to pull scores that align to a grading rubric. Be sure to select standards or question groups for both exams. This area shows the basis for the analysis: Overall, Per Standard Performance, or Per Question Group. Type two scores to define a range. Click check boxes to select one or more performance bands. This name in this area changes to reflect the criteria you are using: Overall, Per Standard Performance, or Per Question Group Performance. 4 Click Continue. After a brief pause, Edusoft displays the intervention group report. Skip to Viewing the intervention group page, next. Viewing the intervention group page The Options Dashboard at the top of the intervention group page shows which demographic options were used to select students. The Intervention Group section shows a list of all students who meet the criteria for the group. assessment.lausd.net Defining an intervention group 65

70 Edusoft LAUSD For each student, you can see student ID, the school attended, the grade, and the name of the teacher who administered each exam. You can also see the raw and percent scores for each exam. Because of the way information is arranged on this report, it s a simple matter to select it for copying and pasting into a spreadsheet. Refining membership in an intervention group The Options Dashboard at the top of the intervention group page displays the same options that were available when you first defined the intervention group report. To analyze different results: 1 Click a link in the Options Dashboard. 2 Click check boxes in the options page for the students you want to include, and click Continue. Or, click the Clear Page link and click Continue to select all options on a page. The Options Dashboard displays the new selections, and the intervention group report displays the corresponding data. Creating a custom group from an intervention group A custom group is composed of students you want to track together for some reason. Once you define a custom group, you can use it to select students for analysis or reports. To create a custom group from an intervention group: 1 Click the Create a Custom Group link on the intervention group page. 2 Type a name for the group and a description. 3 Choose a privacy setting. Choose Private to create a group for your own use. Only you will know it exists. Choose Public to create a group that others in your school or district can view (they won t be able to make changes to the group). 4 If you are responsible for more than one school, select the school for this custom group. 5 Click Continue. Edusoft confirms that the group has been created. You can add or remove students in the new custom group or return to the intervention group you were working with. 6 Click Add or Remove Students from this Custom Group to add students to the group. The Custom Group Properties page appears showing a list of all the students in the group. 66 Defining Intervention Groups LAUSD Help Desk:

71 Training Guide 7 Click Finish at the top of the Custom Group Details page if you don t want to make any further changes. At this point, you could also remove students from the list, add more students, or change the custom group properties. assessment.lausd.net Creating a custom group from an intervention group 67

72 Edusoft LAUSD 68 Defining Intervention Groups LAUSD Help Desk:

73 chapter 7 Generating Instructional Worksheets Edusoft helps teachers and administrators create standards-based prescriptive instructional worksheets for one or more students based on their performance on tests. Instructional worksheets are based on one or more exams your students have taken, and can include missed test questions, instructional resources available in your district textbook references, lesson plans, activities, practice exercises, and teaching aids and additional retesting items that are aligned to the standards covered in the exams. Edusoft creates separate student and teacher worksheets in the form of PDF files that you can print and distribute as needed. In addition to the items and resources that students see, teachers worksheets also contain answers to reassessment items and any available lesson plans and professional development resources. These resources support your reteaching strategies for areas that need special attention based on recent test results. You can also include Benchmark exams that your students have taken.as an administrator, you can base instructional worksheets on any Benchmark exam that teachers at your school or in your district have administered to their students. These are the topics in this chapter: About creating instructional worksheets on page 70 Instructional Tool has a new look on page 71 Creating instructional worksheets on page 72 assessment.lausd.net Generating Instructional Worksheets 69

74 Edusoft LAUSD About creating instructional worksheets Edusoft helps you create worksheets designed to help students improve their performance on specific standards. For example, after administering an exam, teachers can determine which standards are giving students the greatest difficulty. They can then create, print, and distribute customized instructional worksheets based on how students performed. Administrators can generate worksheets for several classes at once. Instructional worksheets can include missed exam questions (with or without correct answers), references to textbook pages or other supplemental materials, practice problems in textbooks, or supplemental materials. They can also include new test questions (reassessment items) from any available item banks. This is a sample teacher s worksheet for third graders based on two reading exams. The worksheet includes missed exam questions (with answers), references to instructional resources, and reassessment items. Review Materials Teacher Guide December 22, 2005 ExamsCovered: ELAGrade3ReadingDiagnostics2-October,ELAGrade3Reading Word Recognition Teacher: Period: Grade 3 / Grade 3 Advanced Options: Teachers: Lori Y. Ed Programs: All Periods: All Custom Groups: All Ethnicities: All Gender: All Standard covered in this worksheet page. You see a separate page for each standard. Missed exam questions for this standard. On a period or group worksheet, you see the questions that most students missed. On individual worksheets, you see the questions that each student CCS English Grade Three Reading 1.2: (Avg. 70%) Decode regular multisyllabic words. Missed exam questions ELA Grade 3 Reading Word Recognition Section 1 5 (Avg. 63%) Which word has three syllables? (a) multiply (b) explain (c) greener (d) intersection Answer: (a) Lesson Plans Match the Syllables - Activity Resource Group: HMCO Reading Resources Activities Handout: Word Finds Resource Group: Materials aligned by users in your district Visit the resource bank to find 1 document attached to this resource. Find and circle the words hidden in the puzzle. Skill level not indicated Language not indicated missed. Print each of the following words on an unlined index card: list, sea, dog, fish, doorway, problem, music, enough, difficult, important, beautiful, remember. Mix the cards and turn them face down on the floor. The Teacher: first player turns up two cards. If the words on the two cards have the same number of syllables, the child keeps the cards and takes another turn. If the Period: Grade 3 / Grade 3 words on the two cards do not have the same number of syllables, the next child takesreassessment a turn. The winner Items is the child Instructional resources with the most cards after all cards have been claimed. for this standard. Multiple Intelligence Preference: Interpersonal Edusoft Item Bank ID Duration: 20 minutes 1) In which of the following word pairs below Materials: unlined 3 by 5 inch cards, marker do the underlined consonants sound different from each other? (a) large; larger (b) require; requirement On Level (c) pick; Englishpickiest (d) space; spacious Answer: (d) Reassessment items from the Edusoft Item Bank 70 Generating Instructional Worksheets LAUSD Help Desk:

75 Training Guide Note: You can display only exam questions that originated in an item bank. If you aligned an existing exam, you will only be able to display the correct answer choice, but not its content. When you align an exam, you align answers to answer sheets; the questions do not enter the system. Instructional Tool has a new look All of the instructional resources you ve come to rely on for targeted intervention are still available through the Edusoft Instructional Tool. However, we ve streamlined and simplified the process of creating instructional worksheets to make it easier to produce the worksheets your students need. Previously Teachers could only create worksheets based on one type of assessment Benchmark exams or teachers classroom tests. Now Teachers can create a single set of worksheets for any combination of tests their students have taken. Administrators can create worksheets based on Benchmark exam data. assessment.lausd.net Instructional Tool has a new look 71

76 Edusoft LAUSD Previously You created a worksheet within the module where the exam was administered. Now Teachers can start in Benchmark Exams or Teacher Tools and access data from both modules on the same worksheet. Teachers can choose both Benchmark exams......and their own classroom tests for a single worksheet. You worked with a single pool of resources for all standards covered on the exams you selected. You can choose instructional resources based on skill levels and languages. Some resources might not have a skill level or language defined. You can preview worksheets by standards and see the resources for each standard and student performance level. Edusoft calculates performance levels based on your underperforming threshold for Benchmark exams. You can view and add resources by standard......and by skill level. Creating instructional worksheets There are several steps involved in creating instructional worksheets. First, you select the type of worksheet your creating: individual worksheets, perperiod worksheets, or just one worksheet for an entire group of students. See Starting a worksheet and selecting a worksheet type, next. Next, you select the students who will receive the worksheets. You can give worksheets to all students at a selected school or in selected periods, to individual students you select, or to a group of students you select based on demographic data or custom groups. See Selecting a set of students on page Generating Instructional Worksheets LAUSD Help Desk:

77 Training Guide Based on the students you select, Edusoft shows you a list of all tests they have taken so you can choose specific tests to base the worksheets on. You can choose any combination of Benchmark exams your students have taken. See Selecting test scores to base worksheets on on page 75. Based on the tests you select, Edusoft shows you a list of the standards they re aligned to so that you can choose which standards you want to cover in the worksheets. See Selecting standards from selected exams on page 75. Based on the standards you choose, Edusoft displays a list of all the types of material that are available in your district so that you can choose the types of materials you want to include on the worksheet. You can include missed questions from the tests you selected, reassessment items aligned to the same standards your students are struggling with, and instructional resources that target areas where your students need assistance. See Selecting worksheet contents on page 76 Next, you review the missed questions, reassessment items, and resources that Edusoft proposes and add or remove items and resources as needed. See Reviewing and customizing worksheets on page 78. Finally, you print worksheets and distribute them to teachers and students. See Printing worksheets for teachers and students on page 79. Starting a worksheet and selecting a worksheet type You can create worksheets for any students at your school or in your district who have taken Benchmark exams. You create worksheets starting from the Benchmark Exams module. The first choice you make is the type of worksheet you want to create or how customized you want the worksheets to be. You can create a custom worksheet for each student, worksheets for each classroom or period, or just one worksheet for everyone. To start a worksheet and select a worksheet type: 1 Click the Benchmark Exams tab. Click the link or icon for Instructional Tool. 2 Choose the type of worksheets you want to create. Choose Individual students Each class or period A group of students To create An individual worksheet for each student. Each worksheet will be based on the student s performance. A per-period worksheet for each class or period. Each worksheet will be based on the overall performance of the class or period. A group worksheet for the all students you select. The worksheet will be based on the overall performance of all the students. assessment.lausd.net Creating instructional worksheets 73

78 Edusoft LAUSD 3 Click Continue to select students. Selecting a set of students Selecting a set of students is the next step in creating instructional worksheets. The choices you make here tell Edusoft which students scores you want to look at and, therefore, which tests to consider (you ll only see the tests that these students have taken). Your students scores also determine the missed questions, reassessment items, and resources that appear on the worksheets. You start by selecting one or more schools (if you have access to more than one) and then you select periods or classes. Then, you select the actual students who will receive worksheets. You can give worksheets to all students in those periods or classes, to specific students you select, or to a group of students you choose based on demographic or roster information. To select a set of students: 1 In the Select Student Set page, choose the schools (if you have access to more than one) and the periods that include the students you want to create worksheets for. If you select periods, click Continue to return to the Select Student Set page. 2 In the Student Selection area, choose the students for this set of worksheets. Click to give worksheets to all students. Click to give worksheets to specific student you select. Click to give worksheets to students you select based on demographic options. To choose All students in the schools, periods, or classes you ve just selected Specific students Do this 1 In the Student Selection area, click All Students. 2 Click Continue. 1 Click Choose Individual Students. 2 Click Continue. 3 In the Choose Individual Students page, click check boxes for the students you want to include. 4 Click Continue. 74 Generating Instructional Worksheets LAUSD Help Desk:

79 Training Guide To choose A group of students Do this 1 Click Select Students Based on Demographic Options. 2 Use the links in the Select Students Based on area to select the students you want to include. Note: Click the Tell Me More link for more information about selecting students using these options. 3 Click Continue. Selecting test scores to base worksheets on The next step is to choose the tests that the worksheets will be based on. Edusoft uses your students performance on the tests you select to help determine the contents of a worksheet. If you include missed questions, they come from these tests. Likewise, the standards covered on the tests determine which resources and reassessment items you can use. Edusoft displays the Benchmark exams your students have taken. For each exam, you can see how many students from your selected group have scores. To select test scores to base worksheets on: 1 In the Select Assessments page, click a check box to select one or more exams. If you re a teacher, you see both Benchmark exams and tests from your Teacher Tools Assessment Locker. If you re an administrator, you see only Benchmark exams. 2 Click Continue to select the standards you want to use for the worksheets. Selecting standards from selected exams Based on the exams you select, Edusoft compiles a list of the standards that were covered in those exams. You can select both the number of standards per student (or group of students) as well as the specific standards to be included. The standards you select determine which resources and reassessment items are available. Edusoft prioritizes the standards covered on the exam based on student performance, starting with the lowest scores. Standards where students fell below your Benchmarks underperforming threshold appear in red. On individual worksheets, Edusoft uses the standards where the student is having the most trouble from among the list you select. assessment.lausd.net Creating instructional worksheets 75

80 Edusoft LAUSD To select standards from selected tests: 1 In the Select Standards page, click check boxes for the standards you wish to include or remove from the list. The average scores in red indicate standards where student scores fell below your Benchmarks underperforming threshold. 2 Select the number of standards to be covered for each student or period. Note: If you are creating worksheets for a group, you skip this step. You can include up to ten standards. The more standards you select, the longer the worksheet will be. 3 Click Continue to select worksheet contents. Selecting worksheet contents Based on the choices you make, worksheet contents are divided into three main sections: missed exam questions from the tests, reassessment items (items from any available item bank that are aligned to the same standards as the tests), and instructional resources. Note: Lesson plans and professional development resources appear only on teachers worksheets, and not on students worksheets. How does Edusoft select resources for worksheets? Edusoft uses a wide range of information to determine which resources to display on a worksheet. The students and tests you specify tell Edusoft which scores and standards to look at. The scores tell Edusoft which resource skill levels to examine and the standards determine which resources are appropriate for the worksheet. Students Tests Scores Score 67% 72% Gr 3-Reading 2.4 Gr 3-Reading 2.5 Standards Resource skill levels Below On Level Advanced Resources aligned to standards Based on those scores, on your underperforming threshold, and on the worksheet contents choices you make, Edusoft sifts through the pool of resources available for your district looking for the ones that match your students needs. Edusoft uses the Benchmarks underperforming threshold you set on the Admin tab to determine which scores are below level, on level, and advanced. 76 Generating Instructional Worksheets LAUSD Help Desk:

81 Training Guide Here s how it works. Edusoft starts with your underperforming threshold for Benchmark tests and adds 10% in each direction to determine the On Level range. Advanced is all scores above that range and Below Level is all scores below it. 60% 80% Below level On level Advanced Benchmark underperforming threshold -10% 70% +10% Then, based on the skill levels you specify, Edusoft selects the best array of resources from the ones that match your choices and your students performance. To select worksheet contents: 1 In the Select Worksheet Contents page, click the check boxes for the material you want to include. Note: The choices that appear in this page depend on the standards you selected and sources available in your district. For example, some standards might not have lesson plans or activities aligned to them. If this is the case, the choices for that type of resource will not appear. For group worksheets, click List Lowest -performing Students to display a list of students in the group who are struggling. For missed exam questions, choose the number of items to include and whether to include the correct answers on the students worksheets. For reassessment items, choose the number of items to include for each standard covered on the worksheet and whether to include the correct answers on the students worksheets. 2 To add instructional resources, click the Instructional Resources check box and choose the number of resources you want to add for each standard covered on the worksheet. When you click the Instructional Resources check box, Edusoft displays additional check boxes for resource types, skill levels, languages, and sources. The check boxes you see depend on the standards you re selected and the resources available in your district. In the Types area, click check boxes for the types of resources you want to include. In the Skill Levels area, click check boxes for the skill levels you want to include. Tip: It s a good idea to always include Not Indicated resources. This gives you access to a wide range of resources that don t have an assigned skill level. In the Languages area, click check boxes for the languages you want to include. assessment.lausd.net Creating instructional worksheets 77

82 Edusoft LAUSD In the Sources area, click check boxes for the resource banks you want to pull resources from. 3 Click Continue to preview and adjust your worksheets. Reviewing and customizing worksheets Now that you ve made your choices, Edusoft creates the worksheets you ve requested. Before viewing and printing the final worksheets, however, you can preview their contents and make adjustments as needed. Although Edusoft uses sophisticated queries to select reassessment items and resources for you, you may want to adjust the contents of a worksheet by adding or removing questions and resources. Worksheets are divided into three main sections: reassessment items, missed questions, and resources. You can work with each section independently, adding or removing items as needed. The resources section displays resources divided into three categories: Below Level, On Level, and Advanced. Edusoft calculates these levels based on your underperforming threshold for Benchmark exams. See How does Edusoft select resources for worksheets? on page 76 for a description of how Edusoft calculates the levels. Click to add more resources for this level and standard. These are the students who performed at this level on the tests covered by this worksheet. Click to delete this resource. These are the skill levels and language associated with this resource. To review and customize worksheets: 1 In the Preview Materials by Standard page, choose the standard you want to review. Missed questions and reassessment items are aligned to one or more standards. 2 In the Reassessment Items area, add or remove items as needed. To remove an item, click the trash can icon for the item you want to remove. Click to remove an item. 78 Generating Instructional Worksheets LAUSD Help Desk:

83 Training Guide To add items, click the Add Reassessment Items link. In the Add Reassessment Items page, click check boxes for the items you want to add. Click Add Selected, and click Continue to add these items to your worksheet. 3 In the Missed Questions area, review the missed questions for each student or period and add or remove questions as needed. To view a different student or period, choose the student or period. To remove a missed question from the worksheet, click the trash can icon for the question you want to remove. To add missed questions to the worksheet for the current student or period, click the Add Missed Questions link. In the Add Missed Questions page, click check boxes for the questions you want to add. Click Add Selected, and click Continue. 4 In the Resources area, review and remove resources for students at each performance level. Performance levels are based on your Benchmarks underperforming threshold. Click a tab to view the resources for a different level. To remove a resource, click the trash can icon for the one you want to remove. 5 To add resources: Click the Add resources link. The Add Resources page appears. The resources you see here are limited by the selections you made on the Worksheet Contents page. For example, if you chose only On Level resources, you won t see Below Level or Advanced resources now. Choose a resource type and skill level. Tip: If you don t find resources for the skill level you select, try choosing Not Indicated. You may find additional resources that don t have a skill level designated. Click check boxes for the resources you want to add. Click Add Selected. Select another resource type or skill level if you wish and add more resources. Click Add Selected for each resource type or skill level. When you ve finished adding resources, click Continue. 6 Continue making changes until you are satisfied with the worksheets. Printing worksheets for teachers and students After you have reviewed and revised your worksheets, the final step is to preview and print them. You can still return to the preview page to make additional changes. assessment.lausd.net Creating instructional worksheets 79

84 Edusoft LAUSD Edusoft creates two PDF files: one for students and one for teachers. A student s PDF file contains the questions and resources you ve selected. The teacher s version contains the same content as the student s, plus professional development and lesson plan resources, answers to reassessment items, and a list of the lowest performing students (if you ve requested it). important! On a Windows computer, be sure to use the Print icon in the Adobe Reader toolbar, and not your browser s menu commands, to print PDF files. You can save the PDF file to your computer before printing. To save this PDF file, click the Save icon. On a Macintosh computer, choose File > Print Largest Frame or the Command-P shortcut. To print worksheets for teachers and students: 1 When you have finished making changes, click View PDF for Teacher or View PDF for Student to view your printable instructional worksheets. Your browser starts Adobe Reader and displays the appropriate PDF file for teachers or students. 2 To print this document, click the Print icon and follow the instructions on your screen. On a Windows computer, the Print icon is part of the Adobe Reader toolbar toward to the top of the page. On a Macintosh computer, use File menu commands to save or print the PDF files. Tip: If you are working with a large set of worksheets, you may want to save the PDF file to your computer before printing. To save this PDF file to your computer, click the Save icon. You can return to this file later to resume printing. 3 To view and print the second PDF file, click View PDF for Student (or View PDF for Teacher). 4 To return to the preview page, click Back. Be sure to use the navigation buttons and links within Edusoft instead of the buttons on your browser toolbar. For printing and saving PDF files, be sure to use the buttons in the Adobe Reader toolbar. 80 Generating Instructional Worksheets LAUSD Help Desk:

85 chapter 8 Managing Edusoft Settings Edusoft maintains a number of settings that include account information, underperforming thresholds, and course information. Depending on your role (teacher or administrator), you can edit or view these settings. If you can edit these settings, the types of changes you can make include: Changing your password, address, or special identification question Creating new school or district administrative Edusoft users Resetting users passwords Changing your user name Changing underperforming thresholds for state analysis, teacher tools exams, and benchmark exams Adding or removing standards alignment to courses You may also be able to view user information for other Edusoft users and print labels for them. These are the topics in this chapter: Managing your account and password information on page 82 Creating administrator accounts on page 83 Managing users, passwords, and schools on page 84 Looking up a user on page 86 Changing your user name on page 87 Setting underperforming thresholds on page 88 assessment.lausd.net Managing Edusoft Settings 81

86 Edusoft LAUSD Managing your account and password information For each user, Edusoft stores a user name and password, an address, and in some districts, a question that s used to identify you if you call Edusoft Help Desk. You can change your password, your address, and the identifying question from the Admin tab s Settings page. To manage your account and password information: 1 Click the Admin tab. Click the Settings link or icon. The Accounts and Password Information page appears. To change your password, enter your old password, and then type your new password in each box. To enter or change your e- mail address, type your e- mail address in each box. Select a question in this list and type the answer in the box. 2 To change your password, enter your old password, type your new password, and then confirm your new password by typing it again. Click Continue. 3 To enter your address, type it and confirm the address by typing it again. Click Continue. 4 To enter an identification question, select one from the list and type the answer. Click Continue. 82 Managing Edusoft Settings LAUSD Help Desk:

87 Training Guide Creating administrator accounts As an administrator, you can create new administrative users who have the same or a lower level of access than yours. If you are a school administrator, you can create other school administrator accounts. If you are a district administrator, you can create school, school group, and district administrator accounts. Note: The only way to add teachers to Edusoft is through roster updates. To create an administrator account: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Create Administrator User Accounts section and click the link for the account you want to create. Click a link to create a new administrative user. You ll only see the type of administrative accounts you can create. The Create School or Create District Administrator page appears. 3 If you have access to more than one school, click check boxes to select the schools to which the new user will have access. 4 Type the new user s first name, last name, and user name. Click Continue. Edusoft creates the new account and assigns the user a temporary password. New users must change their temporary passwords the first time they log on to the Edusoft Web site. This page confirms that the new user has been created. This is the new user s temporary password. assessment.lausd.net Creating administrator accounts 83

88 Edusoft LAUSD Managing users, passwords, and schools As an administrator, you can view the passwords of other Edusoft users. Depending on the access set for your account, you can view and reset user passwords for other administrators and for teachers at your school or in your district. and administrators If the user has provided an address, you can send an that contains their temporary password. For more information, see: Managing teacher accounts, next Managing admin accounts on page 85 Printing user information on page 85 Managing teacher accounts As an administrator, you can view user password information for teachers at your school or in your district. You can print password information for selected teachers, and you can view the user profile for any teacher you select. From the user profile page, you can reset the user s password or deactivate the user s account. Note: School enrollments for teachers are based on your school roster. The only way to change the enrollment of a teacher at a current school is through a roster update. To manage teacher accounts: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Manage Users Passwords section and click the View Users Passwords link. The View User Names & Passwords for page appears. It contains links for the administrative users you can view and for each school that you have access to. 3 Click the link for the teacher s school and then click the Profile link for teacher s name. Note: If you click the link for the teacher s name, Edusoft displays a list of the teacher s students. 4 To reset a user s password, click the Reset Password link. 5 To deactivate a user s account, click the Deactivate link. To reactivate an inactive user, click the Reactive link. 6 Click the Back links to return to the Settings page. 84 Managing Edusoft Settings LAUSD Help Desk:

89 Training Guide Managing admin accounts As an administrator, you can view user password information for other administrators at your school or in your district. You start by viewing the user profile for any administrator you select. From the user profile page, you can reset the user s password, add or remove schools, or deactivate the user s account. Note: Edusoft does not assign administrative users to schools in the same way that teachers are assigned. School enrollments for teachers are based on your school roster. For administrators, you must assign access to one or more schools. To manage admin accounts: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Manage Users Passwords section and click the View Users Passwords link. The View User Names & Passwords page contains links for the administrative users you can view and for each school that you have access to. 3 Click the link for the type of administrator and then click the administrator s Profile link. 4 To reset a user s password, click the Reset Password link. 5 To disable a user s account, click the Deactivate link. To reactivate an inactive user, click the Reactive link. 6 To add school access, select the school in the list and click Add School. 7 To remove a user from a school, click the check box beside the school and click Remove Selected Schools. 8 Click the Back links to return to the Settings page. Printing user information As an administrator, you can print password information for selected teachers or administrators in your school or district. The printout lists the user s first and last names, Edusoft user name, and temporary password. You might want to print (and cut up) a list of users and temporary passwords to distribute before meeting with Edusoft users for the first time. Note: You only see the user s actual password when it s a temporary four-digit password. You don t see passwords for users who have changed their passwords. To print user information: 1 Click the Admin tab. Click the Settings link or icon. assessment.lausd.net Managing users, passwords, and schools 85

90 Edusoft LAUSD Looking up a user 2 Scroll down to the Manage Users Passwords section and click the View users passwords link. 3 Select the users to be included for printing. To print information for administrators, click the link for a type of administrative user. To print information for teachers, click the link for a school. Scroll to the bottom of the list of users and click Show Login Information. 4 Click check boxes beside the names of users you want to include in the print out. At the bottom of the page, click Printer Friendly View. 5 To print this page, use your browser s Print command. As a district administrator, you can look up other users in the system who have the same level or a lower level of access. When you search for a user, the search criteria work together. For example, if you select a user type and enter a partial user name, you can instruct Edusoft to find users with either the user type or user name or both the user type and the user name. To look up a user: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Lookup User section and click the Lookup Users link. 3 Enter your search criteria. You can use criteria alone or together. You can also search based on partial words and instruct Edusoft to only give you items that match all criteria or just one criterion. Use this criterion User Type First Name Middle Name Last Name Full Name When you know The type of user you re looking for. You can also use this choice to narrow down your search in combination with other criteria. The user s first name. The user s middle name. The user s last name. The user s full name. The user s address. 86 Managing Edusoft Settings LAUSD Help Desk:

91 Training Guide Use this criterion Substring match Include inactive users When you know Part of the user s name, user name, or address. You might be looking for a user who is not currently active. This might include users whose accounts have been disabled because of too many unsuccessful log in attempts. 4 Select a search strategy and click Continue. Inclusive (more results): all users who match any criterion. Exclusive (fewer results): all users who match all criteria. Tip: Once you have located the user you want, you can click the View User Profile link to display the user s profile page. Changing your user name The way in which your user name is initially installed depends on your Edusoft role. If you are a teacher, your user name is created by Edusoft based on your first and last name, which is extracted from a roster update from your school or district. If there are other users with the same name, Edusoft appends a number to your user name to make it unique. If you are an administrator, your user name is assigned by the administrative user in your district who created your account. You can change your user name if you wish, and Edusoft will make sure that you still have access to the same schools, students, and data that you had previously. important! Your new user name must be unique in the Edusoft system. No other user can have exactly the same user name. To change your user name: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Change your user name section and click the Change your user name link. A separate Change User Name window appears. 3 Type your new user name and click Continue. If your user name is unique, Edusoft confirms that the change has been made. If the new user name is not unique (another user already has this user name), Edusoft asks you to try another name. assessment.lausd.net Changing your user name 87

92 Edusoft LAUSD If your new user name is not accepted, here are some things you can try: Add a number to the beginning or end. Use a variation on your nickname instead of your full name. For example, if susansmith is already taken, try susiesmith or suesmith. Use a combination of your first name and last initial or your last name and first initial instead of your full name. For example, if susansmith is not available, try susans or ssmith. Setting underperforming thresholds In many reports and other tools, Edusoft highlights scores that fall below a certain percentage. You can set this level, the underperforming threshold, to different amounts for reports that display the results of state assessments, teacher tools exams, and benchmark exams. For example, you might want to set one level for state exam results, and a second level for local assessments such as grade-level benchmark exams or classroom quizzes. Or, you might want to change your underperforming threshold by five or ten percent to see how many students move from one category to the other. important! There are links on other Edusoft pages that bring you to the Settings page so that you can change your underperforming threshold. If you followed one of those links, use the Edusoft tabs and task icons to return to your starting point, and not the browser s back button. To set underperforming thresholds: 1 Click the Admin tab. Click the Settings link or icon. 2 Scroll down to the Underperforming Thresholds Settings section. Type a new percentage and click Continue. 3 Type your new threshold percentages and click Continue. The next time you create a report or other tool, you can expect to see scores that fall at or below your new underperforming thresholds highlighted. When teachers align or create Teacher Tools exams, they choose from a list of standards for the exam. 88 Managing Edusoft Settings LAUSD Help Desk:

93 chapter 9 Creating Custom Groups There are many ways to arrange students into groups: schools, grades, classes, and periods are time-honored examples. Other ways to aggregate students include ethnicity, gender, and Ed programs. But there may be students who share none of these characteristics, but who have still other things in common extra-curricular activities, performance levels, strengths, challenges that make them a group that you want to track and assess over time. For this reason, Edusoft lets you define any collection of students as a custom group that you can track, report on, and give assessments to. Edusoft custom groups are similar to educational programs you can use the custom group any time you select students for reports, benchmark assessments. You create custom groups in one of two ways: from an intervention group (from either Benchmark Exams or State Analysis) or by directly selecting the students you want to include. This chapter covers creating a custom group directly. These are the topics in this chapter: About custom groups on page 90 Creating a custom group on page 91 Editing a custom group on page 92 assessment.lausd.net Creating Custom Groups 89

94 Edusoft LAUSD About custom groups Using custom groups, you can isolate a group of students so that you can take action. The students might be identified in an intervention group, be participants in a special instructional program or team, or simply part of any other group of students you select. The action you take might be tracking performance, administering assessments, or generating custom instructional materials. Instructional Tool Reports Print Answer Sheets Intervention Group Custom Group Once you create a custom group, it appears as one of the demographic options you can use whenever you select students for reports or other Edusoft tools. For example: If your school sponsors an after school writer s club to help students on the cusp of advanced performance improve their writing skills, you might want to look at benchmark or state assessments to see if they improve. If you coach a team and put a lot of emphasis on academic achievement, you might want to compare your team members to the rest of the students in their grade level. If you have set up a peer-tutoring program for math students at your school, you might want to see if their performance improves from one benchmark exam to the next. Custom groups are useful for tracking educational programs over time. For example, you can compare the results of this year s after school program with last year s. 90 Creating Custom Groups LAUSD Help Desk:

95 Training Guide Creating a custom group All users can create a private custom group for their own use. In addition, administrators can create public custom groups that are available to all users. You can create a custom group from the Admin tab, or from any Benchmark or State Analysis intervention group. To create a custom group: 1 Click the Admin tab. Click the Custom Group link or icon. 2 Click New Custom Group. 3 Type a name for the group and a description. 4 If you re an administrator, choose a privacy setting. Choose Private to create a group for your own use. Choose Public to create a group that others in your school or district can view (they won t be able to make changes to the group). 5 Click Continue. The Custom Group Details page appears. From here, you can add new students or change the group properties (name, description, and privacy settings). 6 To add students, click Add new students. The Select Students page lets you filter the students before adding to the group. See Adding students to a custom group, next. Adding students to a custom group You can add new students to a custom group when you first create it, or at any point later on. You can only add students to a custom group that you own. You use the Select Students page to filter the students before adding to the group. If you re a teacher, you can simply choose from among the list of students you teach. To add students to a custom group: 1 If you are creating a new custom group, click Add new students. If you are adding students to an existing custom group, open the custom group and click Add new students. If you re a teacher, the Select Students page lets you filter the list of students before selecting individual students. If you re an administrator, you must filter the list before you can select individual students. 2 To filter the list of students before making your selection, click one or more links to select specific groups of students. Only administrators can select students based on teachers or courses. assessment.lausd.net Creating a custom group 91

96 Edusoft LAUSD Only teachers can select students based on periods. Tip: For more information about selecting students, click the Tell me more link. 3 If you re an administrator, click Continue to filter the list based on your choices. 4 To select students by name, click the check box beside the name of each student you want to include. 5 Click Add students to group. 6 Click Finish at the top of the Custom Group Details page. Note: Click the Clear Page link to erase all checkmarks on the page, or click the Clear All Pages link to erase checkmarks from all pages. Removing students from a custom group Custom groups are flexible in that you can remove students at any time after you create the group. To remove students from a custom group: 1 Click the Admin tab. Click the Custom Group link or icon. 2 Click the link for the custom group that you want to work with. 3 In the Members section on the page, select the students you want to remove. 4 Click the Remove Selected button at the top of the Members section. 5 Click Yes to confirm the removal of the students. Editing a custom group Once you create a custom group, you can change its name, description, or privacy setting. You can only make changes to custom groups that you own, even if a custom group is public. You own all custom groups listed in the My Private Custom Groups section. If you re an administrator, you also own any custom groups where you see You own this group listed as the owner. To edit a custom group: 1 Click the Admin tab. Click the Custom Group link or icon. 2 Click the link for the custom group that you want to work with. 3 Click Edit Properties at the top of the Custom Group Details page. 4 Make changes to the name or description by editing the text in the boxes. 5 If you re an administrator, change the privacy setting by clicking the appropriate button. 92 Creating Custom Groups LAUSD Help Desk:

97 Training Guide 6 Click Finish after you have made your changes. Deleting a custom group Note: If you re an administrator, you can also change the privacy setting from the Custom Groups Home page. First select the check box next to the group whose setting you want to change. Click Make Selected Public if the group is private, or click Make Selected Private if the group is public. If you find that you no longer need to track or report on a custom group that you created, you can delete the customer group. Note: If you have administered and graded an assessment, the scores for the custom group will be deleted when you delete the custom group. To delete a custom group: 1 Click the Admin tab. Click the Custom Group link or icon. 2 To delete a custom group, click the checkbox next to the group you want to delete. 3 Click Delete Selected at the top of the page. After confirming, you return to the Custom Groups Home page. The group you deleted no longer appears in the list. assessment.lausd.net Editing a custom group 93

98 Edusoft LAUSD 94 Creating Custom Groups LAUSD Help Desk:

99 look up Index A administrators creating new accounts 83 viewing user profiles 85 answer breakdown data displaying 55 viewing individual students 56 answer sheets for custom groups 25 period-specific 25 printing 24 replacing 12 scanned 5 school-wide generic 25 types of 25 viewing 24 archiving, described 19 assessment items quality of 54 selecting for analysis 51 Assessment Locker adding folders to 17 archiving folders 20 creating folders 18 deleting assessments 22 deleting folders 18 described 16 moving assessments 21 organizing 17 restoring archived folders 20 selecting tests for worksheets 75 assessments administering 20 archiving 19 as basis for worksheets 75 changing security 22 copying 21 deleting 22 moving 21 organizing 16 private 16, 22 public 16, 22 recognition failures 12 reusing 20 setting security 22 sharing 22 viewing results for 7 viewing scanning sessions 7 Avery 5164 label sheets 27 B benchmark assessments described 15 Benchmark reports data aggregation 34 described 33, 34 display options 35 score types 35 C Class List reports creating 42 described 37 per standard scores, displaying 42 color coding 43 custom groups adding students 91 answer sheets 25 creating 91 assessment.lausd.net Index 95

100 Edusoft LAUSD creating from intervention group 66 deleting 93 described 62, 66, 90 editing 92 examples 66 printing answer sheets for 25 privacy setting 91 removing students 92 viewing scanning status 8 D data aggregation described 34 Performance Band reports 40 data aggregation, Item Response reports 59 demographics choosing for intervention groups 63 filtering for item analysis 52, 60 display options described 35 Performance Band reports 40 E Edusoft described 1 address, changing 82 exam questions adding missed 79 missed 76 removing 79 See also missed questions 71 F folders adding to Assessment Locker 17 archiving 20 creating in Assessment Locker 18 deleting from Assessment Locker 18 restoring archived 20 G generic answer sheets 25 grading viewing other dates 6 viewing results 4 Grading Status Session Detail page 5 Teacher Test Detail page 8 Test Detail View page 8 Grading Status page, described 4 H highlighting color coding 43 highlighting in Item Response report 59 I identification question 82 Instructional Tool, changes, described 71 intervention groups and custom groups 62 changing membership in 66 choosing demographics 63 creating 62 creating custom groups from 66 defining 62 described 62 selecting students 62 item analysis described 37 in Performance Band reports 41 quality of items 54 selecting items 51 Item Analysis report described 50 sorting 55 viewing 53 Item Response report creating 58 described 57 displaying student ID 59 highlighting, described 58 highlighting, selecting 59 report formats 60 report options 59 viewing 58 L languages, selecting for worksheets 77 lowest performing students, displaying in worksheets Index LAUSD Help Desk:

101 Training Guide M missed questions adding 79 adding to worksheets 77 described 77 displaying in worksheets 71 removing 79 O On Level range, calculating 77 Options Dashboard, described 66 overall scores, described 35 P passwords changing 82 resetting 84, 85 temporary 83 viewing 84, 85 per period answer sheets 25 per standard scores, displaying 40, 42 Performance Band reports creating 40 described 36 per standard scores, displaying 40 question group scores, displaying 40, 42 period-specific answer sheets 25 Preview Materials by Standard page 78 privacy setting changing custom group 92 custom groups 91 private assessments 16, 22 profiles viewing administrator 85 viewing teacher 84 public assessments 16, 22 Q question group scores, displaying 40, 42 R reassessment items adding 78 adding to worksheets 77 in worksheets 76 removing 78 removing from worksheets 79 report formats, Item Response report 60 reports deleted scores 17 Item Analysis 53 Item Response 57 selecting type of 40, 42 sorting item analysis 55 resource types, selecting for worksheets 77 resources adding to worksheets 77, 79 displayed in worksheets 78 levels, described 78 removing from worksheets 79 viewing by level 79 S scanning failures described 9 number of 8 rescanning answer sheets 14 resolving 10 student recognition 11 test recognition 12 scanning sessions no data 4 viewing other dates 6 viewing results 5 viewing tests 7 School Comparison reports described 39 schools adding/removing users 85 school-wide generic answer sheets 25 scores below underperforming threshold 88 deleting with assessment 22 keeping by moving assessment 18 missing 8 overwriting 20 types, described 35 security changing 22 setting for assessments 22 Select Assessments page 75 Select Standards page 76 assessment.lausd.net Index 97

102 Edusoft LAUSD Select Student Set page 74 skill levels, selecting for worksheets 77 sorting in Class List reports 42 sources, selecting for worksheets 78 standards as basis for worksheets 75 in exams 75 selecting for worksheets 76 Student Performance report creating 44 described 38 student worksheets, described 80 students adding to custom groups 91 creating custom groups 91 number of graded 8 removing from custom groups 92 selecting a group for worksheets 75 selecting all for worksheets 74 selecting for intervention groups 62 selecting for worksheets 74 selecting specific ones for worksheets 74 users adding/removing schools 85 looking up 86 W worksheet contents how they are retrieved 76 selecting 77 worksheet sections, described 78 worksheets based on exams 75 creating, described 72 customizing 78 described 70, 78 printing 80 sample 70 sections of 76 selecting standards 75 selecting type 73 starting 73 types, described 73 T teacher score sheets 24 teacher worksheets, described 80 teachers viewing scanning status 8 viewing user profile 84 test scores, selecting for worksheets 75 tests recognition failures 12 viewing results for 7 viewing scanning sessions 7 U underperforming threshold calculating On Level 77 standards below 75 underperforming thresholds described 88 setting 88 user names changing 87 described 87 forgotten Index LAUSD Help Desk: