ASSESSMENT TECHNOLOGY, INCORPORATED

Transcription

1 ASSESSMENT TECHNOLOGY, INCORPORATED A Guide for Galileo K-12 Online School Performance Dashboard: Risk Level Summary PURPOSE This report shows progress reflected in performance on a series of benchmark tests that have been placed on a common scale. Since the tests have been placed on a common scale, the scores can be directly compared and an estimate can be generated related to each student s risk of not meeting the standards on the next state standardized assessment. This risk level is based on where his or her Development Level (DL) score falls relative to the Meets cut score on each ATI benchmark assessment taken. The cut scores on the benchmark assessments are set to correspond to the cut score on the state standardized test. ACCESS Risk Level Summary Data may be easily accessed from the School Performance Dashboard page s Risk Level Summary widget. Please note, risk level data may also be analyzed by running the Aggregate Multitest with Risk Levels report. Refer to A Guide for Galileo K-12 Online Generating Aggregate Multi- Test with Risk Level Report. GENERATE REPORT 1. Click the Dashboard link. 2. Use the down arrow to select School Performance. 3. Use the down arrow to select the desired School(s). To run a District-level Risk Level Summary report, select [All Schools]. 5. Click the Run Report button. 6. The number of students in each risk level will be represented in the bar graph. 4. On the Risk Level Summary widget, select the Library and Subject. 7. Click either the: a. risk level bar to view the 2015 Assessment Technology, Incorporated professionaldevelopment@ati-online.com

2 Instruction Performance Tracker report for the selected risk level. b. the View Instruction Performance Tracker for all Risk Levels link. REPORT INTERPRETATION a. The selected District or School. b. The Library and Subject where the assessments reside. c. The table lists all administered ATIcreated assessments, the number of students included in the report, the average Developmental Level (DL) score and the cutscores for each statedefined achivement level. d. The risk level, based on all ATIcreated assessments. Click the Student Risk Level radio button to change the risk level displayed. Rev Assessment Technology, Incorporated - 2 -

3 e. The total number of students in the selected risk level. f. The step to move the selected Student Risk Level (d) from one risk level to another risk level. g. The Assignment and Quiz Builder buttons allow the user to quickly schedule an assignment and/or quiz for the standards in that step. h. The ATI-created assessment on which the standard appeared. If multiple numbers appear (1, 2) this indicates that the standard appeared on first and second assessment. i. The total number of test items that appeared on all the benchmarks addressing this standard. j. The learning standard addressed. k. The probability that the students in the selected Student Risk Level have mastered the standard. This is generated using Item Response Theory (IRT). IRT estimates the probability of mastering an item based on the ability of the students and the item characteristics. Item characteristics include the difficulty of the item and the ability of the item to discriminate between students of differing levels. l. The average points earned is the earned points divided by the total number of questions for that standard. m. Checkbox to select (or deselect) the learning standard for an action (g). ASSIGNMENTS By clicking on the Assignment button and completing the Schedule Assignments page, you can automatically generate an assignment (e.g., a Dialog) for the selected Student Risk Level. An assignment within Galileo is defined as either an Instructional Dialog or a user-created student activity. Assignments are standards-driven. Dialog assignments can be done online by students or presented as whole class instruction. 1. Click the radio button for the desired Student Risk Level. 2. (optional) Uncheck the Learning Standard(s) you want to exclude from the assignment. 3. Click on the Assignments button. You are brought to the Schedule Assignments page. 4. A list of assignments is displayed ordered by standard. 5. Review the list; click the View icon or Dialog name link to preview the assignment. Rev Assessment Technology, Incorporated - 3 -

4 6. Place a checkmark by the desired assignment(s) that you want to administer. SCHEDULE OPTIONS 7. Click the radio button to schedule the Assignment(s) for a(n): AVAILABILITY 12.Click on the Post assignment box to make the assignment available for students to take in the K-12 Student-Parent Center. a. Class Select the Class from the drop-down field. b. New intervention group Group Library and name the c. Existing intervention group Group Library and Most often, you will want to schedule it for an Intervention Group. ASSIGNMENT DETAILS 8. Select the Dialog Library in which to store the copied dialog. 9. Select the test Library in which to copy the associated test. 10.Use the Assign on: and Due Date: calendars to select when and for how many days you wish this assignment to be available to students. 11.Use the Available From and to dropdown fields to select the start and end times. 13.Click the Save Schedule button. 14.Students are now ready to take the Assignment in the K-12 Student- Parent Center. 15.The scheduled assignment now appears on the Teaching Dashboard and Class Calendar pages. QUIZ BUILDER By clicking the Quiz Builder button and completing the Quiz Builder page, you can automatically generate a quiz for the selected Student Risk Level. A quiz generated this way will contain a 5-item test for each designated objective. 1. Click the radio button for the desired Student Risk Level. 2. (optional) Uncheck the Learning Standard(s) you want to exclude from the Quiz Builder tool. 3. Click the Quiz Builder button. You are brought to the Quiz Builder page. 4. Verify the objectives for which you d like to generate a quiz. LOCATION 5. Select the quiz library. Rev Assessment Technology, Incorporated - 4 -

5 6. Select the Subject. AVAILABILITY 7. Select the dates and times for which you would like to have students take the quiz(zes). 8. Click the Generate Quizzes button. 9. One quiz is created per objective. You may change the name, scheduling date and time of any of the quizzes. We recommend you change the quiz name from the default name. Rename quiz to include learning 10.Click the View/Edit Quiz icon to preview the quiz and/or edit the quiz. REPLACE A QUESTION (OPTIONAL) 11.Click the Replace link by the question. 12.The current test item displays. Underneath you will see all of the questions in the bank that can replace the current question. 13.Click the Select button beside the question you would like to appear on the quiz. This question will replace the current question. 14.Click the Finished button. 15.You are brought back to the Quiz Builder page. b. New intervention group Group Library and name the c. Existing intervention group Group Library and SCHEDULE 17.Click the Schedule Quizzes button. Students are now ready to take the online quiz via the K-12 Student- Parent Center. If you want students to take quiz(zes) offline you must schedule the quiz(zes) through traditional means (Teaching Dashboard page). INTERVENTION GROUPS An Intervention Group is a way to group students who share commonalities. You can use an Intervention Group when assigning quizzes or assignments to a particular group of students. For example, Galileo creates Intervention Groups based on risk-levels or allows the user to create them based on demographics. Refer to A Guide for Galileo K-12 Online Intervention Groups for directions on creating, modifying, and deleting an SELECT STUDENTS 16.Click the radio button to schedule the quiz(zes) for a(n): a. Class Select the Class from the drop-down field. Rev Assessment Technology, Incorporated - 5 -