Online Testing Engine

Online Testing Engine Table of Contents Considerations...2 Minimum System Rquirements...3 School Test Leaders... 4 Teachers Administering Tests...5 Online Testing Functionality...7 Online Data Entry for Constructed Response...12 Online Testing FAQs...16 Quick Tips...19 Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 1

Considerations for Online Testing Factors to think about when deciding whether to implement online testing Logistics 1. Check on the number of computers available to students for the testing process. Make sure that every student will be able to access a computer for each of the tests planned. 2. Do a quick mental review of the Internet capabilities of your district. Think about how well it handles many users online at once. 3. Make sure that the computers that will be used for online testing meet the minimum system requirements (see DataDirector Minimum System Requirements). Planning 1. Consider how students will test if there are technical difficulties on the day of the test. Make sure there are alternatives available (paper/ pencil, or alternate testing days). 2. Generate a timeline and rollout of the online testing process. This may include a practice test with a subgroup of students or a pilot with one or two schools. 3. Take into account students with disabilities and the needs that may differ from the rest of the students. For example, if a student will need the test read to him or her, is there a computer away from the rest of the students where the student and his or her aide may work? Support 1. Make sure there are support plans in place for classes and users- especially on the first round of testing. Consider which personnel will be available to answer questions/ give additional support at each site administering tests online. Online Testing- Considerations Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877)993-2633. Rev. 7/19/11 2

DataDirector s Minimum System Requirements Riverside Publishing provides access to DataDirector through an Application Service Provider (ASP), or hosted, model. Like other Internet-based applications delivered through an ASP model, users can access DataDirector from any computer with Internet access 24 hours a day, seven days a week. In order to enjoy the best possible experience while using the system, broadband Internet access is highly recommended. A faster connection to the Internet will improve user experience and provide faster access to data. As a true web-based application, DataDirector is supported for use on both PC and Mac computer platforms. For the best experience using DataDirector, and in alignment with current industry standards, Riverside recommends the following minimum system requirements: Operating System Web Browser Adobe Reader Additional Requirements Windows 7 Windows Vista Windows XP Macintosh OS 10.4 and Up Microsoft IE 7 or higher (IE 8 is recommended) Firefox 3.0 or higher (Firefox 4.0 is recommended) Safari 5.0 or higher (Safari 5.0 is recommended) Firefox 3.0 or higher (Firefox 4.0 is recommended) 7.0 or higher Internet access Processor: 2.8GHz or higher 7.0 or higher Memory: 2 GB RAM or higher is recommended for optimal performance JavaScript must be enabled 1024x768 screen resolution The basic browser and supporting applications needed to use DataDirector can be downloaded free of charge. The following URLs will help you ensure your computers meet Riverside s minimum system requirements. Obtaining Software Upgrades Microsoft Internet Explorer is a free download available from http://www.microsoft.com/windows/ie Adobe Reader is a free download available from http://www.adobe.com/reader/ Firefox is a free download available from http://www.mozilla.com Apple Safari is a free download available from http://www.apple.com/safari Microsoft Net Framework is a free download available from http://www.microsoft.com/downloads Questions? If you have any questions or concerns, please contact DataDirector Customer Support at 877-993-2633. * The requirements for DataScanner differ. 3

School Test Leaders Preparing the overall school environment to get the most out of online testing Environment 1. Arrange for a lab or room before the testing window begins a. Develop a schedule for students moving through the computer lab b. Use desktop computers with hard-wired Internet access when possible c. If laptops are being utilized, use surge protectors (if possible) to alleviate battery issues d. Ensure which computers are usable before the testing begins 2. Provide comfortable seats and a hard writing surface 3. Provide scratch paper and pencils for all tests and calculators (if needed) for Math tests 4. Seat students so that they cannot easily see each others answers a. Consider implementing privacy folders around each student s area to prevent cheating i. Privacy folders are pieces of poster-board or tag-board that have been folded and placed around a student s computer b. If possible, leave one seat open between each child taking the test so cheating is less likely to occur 5. Make sure all students can clearly hear directions 6. Ensure that the lab is well-lit, well-ventilated, and is free of noise and interruption 7. Arrange for additional proctors if necessary consider training one or two people who can be in the testing rooms consistently throughout the entire testing period. Timing 1. Have a quiet activity (book, head down, etc.) ready for students who finish the test early a. Do not allow students who finish early to surf the Internet or play on-line games 2. Allow extra time for computer and technology issues and the log-in process 3. Request that other Internet-intensive resources are not being utilized during the testing period (streaming video or audio take up a lot of bandwidth) Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 4

Teachers Administering Tests Suggestions for users who are responsible for administering the tests to students Preparing the Students 1. Familiarize your students with different question formats on the on-line tests. These might include multiple-choice questions, reading and math formats, and questions using charts or graphs. Talk about how to think through each type of question. Encourage each student to use the same types of problem-solving strategies that s/he uses when taking a paper/pencil test, such as: a. Read each question carefully. b. For reading tests, read the complete passage before answering the questions associated with it. c. For math tests, use scratch paper to work out the problem if needed. d. Make it clear to students that they need to take the online test seriously. 2. Familiarize yourself and your students of the online testing features, including Pause, jumping between questions, advancing to the next question, going back to previous questions, and Exit Section. For Reading tests, ensure students understand they can scroll through the passage (on the left) and questions (on the right). 3. Practice time management and pacing. Encourage students to answer all of the questions on the test. Students may wish to answer the easiest questions first and then return to the harder questions. Students can use the Mark feature to identify a question they might wish to return to. 4. Allow young students time to practice using the computer and the mouse before taking the online tests. If you have computers in your classroom, think about setting up a computer center or talk with your technology teacher about incorporating computer and mouse practice time into the technology lessons. 5. Give students experience in taking a test online with a tutorial (available in Online Testing) or another practice test. Before the Test Teachers should be present in the testing room while their class is testing. Additional proctors may be used to assist the teacher. All test administrators should have a basic knowledge of the computers in the lab and of the DataDirector online test format. Teachers cannot assist students with test questions. 1. Review the test and test format a. Familiarize yourself with the student directions for the assessment b. Know how to log in to the system with the student test keys Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 5

c. Practice logging in with student keys & administering the test with students before the actual benchmark by using mini assessment for practice 2. Gather necessary supplies for testing a. Print out student test keys i. Ensure you have a master copy of student test keys b. Pencils and scratch paper c. Privacy folders, if necessary 3. Know which students in class need to be tested a. Make alternative arrangements for students with special needs i. Order paper copies of the test booklets, if necessary 4. Decide what to do with students who arrive late for testing and students who finish testing early a. Students who finish early should not be allowed to surf the Internet or play on-line games 5. Know the dates for testing and make-up testing 6. Know where to find help in your building or within the district During the Test 1. Allow time for students to have a bathroom break before the test begins 2. Move around the room to ensure that students are following directions, have the materials they need, and are focused on their own tests 3. Verify the student seated at the computer matches the name of the child on the screen 4. Verify the test listed on the screen is the test the student is expected to take 5. Assist the student in submitting their Online Testing scores. a. Ask the student to raise his/her hand or place a paper cup on top of his/her computer monitor when finished. b. Ensure that all questions have been answered before the test is submitted for grading c. Watch the child click the Exit Section button 6. Keep track of students that have not completed testing so they can attend the make-up session After the Test 1. Schedule computer time for make-up testing 2. Force close all benchmark tests once the testing window ends Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 6

Online Testing STEP 1: ADDING ONLINE TESTING FUNCTIONALITY 1. Access the assessment from DataDirector and go to the Assessment Overview page. 2. Click the link Online Assessment has been configured towards the bottom of the screen under the Assessment Options section. 3. The Online Settings will be pre-set for all teachers except for the student tools and options. Teachers can customize the student tools before testing. Please Do Not change the testing period or duration. *If you are able to see the Select Test Key option, please do not change this option. Unique Test Key should remain selected. STEP 2: ADD STUDENTS 4. In the left navigation, select the Manage Students and Keys link. 5. On the next screen you will select the class roster by using the filters at the top of the page. After selecting the correct school, you will be prompted to select criteria on students for which you need test keys (see screenshot on next page). After making your selections, press Submit and a display of students will populate below. You can download the list in Excel or as a PDF document. a. If you need a key created for students not yet rostered to you in DataDirector, you can create a key by clicking Add Unrostered Student and entering their full name. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 7

Make your selections for students 6. 6. After selecting Submit, a display of students that match the criteria selected will be available along with a unique test key for each. The test keys displayed are active and ready for use. 7. This process must be repeated for every separate assessment that you plan to administer to your students. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 8

STEP 3: ADMINSTERING THE TEST 1. During the testing window opening time, have students login to: www.achievedata.com/aps/test. The begining of the web address should be the same as the address used when logging into DataDirector. 2. Have students enter their test key and click Go. 3. The next screen prompts the sudents to confirm their name and the test they are taking. After chosing Yes, they should click the OK button. 4. If the teacher chooses, students will be prompted to take an introductory tutorial. The introductory tutorial will teach students to use features such as the highlighter, strikethrough, and note taking. It will also teach them how to jump to a question, mark a question, and review their answers. Once students have completed the tutorial, they may click Exit Section and begin their test. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 9

5. Students can access many test taking features during their exam. 1. To highlight: Students can left click on the mouse and drag the cursor over the words they would like to highlight. 2. To strikethrough: Students can right click the answer choice they would like to strike through 3. To enter a note: Students can click anywhere on the screen. A popup box will appear. Students can type their note in the box. A small yellow icon will appear when their note is closed. 6. Students can use the navigation buttons to move through the test. They can mark a question, pause the test, move forward or backward. 7. A review screen will prompt students to review their answers. Once students have completed their test, they must click Exit Section. As students exit, they will be prompted to close their browser. ***Please note: Once a student exits a section, they cannot retake their test.*** Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 10

8. During the test, a teacher may monitor student progress on the assessment. To monitor student progress, locate the assessment within DataDirector. On the Assessment Overview page, click Proctor Monitoring on the left navigation. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 11

Data Entry for Constructed Response Items Step 1: Student View of Constructed Response Items 1. The student will see the constructed response items on the screen, but will need to respond to the item separately. They will not type answers onto the screen itself. 2. Once students have answered separately, perhaps on paper provided by the teacher, students will press the Next button in the top right corner to continue or end the assessment depending on where the constructed response item is within that assessment. 3. DataDirector will not be able to score the assessment immediately because the teacher will be required to go back and enter the student scores for only constructed response items. Therefore, the student scores will not display at the end of the assessment. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 12

Step 2: Data Entry for Teachers 1. In the Assessment application, search for the assessment in which data needs to be entered and select. 2. On the Assessment Overview page, click on the Data Entry link in the left navigation. 3. An alphabetical list of students within the teacher s class and the answer strings for each student will be displayed. For any constructed response items, a score of 0.00 will be shown. 4. In place of the 0.00, enter the score each student received for this item using the district provided rubric. In the screenshot below, a student has scored a 2 for this item and that data has been entered. 5. Select the Save or Save and return to results button in order for entered score(s) to be calculated. DataDirector will automatically recalculate total scores for all students and then report immediately on the Assessment Overview page and/or within the Assessment Reports. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 13

For School Administrators: If you have School Administrator access in DataDirector and would like to enter the constructed response data for your teachers, here are a few tips for filtering the number of students you see at a time: a) Go to the Assessments application and locate the assessment you will be entering data for by using the filters at the top of the page. This will just ensure the assessment is available for future steps. b) Go into the Students application. In the left navigation select the Teachers link. Scroll down and select a teacher for which you d like to enter data. Then choose a grade and/or period if applicable. Press Go. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 14

c) The screen should display a list of students that meet the criteria you entered on the Student page. These are the students in which you will enter constructed response data. In the left navigation, click Assessments. From the drop down, choose the assessment you need to enter data. You may choose enter data for a single student or multiple students by clicking the appropriate link. d) Return to Page 2 Step 3 in this document to find instructions on how to complete data entry. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 15

DataDirector Online Testing FAQs A. I have a student who is not on my list, but needs to take the test. How can I get him or her a login key? 1. Login to DataDirector 2. Click on the Assessments application 3. Locate the title of the exam and click on it 4. At the bottom/center of the screen under Assessment Options, click the link for Online Assessment has been configured 5. In the left navigation bar, click, Add Unrostered Student 6. Type the student s name in the box provided and click, Save 7. In the left navigation bar click, Manage Students and Keys 8. Locate the new student toward the top of the student list and give the student his or her newly generated test key 9. Once the student has been rostered in DataDirector, go back into the test and click the link for Online Assessment has been configured 10. In the left navigation bar click, Manage Students and Keys 11. Use the filters to locate unrostered students and then locate the student s new record (usually toward the top of the student list) and click the to the left of the student s name. 12. Enter the student s ID number twice in the fields provided and click Save (identify the student s ID number by going into the Students tab and finding the student, then clicking on the student s name- the ID number is at the top right of the pop-up window) B. There is a student who clicked all the way through the test and exited before answering all the questions. How do I get that student back in the system to re-take the test? 1. Follow steps 1-3 to locate the Assessment Summary page for the test. 2. At the bottom of the page under the Data Management section, select Manage Student Responses. 3. In the student list, find the student s name and jot down the answer string listed. 4. Click Return to Exam. 5. Under Assessment Options click the link for Online Assessment has been configured. 6. In the left navigation bar click, Manage Students and Keys 7. Fill in the filters and select Submit to display the student s test information and test key. 8. Place a check mark in the box next to the student s name. 9. In the drop down under the Exam Edit Options box select Retake Exam. 10. Click Save. 11. The student will then need to log in to the test with a new test key. 12. Go through the questions that have been answered and click on those responses to catch the student up with his or her own answers Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 16

13. Allow the student to continue with the unanswered questions on his or her own and select Exit Section once finished. C. A gray box comes up for the student that says something about an internet connection disruption. What does the student do? 1. Have the student click OK to get back to where he or she was on the test. 2. If the student clicks Cancel have the student log into the test again, and the test will pick up right where the student left off D. My students cannot log in. Once they enter their test key, they get a message that states, This key has not been permitted access at this time 1. Login to DataDirector 2. Click on the Assessments application 3. Locate the title of the exam and click on it 4. Under the Assessment Options section, click the link for Online Assessment has been configured 5. In the left navigation bar click, Manage Students and Keys 6. Check the login time for the students- has the time expired? 7. To update the login time, check the boxes to the left of the student names (to select all students at once, click All at the top of the list) 8. Change the login window start time to an appropriate time for the test 9. Click Save 10. Have the students try to login again E. My students cannot log in. Once they enter their test key, they get a message that states Your test key is invalid. Please try again or seek help from an administrator 1. Login to DataDirector 2. Click on the Assessments application 3. Locate the title of the exam and click on it 4. Under the Assessment Options section, click the link for Online Assessment has been configured 5. In the left navigation bar click, Manage Students and Keys 6. Spot-check the test keys with the ones the students have. Are they the same? 7. If not, click on the green Excel icon to download the accurate keys in Excel. Follow the instructions outlined in the training to make the keys larger and hand them out to the students F. The students have to scroll A LOT to see the items (including to the right and left) 1. Minimize the internet screen by clicking the minimize button in the top right corner of the internet screen Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 17

2. Right-click on the desktop, and select Properties 3. Click on the Settings tab 4. Under Screen Resolution check the settings- check to make sure it is at least 1024 x 768 pixels. If necessary, change this, and click Apply 5. Pull up the test to the main screen again by selecting it in the bottom bar G. I cannot locate the student key that I printed up. How can I get it again? 1. Login to DataDirector 2. Click on the Assessments application 3. Locate the title of the exam and click on it 4. Under the Assessment Options section, click the link for Online Assessment has been configured 5. In the left navigation bar click, Manage Students and Keys 6. Click on the Excel icon at the top of the student list to re-export and print a new list of students and test keys H. I want my students to see the maximum space on their screens. (Windows Operating System) 1. Open up the testing screen/ have the students log in 2. Have the students click the F11 button I. I am a site administrator for the test, and when I click Manage Students and Keys in an exam, I see students who are not at my school entered by other site administrators who are not at my school. 1. Since you have access to all students at your school, DataDirector also gives you access to see test keys for students who might be at your school- unrostered students hand-entered by any user in the district. These will be managed by the user who created them. Ignore these records (after generating the Excel spreadsheet for the test keys, delete them) Remember- when a student clicks the Review button at the top of the page, the Next button turns into Exit Section. If the student clicks that button, he is she will be logged out and unable to return to the test. Go through Questions B or C (according to the situation) to bring the student back into the test. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 18

Quick Tips Checklist for Online Testing 1. All lab computers have run automatic updates or updates are scheduled to run outside of testing hours (if applicable) 2. DataDirector System Minimum Requirements document has been reviewed and confirmed 3. A visible computer lab schedule has been created 4. Test Keys have been generated for all students 5. Teachers have a copy of the test keys to distribute to students 6. A master list of test keys has been printed or saved, and is available to the testing proctor for each class 7. Students are familiar with the online system (practice online assessment is available) 8. Students know how to access the DataDirector student test site; www.achievedata.com/aps/test 9. A Plan B is in place for any Internet difficulties or schedule conflicts 10. Students should engage in a quiet activity after they finish testing (i.e. reading a book, head down, etc...) 11. If students experience trouble with a certain browser or notice that certain components of the screen are not populating (i.e., navigation buttons, graphs, charts, etc...), have the students pause the test, close out the internet browser, and then use a different browser to log back into the test. Questions? If you have any questions or concerns, contact DataDirector Customer Support at (877) 411-1629. 19