ACCESS for ELLs 2.0 Q & A

Transcription

1 ACCESS for ELLs 2.0 Q & A Q: Our school is a consolidated school for grades 1-3. Can the test be administered to all three grades at once? A: Yes. Students of multiple grades can test at the same time. You ll just need to keep in mind and make sure the order of administration is as we noted on the slide earlier (receptive domains of Listening and Reading first, followed by productive domains of Writing and Speaking). Q: Will there be any time constraints for slow typers? A: There are not any time constraints. Test Administrators may give students the time they need, as long as students are working productively. For grades 1-3, students will handwrite their Writing responses so keyboarding typing speed will not affect them. Q: When will we know whether writing responses will be via paper or online for grades 4 and above? A: This decision will apply to grades 4 and 5 and will be made based on the field test results. Students in grades 6-12 will take the Writing test and respond online [with a keyboard] unless the student is not comfortable keyboarding, in which case that setting can be adjusted so they handwrite responses in a booklet. We will let you know as soon as we have recommended guidelines for 4-5. Q: So there will be not be tiers for Reading, Speaking, and Listening, but there will be a tier for Writing? A: For the online test, the tiers are built into the backend so you will not need to consider tiers for the purposes of ordering. As we noted, the students will take the Listening and Reading tests prior to the Writing test. On the backend where the test is calculating, it will determine the appropriate proficiency level form. Writing will be tiered in the sense that there will be a Tier A form and a Tier B Writing form, but the selection will be done from the test platform so there is nothing that the Test Administrator needs to do to select tier. Q: Will you use data from the field test to determine/modify approximate testing times for each domain? A: Yes, we will use the data from the field test to make our recommendations. We will be updating our recommendations, if needed, as we know more. Q: Will there be a manual or other guidance on accommodations/accessibility features so we can see the differences in accommodations across our other assessments? A: The new accommodations/accessibility features will be outlined in a document that we will be releasing in May. It will contain new guidelines for the ACCESS 2.0

2 Assessment, including paper-based test and online test information. But it will be specific to ELP testing for our assessment, not all consortia (e.g. Smarter Balanced, PARCC, other) assessments. Q: Will options for paper be included on the WIDA-AMS for all schools, even if the state does not offer it? A: Yes. If a state tests online for grades 1-12, there will still be paper components, including for Kindergarten, Alternate ACCESS, and customized large print/braille forms. Even if your state is all online for 1-12, it will involve certain components that will be ordered through this process. Q: For whom is the paper form an option? A: The 1-12 paper form will be an option for those who are in states that allow paper testing, for instance in circumstances in which a district does not have the technology needed to test online. Each state will provide guidelines that we will be listing on our website as we get confirmation. Q: So Test Administrators have to do online training for ACCESS 2.0, correct? A: Yes. For all three roles (Test Coordinators, Test Administrators, and Technology Coordinators), there will be training modules and other resources available, such as user guides and test administration manuals. For Test Administrators, you will need to complete the training associated with the online test, meaning review the modules and complete the checklist activities to obtain a Certificate of Completion. There will not be a certification process since this is more of a procedural administration. Q: Will we have information regarding the dates in which Technology Coordinators need to take the training? A: Yes. The ACCESS 2.0 Preparation Resources page lists all upcoming dates. You may filter by role to find resources that pertain to Technology Coordinators, Test Administrators, and Test Coordinators. We have on the website information about next week s Technology Coordinator webinar on May 1 st. That is a large group training intended specifically for Technology Coordinators who will be doing the download of the materials that are required to install the DRC system and will provide technology support for the multiple tests that your state may be administering. Q: How is the local Speaking assessor chosen? What training will they receive? A: The local assessor role is only applicable to a paper administration scenario since that is the only situation in which administrators would score Speaking. If your school or district is administering paper, the district Test Coordinator would identify who will be the ACCESS 2.0 administrators/scorers, as that is a local decision. Then, Administrators will complete training through the WIDA Training Course, which we re updating and will include a Speaking scoring module with the new scoring procedures. The Speaking module will contain the new scoring samples that we ve collected through the Field Test.

3 Q: How long are the training modules? A: For the online test, the training modules will be similar to the short, topic-specific training modules we had for the field test this year. Those may range from five to ten minutes, in some cases. We will be merging those to contain everything in one place. The revised Training Course for the paper test will include trainings similar to what we have now, which may take around 15 minutes [for those that do not include a quiz] and will culminate in a Certificate of Completion. The real difference for training is that the new module for scoring Speaking (for the paper test only) will have a lot of new procedures and is based on an all new design. This module may take up to three hours depending on how many grades will be scored. Q: How long is the time between ending our testing window and getting the scores for the online version? A: This will depend on your state. WIDA and DRC are having conversations about testing windows and when reports will be available. We are not expecting significant changes for now primarily because although two of the domains can be scored by computer, two of them cannot. That information (for Speaking and Writing) needs to go to DRC for scoring, so there s that turnaround and psychometric analysis will still be part of the process. We will let people know via the website when we have final information regarding each of your state windows and key dates. Q: Will there still be tiers? A: For the online test, there will not be tiers for the purposes of ordering at all. There will still be proficiency levels built into the test. Due to the staged adaptivity of the test design, the items the students encounter will be presented to them via folders and as they complete the folder, based how they perform on that folder, they will move on to the next folder. If they don t complete items in the folder at the highest level, they wouldn t move on to a higher folder they would either stay in the same or a lower proficiency folder. The paper-based test will continue to have tiered forms and designated staff will utilize the same tier placement protocol and procedures for selecting which form to order. Q: If we are certified, will we need an additional certification for the paper version? A: For next year, because everything [except Kindergarten and Alternate ACCESS] is brand new, we are requesting that everyone redo their training. However, the only area for the 1-12 online or paper test that will require certification will be for scoring Speaking, for which we will have a new training module. Q: Will there be an online alternate version of the test in case of an irregularity? For example, if a student gets sick in the middle of a module. A: There is not an alternate form and if there is a testing irregularity (depending on circumstance), you will need to start the test again. If a student gets sick or the student needs to leave the room, we do have mechanisms to pause or exit the test. What will happen will depend if it is the same day or a different day. There will be test tickets to use again on the same day if students need to exit the test. All these new features will be outlined in the new Online Test Administration Manual. You will need to use the paperbased test if a student needs an alternate version due to not being able to test online.

4 Q: For the online training, do the online modules and checklists count as the quizzes for the Certificate of Completion? A: Yes, when we say that there s no certification for the online test, it means that you will view the modules and complete the checklists electronically. That will be all you need to do to get a Certificate of Completion. There will be no quizzes involved with it. For online testing, we re looking at a proctoring situation so we feel that individuals just need to go through the steps rather than, as with the Speaking scoring module (for the paper test), demonstrate knowledge of the WIDA Standards. Q: When will training be available? A: The ACCESS 2.0 preparation resources webpage lists all upcoming dates and you re able to sort by role (for Technology Coordinator, Test Coordinator, and Test Administrator). Around September 4 th is a key date for the release of a number of modules associated with the WIDA Assessment Management System, addressing WIDA AMS things you ll need to know in order to prepare for the online test. We will have other modules that will be released by early October with everything you will need to know about the online test itself (including practice items, etc.) Things that relate to accessing reports and final data validation will be available later. This is how we did the releases for this year s field test and the idea is that you will have everything well in advance of your testing session but that the releases follow the test development timeline as we re currently developing the new system and WIDA AMS and won t have things such as screenshots until those systems are done. Q: How will we be notified when test administrator training will be available? A: If you take a look at the website (Preparation Resources), you will see when all of the training will be available throughout the summer and fall. Let us know if you have specific questions. Materials will be available by September and October for the purposes of the test and we will have live webinars in the fall for Test Administrators, Test Coordinators, and Technology Coordinators, followed by monthly live Q and A sessions heading into testing windows. Q: When is the testing window in Illinois [or for any individual state]? A: That is information we are in the process of collecting and finalizing with all states. We don t expect many changes to testing windows except in cases where your state representative has made requests due to other tests that will be administered at the same time. We will share testing windows/key dates information on our website as soon as it is available. Q: For how long will the paper/pencil version be available? A: The paper-based test will continue to be available for situations in which students are not able to test online. We hope that all districts will be able to administer the tests online but we don t know when that point will be, technology-wise. What we can consider is that the paper test is moving to a static form over the next couple of years so we will not continue to refresh paper items. We will make changes to the online items. Therefore, the

5 students experience will be maximized through the online test because they will have the new items. Q: Will there be placement tests? If so will they be paper or online versions? A: We do have an online screener that will be available in spring The W-APT will continue to be available as a paper form through Note: WIDA will provide more information about screener options in the coming year. Q: How does INSIGHT ensure security during testing? A: INSIGHT is a secure browser that pops open when you log in and the students are then not able to interact with other parts of the computer. For example, they will not be able to open another browser and use Google. In terms of confidentiality of data, WIDA has more detailed information about test security we can provide upon request. Q: Will there be access to this webinar/ presentation later? A: It will be posted to our Preparation Resources webpage, as will next week s Technology Coordinator webinar. Q: Can we get a copy of the PowerPoint for today s webinar? A: The best place to get up-to-date info from this presentation will be in the Facilitator Toolkit (behind login). We will be updating the ACCESS 2.0 Toolkit regularly with the newest information and slides. Q: Who determines whether to administer Online or Paper/Pencil? A: That determination will be made by your WIDA state representative, who are in the process of determining what the state plans will be. From WIDA s perspective, we would like to see as many people testing online as possible as the test is more dynamic and interactive and will be beneficial to the consortium over the long run. Q: If we purchase headsets for ACCESS, will these be compatible with PARCC? A: From what we understand, PARCC and Smarter Balanced do not require headsets, only headphones. For our test, you will need headsets that have microphones built in them for the Speaking test, and those could be used for other assessments. Headphones used for other assessments can be used for the Reading, Listening and Writing tests. Q: Are we still scoring the Speaking? A: This will depend on which test you re administering. If you re administering the paper test, you will score Speaking on-site. If you re administering the online test, the student s voice recording file will be automatically sent to DRC to do the scoring. Q: Do you have a testing window available that the state will choose from? A: Each state determines its own testing window. We are currently providing guidance on how long some new processes will take, but the state will determine the final dates. Q: How and when can we start to adequately prep students for this test in terms of technology (e.g. Speaking)?

6 A: We have sample items that you will be able to access this summer and practice test items will be available in early October to have students try out with headsets. For Speaking, you ll want to make sure that your students understand that they should think about their responses before they give them (i.e. emphasize that in the practice). The Test Administrator will need to clearly communicate with the student how they will interact with the online test platform. Note: this information will be further outlined in the Online Test Administration Manual. Q: What webinars will be ready by June 5 th (for a training that day)? A: In early June, though just after that, we will have available the Sample Items for the Public, which will allow interaction with the new system. We also the live webinars we re holding today and next week, an upcoming pre-recorded webinar, and the Facilitator Toolkit PowerPoint (available with WIDA login). All of the training materials are being revised for next year to explain the new procedures as well as show how the new system will look, so most will be available beginning in early September. Q: Are there accommodations that will need to be turned on for the online test? A: This will be outlined in further detail in the upcoming accessibility and accommodations guidelines. We have tried to make accessibility tools available as much as possible and also create a streamlined process for selecting the accommodations only some students need. So, the majority of accessibility tools will be built into the online test for all students. There will only be three accommodations that will need to be turned on if a student has an IEP or 504 Plan. Those are: Manual Control to Start Audio Play of Items (as audio will otherwise start automatically); Repeat Item Audio (which otherwise will play only once); and Extended Speaking Test Response Time. We will explain this more in our training materials, and the process of turning on these accommodations will be pretty straightforward by selecting them within the WIDA AMS. Q: What kind of technology support will be available during testing? A: There are three parts to support. DRC Customer Service will be available in advance and throughout testing to provide technology support if there are questions about technology preparation and their systems. Our website has their contact information and hours of customer service, and they will begin extending their hours in June. WIDA will also be able to direct you to the right people, if you have questions. WIDA staff will not be answering the specific technology questions, as our focus will be on policy and WIDA-specific questions. Someone in your school will also need to be the technology person, as they ll be familiar with your local set up. Next week s Technology Coordinator webinar will address their role, which is also outlined in detail in the Technology Coordinator checklist. Q: Do we score Speaking by listening to the speaker or are we going to be listening to a recording? A: If the students take the online test, the recording will automatically be sent to DRC to score the responses. Test Administrators will not have to score anything for the online test. If you are administering a paper-based test, you will play a new media-delivered

7 recording of the prompt and you will score student responses on-site. This will be outlined in the new trainings for the paper-based test.