MCESA REILize Decision Support System Profile Teacher

Transcription

1 System Profile Teacher

2 Contents Overview... 3 Terminology... Error! Bookmark not defined. System and Software Requirements... 4 ADEConnect Invitation and Password Reset... 5 ADEConnect Invitation ADEConnect Password Reset... 6 Log In... 8 Navigation Bar... 9 Learning Observation Instrument REILize Decision Support System Profile Home Page REIL Score Page Verify REIL Score on the Data Verification Page Observation Reports Observation Reports: Summative Cycle Report Observation Reports: Reinforcement and Refinement Report Observation Reports: Observation Cycle Report Observation Reports: LOI 3 Plus Points Report School Growth Reports School Growth Reports: Value Added Measure (VAM) by Subject School Growth Reports: Galileo Categorical Growth Measure (CGM) by Subject List of Navigation to Reports and Pages Troubleshooting Page 2

3 Overview The REILize Decision Support System Profile collects Evaluator observation data into the True North Logic (TNL) Observation Tool. The scoring data is based upon the MCESA REIL Learning Observation Instrument (LOI) which is used to measure teacher performance, and the MCESA REIL Learning Observation Instrument SPED (LOI) which is used to measure Special Education teacher performance. The LOI is the result of a collaborative effort between MCESA and the participating Maricopa County school districts implementing the REIL Program. The purpose of this coordinated effort is to establish a rigorous, transparent, and fair evaluation system that recognizes excellence and supports the professional growth of teachers. The REILize Decision Support System Profile will provide the reporting capabilities that will enable teachers to view comparable reports for Observation data, allow teachers to report concerns or questions about their REIL Scorecard, and view and verify their REIL Scorecards. This release will be utilized by teachers and Special Education teachers and will provide: Observation Reports: a comprehensive set of observation reports that contain all of the submitted observation data for all observation cycles during the course of a school year. Teachers can view, print, and copies of a report for their personal records. School Growth Reports: depending on which assessments the school administers, these reports show the school s average growth in subject-specific performance scores for the AIMS, Stanford-10, and ATI/Galileo assessments. REIL Score Verification: teachers have the opportunity to view and verify the REIL Score they have achieved, and also have the opportunity to submit a support ticket if they have inquiries about their REIL Score. Learning Observation Instrument (LOI): teachers can access a PDF version of the Learning Observation Instrument which contains the Scoring Rubrics, Elements, and Descriptors against which the teacher is being scored by the Evaluator. Special Education teachers may view the version of the Learning Observation Instrument with a SPED overlay. A teacher must have an ADEConnect account to access the REILize Decision Support System Profile. ADEConnect is the new Identity Management System for educational stakeholders and professionals throughout the state of Arizona and is managed by the Arizona Department of Education (ADE). Teachers with existing ADEConnect accounts may access the Decision Support System Profile by visiting the ADEConnect Single Sign On site at and selecting the REILize Decision Support System Profile - Teacher link. The first time that teachers access ADEConnect, they will be required to choose another password and must first follow the steps outlined in the ADEConnect Invitation and Confirmation section of this guide. The guide includes numerous tips that may greatly aid your ability to quickly get to the information you want to access as quickly as possible. Look for a visual cue similar to this one: Tip: Be sure to close your browser windows to end your session and protect your information especially if you share your computer with others! Page 3

4 System and Software Requirements MCESA REILize Decision Support PC Platform Requirements Operating System: Windows XP SP3, Windows 7 SP1 Processor: 1.3 GHz (Minimum) RAM: 512 MB (Minimum) Browser: Internet Explorer 9 and 10 are recommended, Internet Explorer 7* and 8 are supported, Chrome 1.5 and above, Safari 5.0 and above, Firefox 11.0 and above Additional Windows XP Requirements.NET Framework 4.0 Client Profile v or higher / Link ID NET Framework 4.0 Extended v or higher / Link ID Apple Macintosh Platform Requirements Operating System: OSX Tiger and above Processor: Mac G5 RAM: 512 MB Browser: Safari 5.0 and above Software Requirements Adobe Reader or Adobe Acrobat *Exceptions The Data Verification page does not support Internet Explorer 7 Page 4

5 ADEConnect Invitation and Password Reset ADEConnect Invitation MCESA REILize Decision Support All new users of the REILize Decision Support System Profile will receive an ADEConnect Invitation . Existing users may go directly to ADEConnect at and sign in, and then click on the REILize Decision Support System Profile link. An Arizona Department of Education (ADE) account has been created for Peralta, Melinda. You have received this message to access the system granted to you through the ADEConnect: UserName: Temporary Password: Users who do not already have an ADEConnect may select the URL link in the invitation. Users who experience any issues logging into ADEConnect or who have questions related to their ADEConnect account should You will be required to change this password the first time you sigh in to ADEConnect. Your ADE systems will be available through If you believe this account has been created in error, please contact the Arizona Department of Education Support Center. Thank you. Phone (602) Toll free: 1(866) Fax: (602) Hours: Monday - Friday, 8:00AM - 5:00PM adesupport@azed.gov Once users click on the Invite URL, they will begin the Password Reset process outlined in the next section of this guide. Any Teacher who did not receive the invitation or who are unable to successfully reset their password or sign in to ADEConnect should adesupport@azed.gov for support. Page 5

6 ADEConnect Password Reset Users who click the Invitation URL are directed to the ADEConnect Sign In page. Any teacher that has already reset their password may sign in and proceed to navigate to the REILize Decision Support System Profile and do not need to follow the steps in this section. 1. Navigate to the ADEConnect Sign In page by selecting the link provided in the ADEConnect invitation Key in your user name and temporary password exactly as shown, then select the Sign In button to continue. 3. On the Password Reset page key in your current password, your new password, and confirm your new password. 4. Select the Change Password button to continue. Please note the ADE Password Policy information at the bottom of the page for guidance on acceptable passwords. 5. The ADEConnect Sign In page should redisplay with a message at the bottom if the password reset request was successful. 6. Key in your User Name and new Password and select the Sign In button to continue. Carefully note and secure your User Name and Password. If you do not know your User Name or Password, then select the Forgot Password? link for steps to recover the information. See Step 9. Page 6

7 7. On the Acceptable Use Policy page, read and review the information and then click the Accept button to record that you understand and accept the policy. 8. Click the Next button on the Password Registration page. You will be prompted to enter three secret questions and answers to be used in case of a lost password or username. 9. Select the REILize Decision Support System Profile link. Page 7

8 Log In Access the REILize Decision Support System Profile from the Arizona Department of Education ADEConnect page. 1. Navigate to the ADE Connect page at al/ and enter your User name and Password, then click the Sign In button. Your User name will be the you registered with. 2. Click the REILize Decision Support System Profile link. Page 8

9 Navigation Bar The Navigation Bar is at the top of every page in the REILize Decision Support System Profile. It allows the teacher to change their viewing preferences, navigate to their REIL Score, reports, and view this User Guide. Select Quick Links to access reports, the Verify REIL Score page, the Learning Observation Instrument, or the REIL Score page. The Fiscal/School Year displayed here reflects the Fiscal/School Year of the information being viewed. This can be changed in My Preferences. Select ADE Portal to return to the ADE Common Logon Program list. Select My Preferences to modify the Fiscal/School Year, District, Role, School, and Profile View. Select Help for ADE Support Center contact information. Page 9

10 Learning Observation Instrument MCESA REILize Decision Support The Learning Observation Instrument (LOI) is a PDF that contains the Scoring Rubrics, Elements, and Descriptors against which teachers are scored during an Observation session. This document can be accessed by selecting Learning Observation Instrument or Learning Observation Instrument (SPED) from the Quick Links submenu. The SPED version of the LOI will have a Special Education Overlay. The Rubric title and detailed description. Example of the structure of the LOI The Element description and the Session (shaded) to which it applies. Each column represents the potential ROI Point value, and the description associated with that point value. Standard PDF capabilities will display at the bottom of the page: Save, Print, Page Backward, Page Forward, Jump to Page, Zoom In, and Zoom Out. Page 10

11 REILize Decision Support System Profile Home Page MCESA REILize Decision Support The REILize Decision Support System Profile home page is displayed upon login. The REIL Scoring Gauge consists of performance level classifications which include a performance level scoring range and a description. Submitted data is updated overnight, so will not be visible until the business day after the Evaluator enters the scores into the Observation Tool. Click the REIL Score link to navigate to the REIL Score page. The REIL Score Marker will slide to the right until it reaches the point that corresponds to the user s REIL Score. If the REIL Score has not yet been calculated, the marker will remain at the beginning of the bar. Effective 1 and Effective 2 may be combined depending upon the teacher s school. The Observation Component displays a bar graph of the Points Earned for each submitted observation Evaluation Cycle. Hover over each bar to display points earned and points possible for each Rubric. Click a bar on the chart to view the Observation Cycle Report for that Cycle. Click the View All Observations link to navigate to the Summative Cycle Report. The School Growth Component displays up to two reports (depending on the assessments) showing the school s average subject-specific performance scores: Value-Added Measure (VAM) is based upon AIMS and Stanford-10 assessments. Select the VAM Performance Score to launch the School Growth: Value-Added Measures by Subject Report. Categorical Growth Measure (CGM) is based upon ATI/Galileo assessments. Select the CGM Performance Score marker to launch the School Growth: Value- Added Measures by Subject Report. Page 11

12 REIL Score Page MCESA REILize Decision Support Navigate to the REIL Score page by selecting REIL Score from the Quick Links submenu, or by clicking the REIL Score link above the REIL Score Gauge on the Profile page. Click the Export to PDF button to launch the REIL Score page in a PDF. This PDF can be saved or printed. Select Print Report to launch the computer s Print dialog window. For each Measure, the report displays the Performance Score (1-5), Weight, Points Earned, and Total Points Possible. Performance Score Weight = Points Earned Click the blue Performance Score link to view the Summative Cycle Report. Click the blue Verify REIL Score link to navigate to the Data Verification page in order to verify the REIL Scorecard, or to submit a Support Ticket for any questions or issues regarding the REIL Scorecard. See the next section of this guide for more information. The Total Possible Points for each measure are totaled at the bottom. This is the Total REIL Score. The Total Page 12

13 Verify REIL Score on the Data Verification Page MCESA REILize Decision Support Access the Data Verification page by selecting REIL Score from the Quick Links submenu. This page can also be accessed by clicking the Verify REIL Score link from the REIL Score Page. Users can verify their REIL Score or can submit a support ticket with inquiries about their REIL Score. A full Awards User Guide is available from MCESA. Review the REIL Score information in the Scorecard section of the Data Verification page. Click the Submit Support Ticket button to communicate inquiries to Support. Click the Verify button to verify the REIL Scorecard. Page 13

14 Observation Reports Once the Observation scores have been entered by the Evaluator, Teachers have three Observation Reports available to view the score information: Summative Cycle Report, Reinforcement/ Refinement Report, and the Observation Cycle Report. Observation Reports: Summative Cycle Report The Summative Cycle Report displays the individual and cumulative REIL LOI points earned for each mandatory Rubric for all scored Cycles. Access this report by clicking the blue View All Observations link from the Profile page, or by selecting Summative Cycle Report from the Quick Links submenu. View the Observation details and the REIL ROI Points earned for each Cycle Click the linked text to view the Evaluator s Reinforcement and Refinement Report. Cumulative Summary of Total REIL LOI Points Earned displays the total points earned over all cycles scored to date. The Performance Score column displays the sum of actual LOI points earned for each Rubric Element for all sessions for all completed observation evaluation cycles. Cumulative Summary of % LOI Elements Rated 3 or Higher displays the percentage of Elements rated 3 or higher overall cycles to date. The Performance Score column displays a Performance Score based upon the percentage of Elements rated 3 or higher, dependent upon the number of completed cycles. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 14

15 Observation Reports: Reinforcement and Refinement Report MCESA REILize Decision Support The Reinforcement and Refinement Report contains the Evaluator s comments for all scored cycles for the selected Fiscal/School Year. Access this report by clicking underlined Reinforcement/Refinement links in the Summative Cycle Report, or by selecting Reinforcement & Refinement Report from the Quick Links submenu. Each row provides, for each Cycle, the Observation details and the Evaluator s Reinforcement and Refinement comments for the chosen Rubrics. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 15

16 Observation Reports: Observation Cycle Report MCESA REILize Decision Support The Observation Cycle Report displays the Points Earned for each of the Rubric s Elements for the Pre-Observation, Observation, and Post-Observation sessions that have been scored. Access this report by clicking the bar for any cycle in the chart in the Observation Component on the Profile page, or by selecting Observation Cycle Report from the Quick Links submenu. Navigate the report pages to view the Evaluator Comments, and the Evaluator s Reinforcement and Refinement comments. Use the School dropdown menu to view the report for all associated schools. To view the Observation Report for a different cycle, change the Cycle Number dropdown, and then click the View Report button. View each scored Rubric and Element. Click the minus (-) and plus (+) symbols to show/hide the Element text for any rubric. The Pre, Obs, and Post columns display the scores earned for each Element in that Session. The Points Earned column totals the scores for each Element and Rubric. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 16

17 Observation Reports: LOI 3 Plus Points Report MCESA REILize Decision Support The LOI 3 Plus Points Report displays the Points Earned for each of the Rubric s Elements for the Pre-Observation, Observation, and Post-Observation sessions that have been scored. The report calculates the percentage of Elements that received a score of 3 or higher and highlights those scores as a visual cue. Access this report by selecting LOI 3+ Points Report from the Quick Links submenu. The Cycle columns display the points earned for every Element of every scored Rubric. Scores 3 and higher are highlighted green. The Total LOI Points row displays the sum of LOI Points for each Cycle, and the total points earned over all scored Cycles. The total average percentage of all Elements that scored 3 or higher for each Cycle is displayed both at the top of the report and in the 3+% row. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 17

18 School Growth Reports Teachers have two School Growth Reports available to view school performance in more depth: Value Added Measure (VAM) by Subject Report and the Galileo Categorical Growth Measure (CGM) by Subject Report. School Growth Reports: Value Added Measure (VAM) by Subject The VAM by Subject Report displays an estimate of the school s contribution to student growth on the AIMS and/or Stanford-10 (if their school participated in these assessments). Access this report from the Profile page by clicking on the plot point on the chart in the School Growth Component section. The top labels represent Performance Classification Scores (1 through 5). The bottom labels represent the standard deviation from the State Mean in increments of.5 (-3.0 through 3.0) The decimal value in the white square represents the value-added growth estimate of the school s contribution to student growth in that subject area on the AIMS and/or Stanford-10. These value-added estimates are expressed in standard deviations from the mean contribution of all schools across the state. The numbers on either side of the Value-Added Growth Estimate represent the Confidence Interval Range. There is a 95% confidence that the school s true value-added contribution to student growth falls within this range. Researchers have found that a difference of 0.5 standard deviations from the state mean represents about 1/5th of a year s worth of academic growth. A value-added growth estimate of -1.0 suggests that your school contributed about 2/5ths of a year s worth of academic growth less than the mean contribution of all schools across the state. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 18

19 School Growth Reports: Galileo Categorical Growth Measure (CGM) by Subject The Galileo CGM by Subject Report displays an estimate of the school s contribution to student growth on the AIMS and/or Stanford-10 (if their school participated in these assessments). Access this report from the Profile page by clicking on the plot point on the chart in the School Growth Component section. The top labels represent Performance Classification Scores (1 through 5). The bottom labels represent the School-Level Average CGA Score ranges. The decimal value in the white square represents an estimate of the proportion of students within the school that moved from scoring below the standard on the fall pre-test to above the standard on the spring post-test (or viceversa). A score of 1 indicates there was a significant decrease in the proportion of students achieving mastery, a 2 indicates that the majority of students maintained their mastery, and a 3 indicates a significant increase in mastery. Navigate back to the Profile page by selecting Home from the Quick Links submenu. Page 19

20 List of Navigation to Reports and Pages MCESA REILize Decision Support Report or Page Description Navigation Path Option(s) Home/Profile Page From Quick Links select Home Data Verification Page From Quick Links select Verify REIL Score From REIL Score Report select Verify REIL Score REIL Score Report From Quick Links select REIL Score From the Profile Page select the REIL Score link Observation Cycle Report From Quick Links select Observation Cycle Report From the Observation quadrant on the Performance Dashboard click on the bar hot spot above a Cycle Number in the chart From the LOI 3+ Rate quadrant on the REILize Decision Support System Profile Home Page click on the Points Earned link adjacent to a Cycle Number Summative Cycle Report From Quick Links select Summative Cycle Report From the REIL Scorecard quadrant on the REILize Decision Support System Profile Home Page select the Performance Score link adjacent to the measure Total LOI Points Earned From the LOI 3+ Rate quadrant on the REILize Decision Support System Profile Home Page click on the Points Earned link adjacent to the Totals Reinforcement and Refinement Report From Quick Links select Reinforcement & Refinement Report From the Summative Cycle Report select any link in the Reinforcement or Refinement column LOI 3+ Points Report From Quick Links select LOI 3+ Points Report From the REIL Scorecard quadrant on the REILize Decision Support System Profile Home Page select the Performance Score link adjacent to the measure Pct. LOI Elements Rated 3+ From the LOI 3+ Rate quadrant on the REILize Decision Support System Profile Home Page click on the Pct Rated 3+ link adjacent to a Cycle Number or Totals Learning Observation Instrument From Quick Links select Learning Observation Instrument or Learning Observation Instrument SPED Page 20

21 Troubleshooting General I clicked the browser Back button but the page did not respond. Use the Navigation Bar and the various navigation links or buttons to navigate within the REILize Decision Support System Profile. ADEConnect User Account Sign In I do not have an ADEConnect User Account. I have an ADEConnect User Account, but I do not know my password. I logged into ADEConnect, but I do not see a link to REILize Decision Support System Profile Page. Contact ADE Support. Click the Forgot Password? link on the ADEConnect Sign In page for steps to recover the information using the Password Reset feature. Contact ADE Support. My REILize Decision Support System Profile Report Data I am not seeing all of my observation cycles on the reports. The REILize Decision Support System Profile will only report on observation cycles for which Evaluators have submitted data, and that data has been electronically communicated to the system. The data is typically updated overnight, so will not be visible until the business day after the Evaluator enters it into the Observation Tool. If you have verified that these conditions have been met but still do not see results, contact ADE Support. Printing Reports My reports don t exactly fit on 8 ½ x 11 paper. Select the Fit option when attempting to print your report. In most cases, it will adjust your report to fit on 8 ½ by 11 paper and still be legible. It may be necessary to make some other adjustments such as printing on legal paper, changing the orientation to landscape, etc. REIL Score Data Verification I have a question or concern about my REIL Score. I cannot access the Data Verification page. Submit a support ticket on the Data Verification page. Navigate to this page by clicking on Verify REIL Score from the Quick Links submenu, or from the REIL Score report. Contact ADE Support. I was not able to verify my REIL Scorecard or submit a support ticket. Contact ADE Support. ADE Support Contact Information Local: (602) Toll Free: 1 (866) adesupport@azed.gov Page 21