Comparison of Features: DataDirector 3.x vs. 4.0 DataDirector 4.0 represents an evolution in form and functionality from previous versions. Though we have taken this opportunity to introduce several new features, including an updated user interface, streamlined Exams and Assessments tab, simplified assessment creation processes, additional item creation tools, reporting clusters, and custom performance band sets,, many key features have undergone only minor changes and should still be recognizable to experienced users. If you have a question about a topic that you do not see addressed in this guide, please contact your Account Manager. Table of Contents General Use... 4 Logging In and Getting Started... 5 Sharing, Hiding, Duplicating, and Deleting Assessments... 6 Communication... 7 Locating Demographic Search Options... 9 Assessments... 10 Working With Assessments in DataDirector 4.0... 11 Creating an Exam Shell vs. Creating an Answer Sheet Assessment... 14 Multiple Response Questions... 16 True/False and Yes/No Questions... 18 Rubric-Scored Questions... 20 Short Answer / Extended Response Questions... 21 Number Grid Questions... 22 Aligning Questions to Standards... 23 Adding Multiple Questions at Once... 25 Creating an Item Bank Exam vs. Creating an Item Bank Assessment... 26 1
Creating an Assessment vs. Creating a Summary Assessment... 31 Creating a New Exam... 36 Attaching Additional Materials... 37 Using Auto Export... 38 Modifying Items, Sections and Clusters in 4.0... 39 Other Assessment Tab Functions Found in the Assessment Module... 42 Finding Former Exams Tab Functions in the Assessment Module... 44 Uploading Data... 46 Searching the Item Bank... 47 Displaying All Items in the Item Bank... 50 Displaying Your Own Items in the Item Bank... 51 Displaying Districtwide Items in the Item Bank... 52 Displaying Pending Items in the Item Bank... 53 Creating an Item... 55 Searching for Archived Assessments... 60 Sections and Clusters... 62 Adjusting Assessment and Exam Permissions... 68 Finding and Organizing Assessments Using Folders in DataDirector 4.0... 70 The Shared Assessments Folder... 70 The District Folder... 70 The State Assessments Folder... 70 The Personal Folder... 71 Refreshing Assessments After Changing Filters... 71 Subfolder Deletion... 71 2
Folder Permissions... 72 Setting Up User Level Permissions... 74 Assigning User-Type and Site Level Permissions... 76 Reports... 77 Exam Scoring... 78 Curriculum... 79 Standards Search... 80 Students... 81 Programs... 82 3
General Use 4
Logging In and Getting Started DataDirector 3.x DataDirector 4.0 The process for logging in is identical in both versions of DataDirector. Once a user enters their login information, they will be prompted to select a district. DataDirector 3.x 5
DataDirector 4.0 Sharing, Hiding, Duplicating, and Deleting Assessments DataDirector 3.x users will be familiar with several icons for sharing, hiding, duplicating, or deleting assessments. DataDirector 4.0 maintains all of the same functionality with an updated look and feel. Functionality 3.x Icon 4.0 Icon Share Hide Duplicate Delete 6
Communication The Communication process has undergone minimal changes in DataDirector 4.0. DataDirector 3.x In DataDirector 3.x, users begin by clicking on the Communication tab, displaying the Search Users screen. The image below is how the page appears with the advanced search option enabled. At this point, users have the option of searching for others in a number of ways. It is possible to view a list of site users, search by basic information like first or last name, or use advanced search options to locate and contact individuals. 7
DataDirector 4.0 In DataDirector 4.0 users access communication options by hovering their mouse over the Admin option then clicking Admin Tools. In the Admin Tools menu, the Communication option can be found along the left hand side. At this point, the Communication process becomes identical to DataDirector 3.x. 8
Locating Demographic Search Options The Data Tab has been consolidated into the Students Module in DataDirector 4.0. DataDirector 3.x In 3.x, the Data tab allows users to search for demographic information in a separate tab. DataDirector 4.0 In 4.0, the same options are accessed through the Students module. 9
Assessments 10
Working With Assessments in DataDirector 4.0 In DataDirector 3.x, Assessments and Exams were closely related, but separate. To improve the user experience, the functions performed within the Exams and Assessments tabs in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0. DataDirector 3.x In DataDirector 3.x, the Assessments tab is selected from the navigationbar at the top of the page. Opening the Assessments list, allows users to perform a number of key functions. Similiarly, users can access separate functions in the Exams tab. DataDirector 4.0 In DataDirector 4.0, users access the Assessments module through the Application Switcher. 11
Once the Assessments module is open, users will see the Find Assessments screen. This area serves as a hub for numerous folder-based activities, including finding Assessments within the folder structure. For more on folders, permissions and locating assessments, please see Finding and Organizing Assessments Using Folder 12
Finding and Organizing Assessments Using Folders in DataDirector 4.0. In DataDirector 3.x, Exams and Assessments were created separately under the Exams and Assessments tabs. In DataDirector 4.0, these functions have been streamlined into the same creation process. DataDirector 3.X DataDirector 4.0 13
In 4.0, clicking the Create Assessment link will begin the process, opening up the Create an Assessment page where users can choose which type of assessment they would like to create. The new types of Assessments and how they differ from their 3.x counterparts are explained in the Creating an Exam Shell vs. Creating an Answer Sheet Assessment, Creating an Item Bank Exam vs. Creating an Item Bank Assessment, and Creating an Assessment vs. Creating a Summary Assessment sections below. 14
Creating an Exam Shell vs. Creating an Answer Sheet Assessment The Answer Sheet Assessment in DataDirector 4.0 is a user-created test document that can be customized to suit the user s needs. In 3.x, an answer sheet was known as an Exam Shell or an Alignment. An Answer Sheet will allow students to take a teacher created or publisher test and record their answers on a bubble sheet, simplifying scoring and data upload for non-itembank tests. In 3.x, Exam Shell creation begins by clicking on the Exams tab, followed by the Create a New Exam link. This will open the Exam creation wizard.the Exam Shell creation process actually begins when the user opts to not use the Item Bank for their exam. The user must then enter the remaining creation information, including their answer key, which will be used to generate their answer sheets. Users can then administer their test, scan in student responses, and begin analyzing data. In 4.0, users will first need to access the Create an Assessment page through the Application Switcher. Clicking this link will open the Create Answer Sheet Assessment page, where the New Answer Sheet Assessment option is available. 15
Clicking this link opens the Create Answer Sheet Assessment page. Here, users can edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users can also determine question types, fill in their answer key and link questions to standards. Note that a variety of question type options exist, including multiple choice, multiple response, true/false, yes/no, short answer, rubric-scored, extended response, and number grids. The newer formats are reviewed in detail on subsequent pages. All types of questions will require the user to note the correct answer by clicking it, darkening the circle. It s also possible to deselect an answer by clicking it a second time. 16
Multiple Response Questions Multiple Response Questions are a new feature in DataDirector 4.0 which allow users greater flexibility in creating Answer Sheet Assessments. Multiple Response Questions allow a user to specify more than one correct answer for a question. For a student to score a correct on the question, they must identify each of the appropriate answers. On the above example, options A and C are the correct responses. The answer would only be marked correct if both A and C were selected. It s possible to customize answer choices for Multiple Choice questions in DataDirector 4.0. To begin, click the edit link to the right of the Answer column. This will open up the default options for customization. Users can select from these or choose the Custom button for further options. Clicking on the Custom button will open up a larger array of letter choices to include on the answer sheet, as well as numbers. Selected letters will appear in the box at the top of the window. Unwanted choices can be removed by hovering the pointer over the appropriate letter and clicking the red X that appears. 17
Clicking the Done button will return the user to the initial question, with their new answers included. Note that subsequent questions of the same type, regardless of section, will contain the same answer choices unless the user changes them to a different setting. DataDirector will also add the user s custom answers to the default answer bank for easy selection later on. 18
True/False and Yes/No Questions True / False questions are a new feature in DataDirector 4.0 which allow users greater flexibility in creating Answer Sheet Assessments. True / False questions ask students to determine whether a statement is true or false. Clicking the edit link allows these questions to be customized. Users form Yes / No questions, in which a student must determine whether the correct answer to a question is Yes or No, and select appropriately. It s also possible to choose custom answer letters. To delete an answer choice, hover your pointer over the letter and click the red X. 19
Clicking Done will return you to the Answer Sheet screen. Note that the system categorizes Yes / No questions as True / False questions. 20
Rubric-Scored Questions Rubric-Scored Questions allow for partial credit to be given based on a student s response, making it ideal for incorporating essay questions into an Assessment. When creating a Rubric-Scored question, it s possible to customize the number of levels by clicking on the edit link. This will bring up a dialog box where you can select the number of levels you would like your question to have. Enter the number of points you wish your question to be worth to the right of the level area. It s important to keep in mind that however many levels are possible for scoring is what the total number of points will be divided by. For example, a 24-point question with 6 levels will provide 4 additional points for every level a student moves up. Currently, it is not possible to customize rubrics beyond the options available. It is also not possible to rubric-score a number grid question. This functionality may be included in later releases. For more on number grid questions please see To use a short answer question, simply mark whether the student supplied the correct response on their answer sheet while entering data. It s also possible to customize answer types on Short Answer questions by clicking the edit link. 21
This will open the customization options window. Clicking on the Custom radio button will open further customization options. To delete an answer choice, hover your pointer over the letter and click the red X. Clicking on the Done button will return you to the Answer Sheet creation screen. DataDirector does not currently support more than two bubbles for short answer questions. Number Grid Questions. 22
Short Answer / Extended Response Questions Short Answer Questions have been implemented to provide even greater flexibility in the types of questions teachers can use on Answer Sheet Assessments. To use a short answer question, simply mark whether the student supplied the correct response on their answer sheet while entering data. It s also possible to customize answer types on Short Answer questions by clicking the edit link. This will open the customization options window. Clicking on the Custom radio button will open further customization options. To delete an answer choice, hover your pointer over the letter and click the red X. Clicking on the Done button will return you to the Answer Sheet creation screen. DataDirector does not currently support more than two bubbles for short answer questions. 23
Number Grid Questions Number grid questions allow open-ended responses to math or numerical questions. The process for creating these questions in 4.0 is different from 3.x. In the Answer column, DataDirector displays the number of columns students will have available to fill in, along with the currently selected correct answer. These will default to 5 and 0, respectively. Clicking the edit button to the right of the Answer column will allow you to change these parameters. Clicking the edit link will open a dialog box. Here, select the Custom option, which will open up the Grid Answer Editor window. Users can then enter the correct answer, as well as adjust the number of columns. Note that although there are five columns available to students, they will not all need to be used. 24
Aligning Questions to Standards In DataDirector 3.x, it was possible to add standards to a question by searching for standards and then linking them to specific questions in the assessment. In 4.0, this functionality still exists, but is executed differently. For Item Bank Assessments, standards are added automatically with questions. However, standards may also be added directly from the Edit Assessment page. 25
Clicking on the Add Standards button will bring up a Standards Search window that will be familiar to 3.x users. This window makes it possible to attach additional standards to an Assessment. 26
As standards are added to an Assesment, they will be listed under the Currently Aligned Standards area. Standards links for individual questions can be edited by clicking on the blue text in the Standards column. For more on Standards, please see the Standards Search section. Adding Multiple Questions at Once In DataDirector 4.0, it s also possible to add multiple questions to an Answer Sheet Assessment at once. Click the Add Multiple Questions icon at the bottom right hand corner of the screen. This will bring up a slider which you can use to adjust how many questions will be added to the Assessment. By default, the system will add multiple choice questions, but questions of other types can be added by selecting them from the question type drop down menu before clicking the Add Multiple Questions link. 27
Creating an Item Bank Exam vs. Creating an Item Bank Assessment The Item Bank Assessment in DataDirector 4.0 is a user-created test, including questions, that is generated to suit the user s needs. Users opting to create this type of exam will pull items from sets of items available to that user including Riverside items, district-created items, and items previously created by the user. In 3.x, this exam is created by clicking on the Exams tab, followed by the Create a New Exam link. This will open the standard Exam creation wizard.the user must answer Yes when prompted about whether they will be using the Item Bank to construct their exam. Users must then search for and select items from the associated Item Bank to begin creating their exam. 28
Once items are selected, the exam can be previewed and edited finalization and exportation to assessment. To create this type of assessment in 4.0, users first need to access the Assessments module from the Application Switcher. This will open the Find Assessments page. Here, users need to click on the Create Assessment link to proceed. 29
Doing so will open the Create an Assessment page, where the New Item Bank Assessment option is available. Clicking this link will open the Create Itembank Assessment page. Here, it s possible for users to edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users can also add questions to their assessment by clicking Add Items at the bottom of the page. 30
Clicking the Add Items button will open the Item Search window, where it s possible to apply a number of filter criteria in order to find appropriate items. The itembank search function has not changed. Once the user has searched for and selected their items, they can close out the search window to return to the Edit Itembank Assessment page. 31
Here, it s possible to create and assign questions to sections. For more on and clusters, please see Searching for Archived Assessments To search for an archived assessment in DataDirector 4.0, users must first enter the Assessments module via the Item Switcher. This will open the Find Assessments page. Here, users need to click on the Switch to List View option. 32
This will cause the window to appear like the one below. Users will need to select the appropriate criteria for their assessment and activate the Show Archived Assessments filter before clicking the Search button. DataDirector will then return the search results. 33
Sections and Clusters 34
Sections and Clusters or contact an Account Manager. 35
Creating an Assessment vs. Creating a Summary Assessment The Summary Assessment in DataDirector 4.0 is a spreadsheet containing summary data. Summary Assessments include data uploaded from state sources (state tests) and local assessments customized to suit the user s needs. In 3.x, an Assessment is created by clicking on the Assessments tab, then clicking Create New Assessment. This brings up the Edit Assessment Summary page. Users enter their preliminary information before proceeding to name their fields and enter point values for each subject. 36
Users may then enter the number of points each student has earned in each of the subject areas being assessed or upload the data from a file. Once data is entered, they can save their work and return to the menu for their Assessment. To create this type of assessment in 4.0, users first need to access the Assessments module from the Item Switcher. 37
This will open the Find Assessments page. Here, users need to click on the Create Assessment link to proceed. Doing so will open the Create an Assessment page, where the New Summary Assessment option is available. 38
Clicking this link will open the New Assessment Summary page. This page is identical to the current 3.x Assessment creation. Here, it s possible for users to edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users will also need to select how many fields will appear in their Assessment Summary. Users can then name each of the fields they ve specified and apply a maximum value for each area. 39
After clicking on Next Step, the Assessment Summary will appear. Users can then upload pre-existing data, enter their own data, or export the Summary as a report. 40
Creating a New Exam The process for Exam and Assessment creation is combined in DataDirector 4.0. DataDirector 3.x DataDirector 4.0 Users in 4.0 will need to click the Create Assessment link in order to begin the process. This will open up the Create an Assessment page. Here, users can choose which type of assessment they would like to create, and proceed as normal. For more information on the different types of assessments in 41
DataDirector 4.0, please see Working With Assessments in DataDirector 4.0 or contact your Account Manager. For more information on other former Exam functions, please see Finding Former Exams Tab Functions in the Assessment Module. Attaching Additional Materials Attaching supplementary materials to an Exam or Assessment in 3.x is accomplished on the overview page of either the Assessment or Exam. The function is not available during Exam or Assessment creation in 3.x. To use this feature, users must click the Add/Remove Additional Materials link while on the main information page of either the Assessment or Exam. To attach additional materials to an exam in 4.0, users must click the Upload a File button during the beginning of the assessment creation process. This functionality is available on the edit assessment page. To attach materials after an assessment has been created, click the Edit Assessment link in the left hand navigation. 42
Using Auto Export The Auto Export feature is enabled by default in DataDirector 4.0. Once users enter student data into an Itembank Assessment or an Answer Sheet (formerly an Itembank Exam or Exam Shell), that data will automatically be exported into a Summary Assessment (formerly an Assessment). The Summary Assessment will be linked to the Itembank Assessment or Answer Sheet through the Summary Assessment link in the left hand navigation. 43
Modifying Items, Sections and Clusters in 4.0 In DataDirector 3.x, modification of items, sections and clusters was accomplished using the Modify Questions/Items link on the main page of the user s Exam. 44
This would open the Modify Questions / Items screen, where it was possible to rearrange the exam by entering the order in which the user wanted questions to appear. Clusters were added on a separate page with a different process. In 4.0, these same changes can all take place on the main Edit Assessment page. Sections and questions can be added easily by selecting the Add Section and Add Items buttons. Users can rearrange questions and sections on-the-fly using convenient handlebars on the left side of the screen.simply grab the handle bar and drag and drop each question or section into the appropriate location. 45
Users can also edit their reporting cluster information from the Edit Assessment page. This functionality is identical within the Create Answer Sheet Assessment module. For more on Sections and Clusters in 4.0, please see 46
Sections and Clusters. 47
Other Assessment Tab Functions Found in the Assessment Module The functions performed within the Assessments tab in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0. The process for accessing these functions is different in both versions. DataDirector 3.x In DataDirector 3.x, the Assessments tab is selected from the tab bar at the top of the page. This will open the Assessments List, where a number of key functions can be found on the left hand side menu. DataDirector 4.0 In DataDirector 4.0, users need to access the Assessments module through the Item Switcher. 48
Once the Assessments module is open, users will see the Find Assessments screen. Here, users can access a number of familiar features from DataDirector 3.x. The View Assessments function has been rolled into the Find Assessments section of the Assessments menu, which is the default window in the Assessment module. Each of the Assessment functions within DataDirector 4.0 works the same as in previous versions. DataDirector 3.x DataDirector 4.0 49
Finding Former Exams Tab Functions in the Assessment Module The functions performed within the Exams tab in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0. The process for accessing these functions is different in both versions. DataDirector 3.x In DataDirector 3.x, the Exams tab is selected from the tab bar at the top of the page. This will open the Exams List, where a number of key functions can be found on the left hand side menu. DataDirector 4.0 In DataDirector 4.0, users need to access the Assessments module through the Item Switcher. 50
Once the Assessments module is open, users will see the Find Assessments screen. Here, users can access a number of familiar features from DataDirector 3.x. 51
Uploading Data It is possible to upload pre-existing data in both versions of DataDirector; however, the process is located in different areas on each version. While under the Exams tab in DataDirector 3.x, users can click Upload to Multiple Assessments in order to incorporate pre-existing data into different exams. DataDirector 3.x DataDirector 4.0 In DataDirector 4.0, users must first navigate to the Assessments module through the Item Switcher. Once there, users can click on the upload function, which then becomes identical to the function from 3.x. 52
Searching the Item Bank DataDirector 3.x To perform an Item Bank search in DataDirector 3.x, users need to first access the Exams tab. This opens the Exams List page, where the Search Item Bank feature is available on the left hand side menu. The Item Bank can then be searched using a number of criteria, including Item ID numbers, filtering state and national standards, and item publisher. The user is then able to add the desired items to their exam. 53
DataDirector 4.0 To search the Item Bank in DataDirector 4.0, users must navigate to the Assessments page from the Overview page using the Switcher in the upper-left hand corner of the screen. Once on the Assessments page, the user needs to click on the Manage Item Bank tab on the left hand side of the screen. 54
Once at the Item Search page, the user can proceed to search just as they would have in DataDirector 3.x. Users can also browse all items, their own items and items created by others in the district. As DataDirector 4.0 continues to grow, new functionality will be added to this tab. 55
Displaying All Items in the Item Bank It is possible to view a list of every item in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the All Items link. DataDirector 3.x DataDirector 4.0 In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank. This will bring up the Item Search page, where it is possible to access the list of all items within the Item Bank. 56
Displaying Your Own Items in the Item Bank It is possible to view a list of only items that you have created in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the My Items link. DataDirector 3.x DataDirector 4.0 In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank. This will bring up the Item Search page, where it is possible to access a list of your items within the Item Bank. 57
Displaying Districtwide Items in the Item Bank It is possible to view a list of district-specific items in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the Districtwide Items link. DataDirector 3.x DataDirector 4.0 In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank. This will bring up the Item Search page, where it is possible to access a list of districtspecific items within the Item Bank. 58
Displaying Pending Items in the Item Bank It is possible to view a list of pending items in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the Pending Items link. DataDirector 3.x DataDirector 4.0 In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank. 59
This will bring up the Item Search page, where it is possible to access a list of all pending items within the Item Bank. Please note that this feature is available only to a limited number of users. 60
Creating an Item The primary difference in the item creation process between DataDirector 3.x and 4.0 is the number of item types users have the ability to create. In 3.x, it is only possible to create multiple choice questions, while 4.0 users can create multiple choice, true/false, yes/no, short answer and constructed response questions. DataDirector 3.x To create a new Item in DataDirector 3.x, users need to first access the Exams tab. This opens the Exams List page, where the Create an Item feature is available on the left hand side menu. This will open the Item Builder. Once the Item Builder is open, it s possible to create a new multiple choice question for use in assessments. Once incorrect and correct answer choices are established, users need to note whether the item will wrap into more than one column, whether the item will be available for use in exams, the primary language of the item and its cognitive difficulty. At this point the user can finish the item creation process by clicking Create Item. 61
DataDirector 4.0 To create an item in DataDirector 4.0, users must navigate to the Assessments page from the Overview page using the Switcher in the upper-left hand corner of the screen. Once on the Assessments page, the user needs to click on the Manage Item Bank tab on the left hand side of the screen, which will take them to the Search Item Bank page by default. 62
Once at the Item Search page, the user must click the Create New Item link. The Create New Item link will take users to the Item Properties page, which is nearly identical to the Item Properties page found in 3.x. The main difference is the inclusion of a drop-down Item Type menu, which allows users to select between multiple choice, true/false, yes/no, short answer and constructed response questions. Please note that at this time, online testing only supports multiple choice item types. The multiple choice item creation process is identical to the 3.x multiple choice item creation. However, if a user opts to create another type of question, the screen will automatically change accordingly. 63
True/false and yes/no items are constructed using a radio button where the user notes the correct answer after typing the question. The true/false item type is pictured below, but the yes/no item type will appear in the same format. Short answer questions are created by typing the question in the appropriate box and filling in the answer under the Correct Answer box. 64
Constructed response questions are also created by typing the question in the appropriate box and filling in the answer under the Correct Answer box. Once a correct answer has been supplied, the user can then fill in Rubric Scores depending on what answer is appropriate for each point level. There are four rubric scores (0-3) by default, but more can be added or removed as needed. Once the possible answers have been entered, the user needs to select whether the item will wrap into more than one column, whether the item will be available for use in exams, the primary language of the item and its cognitive difficulty. At this point the user can finish the item creation process by clicking Create Item. 65
Searching for Archived Assessments To search for an archived assessment in DataDirector 4.0, users must first enter the Assessments module via the Item Switcher. This will open the Find Assessments page. Here, users need to click on the Switch to List View option. 66
This will cause the window to appear like the one below. Users will need to select the appropriate criteria for their assessment and activate the Show Archived Assessments filter before clicking the Search button. DataDirector will then return the search results. 67
Sections and Clusters Sections and reporting clusters are handled differently in DataDirector 3.x and 4.0. In 3.x, sections and clusters are not considered different entities. DataDirector 3.x To edit reporting clusters in 3.x, users must first locate and open the exam they wish to work with. Once this exam is open, they must click the Links to Clusters link. If no clusters currently exist, users will be prompted to create clusters. Once the clusters have been identified, the user can begin linking questions to clusters. To do so, the user must first click on the radio button of the desired cluster on the left hand side of the screen. Then, they need to click and check off each of the questions they would like associated with that cluster. Finally, clicking the Link button will assign those questions to the appropriate cluster. Questions can be unlinked from reporting clusters in a similar fashion. The user can then click Return to Exam when they have finished assigning questions to clusters. DataDirector 4.0 In DataDirector 4.0, sections and reporting clusters are considered different entities, and each has a unique function within the system. Sections have been reimplemented as distinct areas of a single exam, while clusters are used to better target reporting efforts. Each cluster can be assigned its own customized set of performance bands which will display in the Assessment Report. 68
Users can still create reporting clusters based on sections of an assessment, but clusters can now also be structured around a group of standards, cognitive difficulty level, Bloom s Taxonomy Level, or criteria defined by the user. Questions can even lie in different sections and still be added to the same cluster. Since sections can be used as criteria for reporting clusters in DataDirector 4.0, this guide will first cover the creation of sections. To create an exam section, the user must locate and access the exam in which they wish to add sections. Once the appropriate exam has been opened, the user needs to click on the Edit Assessment link on the left hand side of the Assessment Overview page. This will open the Edit Itembank Assessment page or Edit Answer Sheet Assessment page. 69
The user will need to scroll down until they locate the Add Section button. Clicking this button will add a new section to the exam, which the user must then name. Questions can be added to the section by clicking the Add items link. In addition, users can reorder questions using the handlebars on the left hand side of each question to dragan item into a section. The sections of an assessment can also be rearranged in this fashion. Users should be sure to click Save before moving to another part of the assessment, or their changes will not be saved. 70
Once the sections of an exam have been created (if necessary), a user can proceed to the cluster creation process. To begin, the user needs to click on the Edit Reporting Clusters link on the left hand side of the page. This link can be accessed from the Assessment Overview page. Clicking the link will bring the user to the Reporting Clusters page, which will detail all the standards linked to the current Assessment, sections created, and any preexisting clusters. Notice that the volume section created earlier is listed under the Sections area of the standards list. 71
Scrolling to the bottom of the page will bring the user to the Custom Reporting Clusters section, where they can add a new reporting cluster to their Assessment ny clicking Add a Reporting Cluster. Clicking this button will bring up a box titled Creating New Cluster. Here, the user can identify the cluster s name and check off which questions will be included in the cluster. Notice that Question 18 has automatically been listed in the Volume section so that the user can easily see how questions are grouped on the assessment. 72
Once the user s desired questions have been incorporated into the cluster, the user can also choose to add custom performance bands for that cluster. To do so, the user must click on Performance Band and select the New Performance Band option. This will bring up the pictured box, where the performance band set can be titled and customized. Once a user is done entering this information, they need to click save in order to ensure their changes are preserved. The cluster will then be added to the standards page. Once the user clicks on the save button on this page, the cluster will be ready for use in reporting. 73
Adjusting Assessment and Exam Permissions In DataDirector 3.x, permissions between Exams and Assessments were kept separately, although it was possible to copy permission sets from an Exam to an Assessment. 74
Users who have transferred over Exams and Assessments from DataDirector 3.x to DataDirector 4.0 will find that their pool of permissions has been combined as well; DataDirector will automatically assign the larger of the two pools to the new assessment. 75
Finding and Organizing Assessments Using Folders in DataDirector 4.0 Folders are a new way to organize, access and share Assessments within DataDirector 4.0. The Find Assessments page serves as a hub for all folder and Assessment based activity. The Shared Assessments Folder The Shared Assessments folder is where users will find any Assessments that have been shared with them, including state and district data (for non-administrative personnel). In a forthcoming update, a new Folder will be created to house State data. The District Folder The District admin can choose which assessments can be placed in the District Folder. Users should be cautious when placing district benchmarks directly into the district folder, as folder permissions override Assessment permissions. It may be advisable to create a subfolder in the District Folder with appropriate permissions for district benchmark Assessments. See Folder Permissions for more. The State Assessments Folder The State Assessments Folder is a subfolder of the District folder. All state assessments will automatically migrate into the State Assessment folder and do not need to be moved. All user permissions will remain the same as in the current version of DataDirector. 76
The Personal Folder Any Assessments created by the user appear in the Personal Folder. Administrators will also find state data in their Personal Folder. Refreshing Assessments After Changing Filters To refresh which Assessments appear in your folders after changing a search filter, click the green Refresh arrows in the top right corner of the folder area. Subfolder Deletion It is possible for district administrators to delete subfolders. This is accomplished by clicking on the small cog to the right of the folder s name and selecting the Delete option. However, if the subfolder contains any Assessments, it will be impossible to delete. Users should ensure that all Assessments have been moved to different folders or deleted before attempting to delete a subfolder. Additionally, if users are still unable to delete a subfolder after removing all Assessments, they should employ the hidden assessment filter in order to locate any remaining assessments. This will allow the removal or deletion of Assessments so that the folder itself can ultimately be deleted. 77
Folder Permissions Initially, only District Administrators have access to all District and School folder permissions; however, Administrators can provide these permissions to any individual. All users can view the District folder. In addition, users may view the School folder of Schools to which they are affiliated. Permissions associated with the District and School folder will override assessment permissions. Only District Administrators may create and edit District and School folders. In addition, the District Administrator can provide these permissions to the appropriate individuals. To edit permissions for a folder, a user will need to click on the small cog next to the folder s title. This will open a small menu where users can either create a sub folder or share exam permissions with another user. 78
After clicking the Share option, a new window will open, revealing the permissions sets within the specific site the user has chosen. Here, it s possible to set up permissions for individuals, user types, or at the site level. 79
Setting Up User Level Permissions To establish permissions for an individual or a group of people, the user must click on the Add New Sharing Rule Button. This will pull up a new dialog box where the user can select an individual (or a group of people by normal control + or shift + click actions) and establish permissions. 80
After selecting the appropriate people, the user will need to specify which permissions that group will have access to before clicking the Add button. The user(s) will then be added to the list on the main permissions page, along with quick-reference icons detailing which permissions they have. Notice it is also possible to edit or remove a permission set at any time using the links on the right hand side of the box. 81
Assigning User-Type and Site Level Permissions The process for assigning Site Level permissions is identical to the User Permissions process. However, when setting User-Type permissions, it is also necessary to choose the site for which you would like the permissions applied. 82
Reports 83
Exam Scoring In version 3.x, users can enter data and view their results in the system immediately. To improve system performance overall, DataDirector 4.0 requires all exams to be scored on a separate server. As a result, users may notice a 5 to 10 minute delay between the time that a user enters their data and the point at which they can review and begin analysis. The DataDirector team is working to reduce or eliminate the delay in scoring before DataDirector 4.0 goes live. 84
Curriculum 85
Standards Search The process for browsing standards has been relocated for DataDirector 4.0. DataDirector 3.x In DataDirector 3.x, users can access the Standards tab directly from the home page. DataDirector 4.0 In DataDirector 4.0, users must first access the Curriculum module from the Overview page. Standards can then be searched or browsed normally. 86
Students 87
Programs 88