CHARTrunner Data Management System

Transcription

1 PQ has a new quality data management and data entry system that stores data in SQL Server. If you are familiar with the way that SQCpack manages data then you will recognize a lot of similarity in this product. The product is called the CHARTrunner Data Management system (CRDM). CRDM is offered as part of a subscription bundle (called CHARTrunner Enterprise) consisting of CHARTrunner plus CRDM. There are a number of reasons why the CHARTrunner Data Management system was created: 1. To help customers who would like to use CHARTrunner but currently have no means of manually entering data into a data source so that CHARTrunner can analyze the data. 2. To help customers who currently have a data entry and storage system, but the current system has to be managed by the IT department rather than by the quality department. Sometimes the IT managed system can be a bit cumbersome and slow to react to changing needs. 3. To help customers who want to stop using Access because of IT pressure. Many IT departments do not like the idea of having data located in Access databases. There can be an issue with backing-up an Access database while someone has the database file open. 4. To help customers who want to stop using Excel worksheets because of IT pressure. Many IT departments do not like the idea of having data located in Excel worksheets. Also, Excel worksheets are not well suited to allow multiple users to concurrently change data in a worksheet. There can be an issue with backing-up a worksheet while someone has the worksheet file open. 5. To help customers who need the capability for more than one person to enter data into the same group (i.e. data table) at the same time. In this product there is no limit to the number of users who can be editing the same group at the same time. 6. To help customers who have experienced corruption of a file-based database like Microsoft Access or Excel. If you tried to have 10 or 20 users in the same SQCpack (i.e. Access) database at the same time you may have experienced corruption of the database. If any one of the computers doing the updating crashes while doing a data update there is a significant possibility of corrupting the Access database (or Excel file). With SQL Server this is not an issue. SQL Server is designed to have hundreds of concurrent users doing work at the same time. And if a computer running the editor crashes, there will be no damage to the SQL Server database since any partially completed transaction will automatically be rolled-back. 7. To help customers who want to have a central place to store their data, and want to be able to backup their data while users are adding/editing data and producing charts. 8. To give customers the ability to display a CHARTrunner chart and have the chart automatically update whenever a change is made via a data management editor. The CHARTrunner Data Management system consists of the following components: 1. Admin program. This is where you define groups, users, choice lists, categories, custom editors and import groups from SQCpack. Although the data is stored in SQL Server, the complexity of dealing with creating and modifying tables and views in SQL Server is hidden from the user. The fundamental data structure is the Group. You can have an unlimited number of groups in each database (and you can have as many databases as you like). Each group consists of the identifiers and characteristics that you specify. For instance, a group might consist of a Date/Time identifier, an Operator identifier, and a ph measurement characteristic with a sample size of 5. 1

2 2. Editor program. The user can edit the data in a group using one of the following editors. A large number of users can concurrently view, edit and chart data in a group. a. Grid editor. b. Single sample editor. c. Custom editor A single sample editor where the look and feel of the editor is defined by the user. The user can control colors, images, and field placement on the editor. 3. CHARTrunner CHARTrunner is used to draw quality charts of the data that has been stored in SQL Server. When an operator changes data in a group any CHARTrunner chart that uses that group as its data source will automatically refresh itself (if you want it to). This allows everyone in the organization to have access to realtime charts of quality data in the system. 4. CHARTrunner -m Used to monitor the quality data as it arrives in SQL Server and alert users to statistical signals in the data via or text message. SQL Server - If customers already have SQL Server they can use it. For customers who do not have SQL Server the free SQL Server Express edition can be used (which has a database size limit of 10GB, but you could enter data for a long time before ever getting near that limit). We have a customer who is using an XP computer in a lab to run SQL Server Express, and multiple users enter laboratory data into the system using other computers in the lab. SQL Server is easy to backup to a network share so that your normal network backup system includes your SQL Server data for backup. IT departments like having all of the quality data in one place that can be centrally managed and backed-up. Glossary of terms Group The group is the basic means of wrapping related quality data together so that you can work with it. If you are familiar with the concept of tables in databases, then a group is pretty much synonymous with a database table. Or, you can think of a group as a single worksheet in an Excel workbook. In fact, under the covers all the identifiers and characteristics defined by a single group are stored in a single SQL Server table. Characteristic A characteristic is something that you gather quality data about. For instance, if you are making soda cans some characteristics of the can are: 1) Height, 2) Diameter and 3) Weight. The data management system currently supports two types of characteristic: Measurement and Count. A measurement characteristic has a Sample size that defines how many numbers (observations) are collected in a sample. A measurement characteristic is used as the data source for measurement control charts like individuals, x-bar, range, sigma, etc. A count characteristic is used as the data source for Attribute charts (p-chart, np-chart, u-chart and c-chart). Observation In the example of the soda can, every hour you might randomly take five soda cans off a production line and measure the Height, Diameter and Weight of each can. Thus you would have five measurements of Height. Each measurement of Height is one observation. Identifier Data that you collect to help identify each row of quality data (i.e. each sample) is called an identifier. In the example of the soda can, every hour you might record the date/time, production line number and the operator name to help identify the observations you take. In your CHARTrunner charts you can filter on the identifier data so that you can have a chart that only considers cans from production line 4 and measured by operator Harry during January

3 Subgroup The five observations of Height that are taken each hour are said to comprise one subgroup of data for the Height characteristic. A subgroup consists of the data for one characteristic taken essentially under the same set of conditions. The set of conditions is documented by the identifiers you define for the group. Sample A sample is the data for all the identifiers and characteristics in a group taken under the same set of conditions. In the grid editor each row contains a sample. In the single sample editor the data displayed in the editor window is for one sample. SQL Server SQL Server is a popular Microsoft database system that is in wide use by businesses all over the world. 3

4 The admin program The admin program is used to define groups, users, choice lists, categories, custom editors and import groups from SQCpack. Although the data is stored in SQL Server, the complexity of dealing with creating and modifying tables and views in SQL Server is hidden from the user. The fundamental data structure is the Group. You can have an unlimited number of groups in each database (and you can have as many databases as you like). Each group consists of the identifiers and characteristics that you specify. For instance, a group might consist of a Date/Time identifier, an Operator identifier, and a ph measurement characteristic with a sample size of 5. The Groups tab shows the groups that have been defined in the current database (which is the CRDE_New database on SQL Server BOBS\SQL2008R2 as shown on the status bar at the bottom of the window). If you right-click on a group row a context menu opens to allow you to open a data editor for that group. Or you can click the Open button to open the grid editor for the group. 4

5 The File menu (which applies to both the Admin and Editor programs) allows you to: Open connection file Connect to a SQL Server database by opening a.dbc file. The.DBC file is created using the PQ.DB.Connection.Utility program. Recently used.dbc connection files are shown in the list. Connect to database Provides an alternate means of connecting to a SQL Server database. You must specify the location of SQL Server, the name of the database, and in login information. Select application style The visual styling of the program can be changed by selecting from the supplied.isl style files. Open connection via a recently used connection file Each time you select Open connection file the.dbc connection file you choose is place at the top of the list of recently used.dbc files. You can open any recently used database connection by clicking that entry in the list. This makes it easy to switch between multiple SQL Server databases that you frequently use. Exit Exit (i.e. close) the program. 5

6 The Edit group window allows you to define the identifiers, measurement characteristics and count characteristics that define the group s data. In order to add a new identifier, measurement characteristic or count characteristic you click on Add new and the list drops down as shown above. 6

7 The Charts tab allows you to define CHARTrunner charts for the group that can be viewed while in a data editor. Each chart can pertain to the entire group, or to a specific characteristic. In the example shown above both charts pertain to the Weight characteristic. While using a data editor you can click on the Charts toolbar button and select one or more of the charts to be displayed while you enter data. As you make changes to the data in the group the chart automatically updates giving you a realtime data entry and charting solution. The automatic chart update also occurs for any other charts being displayed throughout your organization (as long as they are setup properly and are using a data management group as their data source). 7

8 The Documents tab allows you to associate documents with the group. The documents can be viewed while in a data editor. Each document can pertain to the entire group, or to a specific characteristic. You can associate any type of document for which you have a program that can open that type of document. Examples include Word documents, PowerPoint slideshows, movie files, image files, etc. 8

9 The Procedure tab allows you to specify procedures, notes, etc. that can be displayed while editing the group. 9

10 The Measurement characteristic window is where you define the properties of a measurement characteristic. Most of the properties are the same as those in SQCpack. The Subgroup size specifies the number of observations to record for each sample. 10

11 The upper/target/lower specification values are optional. If Warn on entries beyond specifications is selected any data beyond the specification limits will be flagged with red text and a yellow background in the data editor. If Data value must be entered is selected then a value must be entered for each observation while in a data editor. The Minimum and Maximum section allows you to specify optional Min and Max values. If an observation value is beyond the Min/Max values you can ignore it, warn but allow it, or force the operator to enter an observation value within the limits. You can specify a fixed number of decimal places when displaying the observations in a data editor, or you can specify a custom data display format like 0.00 (if you enter.2 it will be displayed as 0.20). If you specify a Value to automatically enter of 15.1 then each observation of a new sample will be automatically filled with 15.1 when you enter the empty cell and the operator only needs to enter any remaining fractional digits. This is a timesaver when your data is typically in the 15.1 range. 11

12 Each characteristic can specify procedure text, just like the group can. This information is available to the operator while using the data editor. 12

13 Shown above are the properties of the Operator identifier. In this case the data entry user must select an operator name from the Operators choice list (as was defined in the Admin program). The entered value must match an operator in the Operators choice list. Shown above are the properties of the DateTime identifier. The types of identifiers that can be defined are: Date Shows only the date. Time Shows only the time. Date & Time Shows both date and time. Text Type as much text here as you want. You can limit the operator from entering more than N characters, or not impose any limit on the length of the text. Number Useful if you want to identify a sample with a number, like the line number or the lot number. This must be a number and cannot contain any non-numeric characters. 13

14 Shown above are the properties of a numeric identifier named Lot Number. This particular identifier is not a part of the Demo data group we have been looking at so don t be confused when you don t see it in the other screen shots. It is shown here to demonstrate the properties of a numeric identifier. 14

15 You can require users to login to the data management system or not. If you require users to login, you can define usernames and passwords within the data management system. Or, you can use the usernames and passwords provided by your network infrastructure. You can also use a combination of both approaches. The following rights can be assigned to each user: Administrator The user can open the data management Admin program. Add new data The user can add new samples (rows in the grid editor), but cannot modify or delete any preexisting data in the group. Edit existing data The user can edit/delete existing data, but cannot add any new data. Draw charts The user can draw charts while using the various editors in the system. Choose editor The user can choose to use any available editor. Without this right, the user can only used the editor that was assigned to the group by the administrator. Login using network credentials If the user Name matches the user s network login name, and the user has authenticated with a domain controller, then the user is granted access to the system. When this option is selected the Password field is hidden since passwords are managed by the network domain controller. 15

16 The Choice lists tab lets you administer any choice lists that will be used while editing the data in a group. You can use a choice list with a text identifier in order to prevent spelling errors or to ensure that only authorized values are entered. Limiting identifier entries to predetermined values can be useful when filtering data in a CHARTrunner chart. The screenshot above pretty much says it all. 16

17 The Categories tab allows you to manage the various category names that you assign to your groups. Each group can be a member of one category. In the Admin program or the Editor program you can specify to Only show me the groups in a specific category. 17

18 The SQCpack Import tab allows you to import groups (and optionally group data) defined in your SQCpack databases. If you already have SQCpack, and want to migrate to the data management system, this tab will make you happy. 18

19 The editor program The user can edit the data in a group using several available types of data editors. A large number of users can concurrently view, edit and chart data in the same group or in different groups. Customers typically install the editor program on computers used by operators who need to enter data but have no need to administer the system. The main screen of the editor presents a list of the groups that are available to be edited. Select the desired group; optionally select the type of editor to use, then click Edit. The list of available editor types consists of: a. Grid editor. b. Single sample editor. c. Custom editor A single sample editor where the look and feel of the editor is defined by the user. The user can control colors, images, and field placement on the editor. The list will contain the names of all the custom editors defined for the currently selected group. 19

20 The displayed list of groups can be filtered by selecting a category, in which case only the groups in the selected category will be displayed in the list. If you have lots of groups this can be helpful. If you right-click on a group row a context menu opens to allow you to open a data editor for that group. Or you can select the desired type of data editor and click the Edit button to open the editor for the group. The grid editor The grid editor presents the data in a rows and columns format similar to that used by Microsoft Excel. Each row represents a data sample. The columns represent the identifiers and characteristics defined in the group. The grid editor for the Demo data group is shown above. The cursor is always initially placed in the last row of the grid so that the operator can add a new row of data. In the example above there is only one row currently in the data table. If user login is enabled (as specified in the Admin program), the size and position of each editor window (along with the desired text size) is remembered on a per-user basis. If user login is not enabled, the editor window information is remembered as if all users login as a single anonymous user (i.e. the same window information is applied to all users of the system). In either the grid or single-subgroup editors when adding a new subgroup if you press Enter on a date/time field the current date/time will be automatically filled in for you. 20

21 In general pressing Enter in either editor moves you to the next cell, and also to the next subgroup when on the last field of the current subgroup. The value in the first row is highlighted because the value is beyond the upper specification limit of 14.0, and Weight characteristic has Warn on entries beyond specifications enabled. Press enter in the DateTime field and the current date and time are automatically entered for you and the cursor advances to the Operator field. Since the Operator field has a choice list it is automatically displayed. 21

22 A choice list is defined for the Operator field, so the operator can select from the available choices. Notice the information about the field in the status bar at the bottom of the window. You can choose an operator name by typing part of the name, or by selecting a name using the mouse cursor, or by using the up/down arrow keys on the keyboard. The software prevents the user from entering an incorrect value since this identifier was defined with the Value must be in choice list option. When the user finishes the selection for the Operator field and presses Enter the cursor advances to the first observation for the Weight measurement characteristic) as shown below. 22

23 The status bar at the bottom informs the user that a value must be entered in the Weight field. Let s enter (which is actually a typing error, because the user really wanted to enter 13.88). 23

24 The software informs the user that numbers greater than 15 are not allowed, so the typing mistake must be corrected. When the administrator set up the Weight characteristic he specified that numbers larger than 15.0 are not allowed. 24

25 The remainder of the row has been entered. Press Enter and the data in the row are written to the SQL Server database table, and then editor adds a new blank row for you to enter some more new data. If one or more CHARTrunner charts are currently displaying a chart based upon the data in this group they will automatically refresh to display the new data (assuming the charts were setup to do so). 25

26 Like SQCpack, the editor keeps the rows in the same order they are added to the group. If you define your CHARTrunner charts to use the SeqNumber column (not shown in the editor) as the Order By column then the data will be ordered on the chart exactly as it is displayed in the editor. Let s say that we want to insert a new row between the two existing rows. The cursor is positioned on the row that we want to insert above and the Insert button on the toolbar is clicked, as shown below. 26

27 A new blank row is inserted above the row as shown below. 27

28 The operator can now enter data for the newly inserted row. 28

29 After data for the inserted row has been entered the editor looks as shown above. Technical information (if you are interested in geek stuff) How does the system keep the data rows in the same order that they were entered, and allow inserts between rows? Each row of the underlying SQL Server data table has a 64 bit integer sequence number column named SeqNumber. In the editor the data is ordered by the SeqNumber column. Each time a new row is appended to the table it is assigned a SeqNumber that is equal to 8192 plus the largest SeqNumber currently in the table. When a row is inserted between two existing rows it is assigned a SeqNumber that is halfway between the rows. After 13 successive inserts in the same place there is no longer any room to insert between the two rows, so the entire table is locked and re-sequenced so that the difference in SeqNumber between two adjacent rows is again The table also has a RowID column (64 bit integer) that is a SQL Server identity column. The RowID column allows the software to update a row even if a re-sequence occurs between the time the row is read and written. 29

30 Different font sizes can be selected for the editor. This is the Huge font size. This is the Tiny font size. Five different font sizes are available from Tiny to Huge. The operator can choose the font size that works best. If user logins are enabled the font size is remembered on a peruser basis for each group s data editors. 30

31 What happens if other users are adding and deleting rows in the same group as you? If you attempt to modify a row that has been deleted by someone else the software will inform you and refresh the displayed rows. If two or more people are making changes to the same sample the last person to save wins. Grid editor toolbar buttons Click the toolbar button to insert a new blank sample row prior to the current sample row. Click the toolbar button to delete the currently selected row(s). You can select multiple rows for deletion as follows. To select a contiguous block of rows select the first row by Shift-Left-Click to the left of the row, then select the last row of the block by Shift-Left-Click to the left of the last row. To select multiple non-contiguous rows you Control-Left-Click to the left of each row you want to select. After the desired rows have been selected click the delete the selected rows. toolbar button to Click the toolbar button to view the CHARTrunner charts that are associated with the group. The View associated charts window opens as shown above. To display a chart either double-click the chart row or select the chart row and click the View button. The size and position of the window can be adjusted and will be remembered the next time the window is displayed. 31

32 Click the toolbar button to view the documents that are associated with the group. The View associated documents window opens as shown above. To view a document either double-click the document row or select the document row and click the View button. The size and position of the window can be adjusted and will be remembered the next time the window is displayed. Click the toolbar button to open the Procedure window as shown above. The choice list at the bottom of the window allows the operator to display the procedure for the group or for each characteristic in the group. If the cursor is in an identifier field the procedure for the entire group will be shown, otherwise the procedure for the current characteristic will be shown. The size and position of the Procedure window is remembered for each group and user. Click the toolbar button to toggle the always on top state of the editor window. When always on top is enabled the editor window will always appear on top of any other windows on the desktop. Click the toolbar button (or press F5) and the editor will refresh to show you any changes made by other users who are editing the same group. 32

33 Click the toolbar button to toggle whether all the columns are automatically resized to fit within the available width of the editor window. Press the toolbar button to open the Cause and Note editor window as shown above. This toolbar button is enabled only when the cursor is located in a characteristic field (it is not enabled when in an identifier field). Special-cause Used to document one or more special-causes that apply to a subgroup. A subgroup with a special-cause is not used by CHARTrunner in the calculation of control limits. CHARTrunner can display the text of a special-cause on the chart next to its subgroup. Definition: "Common-cause" is the usual, historical, quantifiable variation in a process or system, while "special- causes" are unusual, not previously observed, non-quantifiable variation in a process or system. Note Used to record comments and notes that apply to a subgroup. In CHARTrunner the presence of a note does not prevent a subgroup from being used in the calculation of control limits. CHARTrunner can display the text of a note on the chart next to its subgroup. NOTE: SQCpack allowed users to apply a special-cause cause or note to the entire sample, but the data management editor only allows you to apply a special-cause or note to a specific subgroup of a characteristic. Use the Text size choice list to specify the editor s font size. The selected font size will be remembered for each group and user. 33

34 The single sample editor The single sample editor presents the data for a single sample (i.e. row in the grid editor) at a time. Navigation buttons on the toolbar allow you to move back and forward through the samples in the group. Just like in the grid editor, you can append a new sample at the end and insert a new sample prior to an existing sample. When the single sample editor opens it positions itself beyond the last sample in anticipation of entering a new sample. The error checking and warning options for each field are identical to those we have already looked at in the grid editor. 34

35 Click the First/Previous/Next/Last navigation buttons on the toolbar to move among the existing samples in the group. The Sample number shown in the status bar at the bottom accurately reflects the sample s relative position in the data table, even if other users have been adding or deleting samples. Single samle editor toolbar buttons Click the toolbar button to navigate to the first sample in the group. Click the toolbar button to navigate to the previous sample in the group. Click the toolbar button to navigate to the next sample in the group. Click the toolbar button to navigate to the last sample in the group. Click the toolbar button to append a new sample (i.e. row in the grid editor) to the group. Click the toolbar button to insert a new sample in front of the current sample. Click the toolbar button to delete the current sample. 35

36 Click the toolbar button to view the CHARTrunner charts that are associated with the group. The View associated charts window opens as shown above. To display a chart either double-click the chart row or select the chart row and click the View button. The size and position of the window can be adjusted and will be remembered the next time the window is displayed. Click the toolbar button to view the documents that are associated with the group. The View associated documents window opens as shown above. To view a document either double-click the document row or select the document row and click the View button. The size and position of the window can be adjusted and will be remembered the next time the window is displayed. 36

37 Click the toolbar button to open the Procedure window as shown above. The choice list at the bottom of the window allows the operator to display the procedure for the group or for each characteristic in the group. If the cursor is in an identifier field the procedure for the entire group will be shown, otherwise the procedure for the current characteristic will be shown. The size and position of the Procedure window is remembered for each group and user. Click the toolbar button to toggle the always on top state of the editor window. When always on top is enabled the editor window will always appear on top of any other windows on the desktop. Click the toolbar button (or press F5) and the editor will refresh to show you any changes made by other users who are editing the same group. Click the toolbar button to toggle whether all the columns are automatically resized to fit within the available width of the editor window. 37

38 Press the toolbar button to open the Cause and Note editor window as shown above. This toolbar button is enabled only when the cursor is located in a characteristic field (it is not enabled when in an identifier field). Special-cause Used to document one or more special-causes causes that apply to a subgroup. A subgroup with a special-cause is not used by CHARTrunner in the calculation of control limits. CHARTrunner can display the text of a special-cause on the chart next to its subgroup. Definition: "Common-cause" is the usual, historical, quantifiable variation in a process or system, while "specialin a process or causes" are unusual, not previously observed, non-quantifiable variation system. Note Used to record comments and notes that apply to a subgroup. In CHARTrunner the presence of a note does not prevent a subgroup from being used in the calculation of control limits. CHARTrunner can display the text of a note on the chart next to its subgroup. NOTE: SQCpack allowed users to apply a special-cause cause or note to the entire sample, but the data management editor only allows you to apply a special-cause or note to a specific subgroup of a characteristic. Use the Text size choice list to specify the editor s font size. The selected font size will be remembered for each group and user. 38

39 Custom editor You can define your own custom editors. As the editor above demonstrates (in a bad way if you can see it in color), you probably want someone with a good sense of color and design to help you out with your editor designs. But the good news is that you have the freedom to design the editor to look the way you want it to. Integration with CHARTrunner CHARTrunner can easily display charts of the quality data that has been entered because the data is stored in SQL Server tables, and CHARTrunner is perfectly happy to use SQL Server data. In your CHARTrunner chart definitions you will actually use a SQL Server view as your data source, rather than using the group s data table directly. This is because the table and column names are not very human-friendly looking. The data management Admin program creates a SQL Server view for each group. The view has the same name as the group, and the column names are easily recognizable when you are mapping columns in the chart definition. 39

40 In CHARTrunner (and higher) a new triggered chart refresh feature has been added to the Misc tab of the chart definition (as shown above). This allows the chart to automatically update itself each time data changes in the group s data table. The data management editor sends a broadcast message across the network each time it changes data in the group s data table. The format of the message is [SQLServerName-DatabaseName-TableName]. All you have to do in order to get automatic refresh of a CHARTrunner chart is specify the proper message to listen for and you have realtime charting. On the Edit group window (shown above) click the Refresh ID button and the appropriate text will be copied to the clipboard. Edit a CHARTrunner chart definition, select the Misc tab, and paste the refresh ID into the Triggered chart refresh field. Ensure that Refresh the chart is selected and save the chart definition. This feature works with the charts in a CHARTrunner multi-chart as well. You might have 12 charts displayed on a large screen monitor via a multi-chart, and each one will individually update when an editor makes a change to the group data that chart is displaying. The broadcast message can be received by every CHARTrunner in your organization. Let s assume the operator has a chart displayed beside the editor window, the supervisor has a chart displayed, and the plant manager has a chart displayed. Every time the data entry person changes data via the editor all three of those charts will automatically refresh and display the latest data. Summary The CHARTrunner Data Management software has the simplicity of the SQCpack data management and entry paradigm (groups, characteristics and identifiers). 40

41 Your quality data is stored in SQL Server (so your IT department will be pleased). You define the data groups that you are interested in and the software creates the needed SQL Server data storage for you. Your data is safe from corruption caused by a failed data entry computer. Multiple users can add/edit/delete data in the same group at the same time. The data management editors are designed to be helpful for entering quality data. Entered data can optionally be checked against specification limits and min/max limits. Current date and time values can be automatically entered for you. Choice lists provide quick and accurate entry of identifier values. New observation fields can be pre-filled with a constant value like 15.1 in order to speed data entry when all your data values typically begin with CHARTrunner is used to display quality control and analysis charts throughout your organization based upon the quality data that is stored in SQL Server. You can implement real-time charting of data as it is entered by operators. If you already have data in SQCpack you can easily import your group definitions and data into the data management system. 41