Dutch Users Meeting. September 30 th 2014 Steve Lay, Integrations and Delivery Product Owner Draft: T10:41

Transcription

1 Dutch Users Meeting September 30 th 2014 Steve Lay, Integrations and Delivery Product Owner Draft: T10:41 All rights reserved. Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

2 OData for Delivery and Analytics Separate component, URL and use cases But still the same technical standard! Remember you can t talk directly to the database OnDemand NG Authoring Delivery Analytics Slide 2

3 OData for Delivery: Read & Write Scoring Tool Printing & Scanning People Sync

4 Scoring Tool Existing Scoring Tool Available in Enterprise Manager Optimized for a limited set of use cases External Scoring Tools (using API) No issues with locking Marks can be saved and updated prior to being finalized Flexibility concerning workflow Full access to the Scoring Tool data model Warning: Authorization Currently uses a service account for authentication like QMWISe Slide 4

5 OData Delivery Feeds Read and Write Access Adminstrators Answers Assessments DimensionScores Dimensions Groups Participants Questions QuestionTranslations Results Rubrics ScoringResults ScoringTasks more to come! Slide 5

6 Data model limitations Multiple graders Our data model currently only supports one set of marks for each graded question Workflows that store marks from multiple grades must use their own database and publish the final agreed mark through the API Assessment Level API makes it easier to present all questions from a particular assessment for whole paper grader But you cannot provide whole paper marks and comments Slide 6

7 Rich [Text] Input Use Case: Participant enters markup directly or with WYSIWYG browser during delivery Graders can view and annotate the marked-up text when scoring Similar Use Cases: participant takes photo participant records sound clip participant records video clip Current API supports: Plain text essays Arbitrary file uploads We are investigating: Adding special forms of the file upload question to cater for, e.g., HTML, Maths input Interested in extending to picture, voice capture etc. Timeline: Not before 2015 Slide 7

8 Example Scoring Tool Subjective marking in Excel Slide 8

9 It is easy to get a list of participants from a group, this sample application then provides a link to drill down into the results Slide 9

10 This result has been previously scored (80%) It also shows a download link to download a CSV with the details. The list contains only results from this one participant that relate to the specific group (OData is great for filtering) Slide 10

11 Slide 11 The sample app formats the information from the API into a simple CSV which opens in Excel

12 Here s the question text Here s the participant s response And here s the dimension score and comment Slide 12

13 I ve updated the score and comment for this dimension Slide 13

14 After saving my changes, I go back to the browser and browse for the saved CSV, I want to update the final score so I check the box to complete the scoring workflow and then hit Upload Slide 14

15 This result has been updated, now (100%) Slide 15

16 OData Delivery API Now live on Questionmark OnDemand Will be included in next full Perception release Target users: Application Programmers Writers of automation scripts Future May be used to replace our existing Enterprise Manager tools Dogfooding Scheduling Printing and Scanning Will replace Snapshot methods in QMWISe Will link printed delivery to scheduling Slide 16