Advanced Content Authoring and Reporting - Requesting a report on more detailed analytics on student behavior or exporting Pressbooks data from Learning Locker

Pressbooks is an innovative, open-source tool and is still emerging as an enterprise-level platform with predictable performance. As a result, the vendor and other contributors to the platform may not be able to immediately respond to performance issues that arise. Please take this into account when deciding to use Pressbooks for the creation of course and assignment materials. There may be times when Pressbooks may be unavailable and that could mean students will not be able to access materials. Learn@UW-Madison continues to track and document known issues with Pressbooks.

This document covers basic information on requesting a report on student use of a Pressbooks module. It also covers creating an export from Learning Locker for those technology staff who have access. Finally the document covers basic information on Pressbooks analytics and what information is or is not captured in the Learning Locker.

If you are an instructor and you would like to request a data export from Learning Locker from one of your Pressbooks modules:

  1. E-mail learnuw_contentauth@lists.wisc.edu indicating that you would like assistance with a data report for a specific module. Please include any specific data you need, along with when you would like the report. Please include your Pressbooks URL and your Canvas course URL. Report requests are processed within 2 business days.
  2. A team member will either send you questions for additional definition of your data requirements, or a CSV file with the requested data.

Creating Exports in Learning Locker

If you are a School, College, or Department instructional technology consultant who would like an account to login to Learning Locker to generate reports for instructors in your School, College, or Department please e-mail learnuw_contentauth@lists.wisc.edu to request an account. Learning Locker is an open source learning record store designed to store learning activity statements generated by xAPI compliant learning modules. Learning Locker documentation can be found here: http://docs.learninglocker.net/reporting/

The primary way to get data out of Learning Locker is to use the export function.

  1. Login to Learning Locker: saas-us.learninglocker.net/login
  2. Click on the appropriate Learning Locker organization that you were given access to. Example organizations include: UW-Madison College of Letters and Science, UW-Madison School of Medicine and Public Health, and UW-Madison School of Pharmacy.
  3. Click Exporting on the left side menu.
  4. Click Edit next to either Storyline Simplified Export, Pressbooks Simplified Export or Captivate Simplified Export [Note that the Captivate report was not available when this document was written]
  5. Click the Download dropdown and select .CSV  Name the CSV something that will make it easily findable in the future.

Analytics

xAPI statements are only sent to Learning Locker from the H5P activities embedded within a Pressbooks module. We are able to capture user's answers to questions, and what time the user submitted them. Depending on how a Pressbooks module is designed with H5P activities one could interpret a lot from this. For instance if an author is creative with the use of the H5P activities, they could use a question at the very beginning of the reading which would then become a data point of the approximate time the student began the module.

Pressbooks, as a tool, is unable to send data about:

  • When users opened the reading,
  • How long they spent in it,
  • What information they did or did not click on within the reading (e.g. Did they click on every caption, or just the ones with questions in it? Did they click on / view the glossary items or not? Did they follow links to external sources?)
  • How much time did they spend viewing the reading total?

The LTI plugin for Pressbooks processes "Completed" and "Answered" xAPI statements to send a grade to the Canvas gradebook.

Pressbooks H5P Module xAPI data available in Learning Locker

Learning Locker


LL Data

LL output

How to interpret

actor name

Zachary Schwaller

n/a

actor name


Timestamp


object definition name

Neufeld


2017-09-07T11:04:11.248100-05:00


{"en-US":"Holistic Rubric Advantages #2"}

Can only be viewed by H5P activities embedded in PressBooks on the main page (will not work when embedded in the annotation layer). Can be inferred for number of attempts of entire PressBook book.


  1. Filter by actor name

  2. Sort by timestamp

  3. Filter by an activity to view attempts

  4. Count number of times student (attempted/consumed) activity

actor name


Timestamp


object definition name

Zachary Schwaller


2017-08-07T14:03:37.486Z


{"en-US":"Holistic Rubric Advantages #2"}

Can only be viewed by H5P activities embedded in PressBooks on the main page (will not work when embedded in the annotation layer). Can be inferred for number of attempts of entire PressBook book.


  1. Filter by actor name

  2. Sort by timestamp

  3. Filter by learning object title

actor name


Timestamp


object definition name

Zachary Schwaller


2017-08-07T14:03:37.486Z


{"en-US":"Holistic Rubric Advantages #2"}

Can only be viewed by H5P activities embedded in PressBooks on the main page (will not work when embedded in the annotation layer). Can be inferred for number of attempts of entire PressBook book.


  1. Filter by actor name

  2. Sort by timestamp

  3. Filter by learning object title


object definition name


Result duration

{"en-US":"Holistic Rubric Advantages #2"}


PT38.59S

Can only be viewed by H5P activities embedded in PressBooks on the main page (will not work when embedded in the annotation layer). Can be inferred for number of attempts of entire PressBook book.


  1. Filter by learning object title

  2. View the time spent per activity by user in the result duration field.

actor name


Timestamp


object definition name

Zachary Schwaller


2017-08-07T14:03:37.486Z


{"en-US":"Holistic Rubric Advantages #2"}

Can only be viewed by H5P activities embedded in PressBooks on the main page (will not work when embedded in the annotation layer). Can be inferred for number of attempts of entire PressBook book.


Subtract Completed timestamp of latest H5P activity - Started On timestamp of earliest H5P activity

result response

4[,]2[,]6

Need to look into how these values can be translated

actor name


Verb display

Result success

Zachary Schwaller


answered


1

Blank

Null




1 = complete

Blank = incomplete

Null = no completion value for that


context contextActivities

{"category":[{"objectType":"Activity","id":"http:\/\/h5p.org\/libraries\/H5P.DragQuestion-1.11"}],"grouping":[{"objectType":"Activity","id":"https:\/\/wisc-dev.pb.unizin.org\/teachonlinerubrics\/chapter\/test-your-knowledge\/","definition":{"type":"http:\/\/activitystrea.ms\/schema\/1.0\/page","name":{"en":" | Test Your Knowledge"},"moreInfo":"https:\/\/wisc-dev.pb.unizin.org\/teachonlinerubrics\/chapter\/test-your-knowledge\/"}}]}

Can be parsed by reading the context Activity field

object definition name

{"en-US":"Holistic Rubric Advantages #1"}

Provides the name of the activity as titled in H5P.


For responses: Need to look into how these values can be translated

object definition description

{"en-US":"Please check all that could be examples of criteria. Hint: There are three (3) correct answers.\n"}

This seems to be the description for the H5P activity


See Also:




Keywords:Pressbooks, pilot, learning, locker, record, store, xapi, statements, ACAR   Doc ID:76503
Owner:Learn@UW Madison .Group:Learn@UW Madison
Created:2017-09-13 08:24 CSTUpdated:2018-11-16 12:55 CST
Sites:Academic Technology Pilots, DoIT Help Desk, Learn@UW Madison
Feedback:  2   2