Tracking Student Progress of Noba/ Cerego Online Quizzes

The Purpose of Noba/Cerego Online Quizzes

We’ve created 20-item quizzes to accompany many of our online learning modules. The quizzes are a form of

retrieval practice for students to strengthen their understanding of the concepts they encounter in the text

reading. They also offer students a chance to practice metacognition by noting which concepts cause them

confusion and which they feel more confident they understand.

Instructors may simply encourage their students to take the quizzes independently after reading each module. Or

they may choose to make them a formal part of the course by assigning the quizzes for credit. By using a Cerego

dashboard, instructors can verify that students are completing assigned quizzes and get insights into individual

and class performance.

Cerego is a learning platform that allows for long-term study of material over weeks and months (mastery-focus).

But the typical use case for these Noba quizzes is to have students engage with the quiz content once or

perhaps a few times during a particular week during the semester before moving on to other modules and

quizzes in subsequent weeks. One of the key indicators of the dashboard, the “Set Goal”, has been placed at a

level that assumes this sort of short-term use of the quizzes. You’ll learn more about the Set Goal and other

indicators later in this document.

Students can engage with the quiz material as often as they like and over periods longer than a single week of the

semester. For example, they may choose to return to the quizzes as a form of review before mid-terms or finals.

Even when the Set Goal has been reached or students meet other short-term requirements they retain access to

the quizzes for further study if they wish.

Things that you’ll need before you start:

Access to the email account that you used to register as a Noba instructor-user

List of email addresses for all students you wish to track. These email addresses have to be the same ones

the students used to sign up and log into the Noba website. Students must register and log into the Noba

website to take the quizzes and to enable individual tracking of progress. Collecting these addresses in a

comma separated list will be best.

List of all Noba modules/quizzes that you will assign to students and track

Registration email from Cerego (expect this within 1-2 business days of your initial student tracking request

to Noba)

Table of Contents:

How to access your Cerego account……………………………………..pp. 5-6

How to navigate to your course(s)………………………………………..pp. 7-10

How to add Noba quizzes/sets………………………………………………pp. 11-13

How to add students……………………………………………………………..pp. 14-16

Publishing your course…………………………………………………………..pp. 17-18

Info about student progress - Instructor dashboard ……………..p. 19

How to read, understand, and manage reports……………………..pp. 20-27

What students see……….………………………………………………………..pp. 28-30

Additional details to know/share with students…………………….p. 31

How to access your Cerego account

Instructions:

Go to your email inbox and open the registration email from Cerego. The subject line beings “An invitation

from . . .”. It will usually arrive 1-2 business days after your initial student tracking request to Noba. Click

the link in the email to register on the Cerego website.

On the Cerego registration page enter your first and last name, your email, and create a password that you

will use to log-in to Cerego each time you want to access your student progress dashboard.

Click the green “Log In” button after you have registered.

For Those Also Using Cerego with Other Content Providers

If you are have ever used the Cerego learning platform to access content from another organization, like

Cengage, and already have a Cerego account, don’t be confused if you log in and can’t find your Noba content

right away. Sometimes what you need to do is just “switch partners”. To do that, simply log in to Cerego, navigate

to the upper right-hand corner of the page and click on your name. A drop-down menu will appear, click on

Switch Partners to switch over to Noba content.

How to navigate to your course(s)

Once logged in, you will be taken to Cerego’s main page. Click the green button at the top-left labeled

“Cerego Learn” to see the drop-down menu.

Click on the blue icon called Courses under NOBA. This will take you to the list of Noba courses for which

you are now a designated instructor.

The Courses page contains the class sections you plan to track. Click on the Unpublished tab (please note

that once you’ve published a course, it will be moved to the Published tab). The number of courses you

administer should be equal to the number of class sections you want to track separately. Please confirm

that the correct number of class sections you requested have been created for you. If there’s a discrepancy

let us know and we can fix it. Please email us if you have any questions at info@nobaproject.com rather

than contacting Cerego through the green Support button at the bottom of you page. We will already be

familiar with your case and can better assist you.

Click on the name of the course that you wish to work in, and you’ll be taken to a set up page that will look

like this:

Notice that the course status is Unpublished, you will be able to publish it once you add students (called

Learners by Cerego) and the Noba module quizzes you plan to assign (called Assignments by Cerego).

How to add Noba quizzes/sets

To add Noba module quizzes to your course, scroll to the bottom of the page to the Manage Your Course section and click on the green Edit Assignments button.

Next, click on the green Add Assignments button.

Click My Organization Tab. This will open a list of all available quizzes.

Go down the list and check the Noba quizzes (Cerego calls these “Sets”) that you wish to add, please note

that you can add more than one set at a time.

Once you have selected the set(s) that you want, click the green Add Assignments button.

How to add students

Navigate back to the Manage Your Course section for the course that you are working on. Click the green

Edit Learners button.

Click the green Add Learners button either at the top or middle of the page.

Type or paste a list of your students’ email addresses below, each separated by a comma, then click the

green Add Learners button.

Then click Done.

Publishing your course

Navigate to your blue Courses tab and go to the Unpublished tab. Put a check mark next the course that you

want in the list and press the green Publish button.

Before hitting the green Confirm & Publish button, uncheck the Send email invitations to learners you've added

to course rosters checkbox. If your students have registered on the nobaproject.com website Cerego is already

enabled to track their progress on quizzes. So students don’t need the additional invitation/registration email.

Info about student progress - Instructor dashboard

As soon as a student takes her first quiz, her progress towards the Set Goal will be displayed on your

dashboard.

The default Set Goal of 0.7 (green arrow) is a good target for students to reach for a quiz within a single week.

If a student scores all 20 correct on the first attempt she will reach 0.7. If a student scores below 20 correct on

the first attempt she will have to return to review the quiz material at least once to reach 0.7.

To navigate to your Instructor’s Dashboard click Analytics on the left-hand side menu.

As you can see from the little silhouette icons, three of this instructor’s students have taken the quiz for The

Family. You can click on individual icons to see the names of students on the dashboard and some basic info,

like how many items they’ve studied on a particular quiz. For more in-depth information, you’ll need to run a

report. Please see the details on the following pages:

How to Read, Understand and Manage Reports:

For more student progress information you can access reports. There are 3 different reports you can run:

1. Set Progress

2. Daily Set/Series Study Time

3. Content Insights

The first type of report – Set Progress – displays progress for each student by module/quiz.

The second type of report (one that you probably won’t use very much) – Daily Set/Series Study Time–

displays the total study time per student per set – i.e. how much time each student took to complete each

set.

The third type of report – Content Insights – shows you each quiz item in each of the sets and shows you

on a group level how many tries it took students to get it right to help you identify problem

items/concepts.

To access a particular report, first click Reports in the far left column

Set Progress Report

How to run: In Run Report, select Set Progress. Select the Date for which you wish to run the report. In Show,

select either All Sets and Series if you want to see a progress report for all sets and series at once, or select the

individual Noba module for which you wish to see the report. Then either choose an individual student to run the

report for or select All Students. Finally, click the orange Generate button.

What you will see –

The names and emails of your students (your name will be here also if you have ever taken a quiz on Noba in

a given module).

Progress to Goal is basically how close students are to achieving the pre-set goal of 0.7.

What Set Level they’ve reached based on how many questions they’ve answered correctly.

Set Goal is a pre-set target. For the Noba quizzes the default Set Goal is 0.7.

How many questions they’ve attempted to answer in % Started.

How many questions each student has answered listed as “Number of Memories”.

How long it took the student to complete the quiz in “Study Time” column.

How many Days Since they have taken the quiz (if you see an “-“ next to their name, that means they’ve taken

the quiz the same day as the report was generated).

The Name of the Set or Sets (the quizzes).

Daily Set/Daily Series Study Time Report

How to run: Navigate to the Reports page. In Run Report, select Daily Set/Series Study Time from the dropdown

menu, then pick the dates (just specify the range of time that you wish to view the report for). In the Show option

for this report, you can only run it for one module at a time, so select the Set that you wish to run the report for.

Then choose an individual student to run the report for or select All Students. Finally, click the orange Generate

button.

What you will see:

Names of your students, their Emails and

Total Study Time they’ve spent on the set/quiz you’ve selected.

Content Insights Report

How to run: Navigate to the Reports page. In Run Report, select Content Insights from the dropdown menu. In the

Show option for this report, you can only run it for one module at a time, so select the set/quiz that you wish to run

the report for. Then choose an individual student to run the report for or select All Students. Finally, click the

orange Generate button.

What you will see:

Columns on the left will show you text and/or images indicating the specific items within the quiz

Columns to the right will show you data specific to the item such as

o How many times an item has been seen,

o How many times it was answered correctly

o What percentage of students has answered correctly on the first try

o Number of students who have provided an answer on an item

The value of running this report is that you can quickly identify at a glance which items in the quiz might be

causing your students the most trouble

What students see

Students who take Noba quizzes will have access to a dashboard that tracks their individual progress. It will not only

show what a student she accomplished but also suggest a time for the next review and notify the student by email

or text.

Anna Apricot’s Dashboard Day 1 – this learner got all answers correct (20/20) on the first try:

The Set Goal and Set Level lines are overlapping. She has reached the Set Goal of 0.7

Bob Banana’s Dashboard Day 1 – this learner got 18/20 correct on the first try:

Bob has reached the Set Level of 0.6 and will have to return to the quiz at least once in order to meet the Set

Goal of 0.7

Curtis Coconut’s Dashboard Day 1 – this learner got 14/20 correct on the first try:

He has reached Set Level 0.5 and will have to return to the quiz at least once in order to meet the Set Goal of

0.7

Additional details to know/share with students

Students must create a student account on nobaproject.com in order to take the quizzes and link to the

instructor tracking dashboard. It takes less than a minute to sign up and all Noba materials are free.

Students should share the email address they used to register on the Noba website with the instructor so

they can be added to a Course and tracked as they complete assigned quizzes.

The quizzes are found within the individual Noba modules on the Noba website following the main text

content. To review quiz material, students must return to the Noba website and navigate to the specific

module that needs review.

Students can access individual modules either through a link to the Noba book you are using, or by going to

the Browse tab on the Noba website and searching for the title of the module you have assigned.

o Sample book link – http://noba.to/5wjrz72n

o Browse page link - http://nobaproject.com/browse-content

Noba student quizzes each contain 20 items/questions. However, Cerego encourages “micro” study sessions

to promote better long term retention. The maximum number of items a student can attempt in a single

micro-session is 10. More frequent micro-sessions do not always fit with busy student schedules, so it is

possible to do two back-to-back sessions of 10 so that all the quiz items can be attempted in a single sitting.

The level of accuracy on the first pass through the full 20 items (in 2 micro-sessions) will determine if/when a

student must return to review particular items to reach the Set Goal.

Students will receive email updates (or text updates if they select this option in their account page) when they

reach the suggested review time for a particular quiz. Students can turn off these reminders at any time.

Students can see their progress toward the Set Goal as well as the Countdown Clock for the next review by

logging into Noba a navigating to any quiz they have attempted.