anzltc14: bb training workshop: reporting - analytics, student performance and retention - nicole...

13
® Institutional Reporting Blackboard Reporting: Analytics, Student Performance and Retention

Upload: blackboard-inc

Post on 23-Jan-2015

146 views

Category:

Education


1 download

DESCRIPTION

ANZLTC14: Bb Training Workshop Reporting - Analytics, Student Performance and Retention Nicole Wall, Michael Garner & Chris Eske

TRANSCRIPT

Page 1: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

®

Institutional  Reporting  

Blackboard  Reporting:  Analytics,  Student  Performance  and  Retention  

Page 2: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

Introductions  

Chris  Eske  

•  Analytics  Specialist  (APAC)  [email protected]  

Nicole  Wall  

•  Senior  Consultant  (APAC)  Blackboard  Analytics  [email protected]  

Michael  Garner  

•  Solutions  Engineer  (ANZ)  [email protected]  

2  

Want  to  see  some  examples  of  Reports?      

Visit:  https://apac-­‐demo.blackboard.com/  ID:  Analytics1  PW:  Analytics  1    

Page 3: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

LMS  Reporting  

A  series  of  tools  and  platforms  designed  to  provide  insight  into  activity  within  the  LMS  

•  Blackboard  Analytics  •  Course  Reports  •  Item  Activity  

3  

Current  

Information  Analysis,  Descision,  Actions  

Future  

Data  acquisition,  integration,  management  and  information  delivery  

•  Performance  Dashboards  •  Retention  Centre  •  System  Reports  

 

Page 4: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

The  Rise  of  Big  Data  

2000   2005   2010   2015  

Data  Requirements  

4  

Page 5: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

Blackboard  LMS  Reporting  

5  

Strategic  

Tactical  

Operational  

#  of  Users  

Page 6: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

How  can  I  support  students,  teachers  and  systems  

Support  

Breadth  of  Reporting  

How  often  should  I  look  at  my  site?  

Students  

6  

What  are  my  students  doing?  

Teachers  

Where  are  we  heading?  

Executives  

Page 7: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

Aligning  Breadth  and  Depth  with  Reporting  Objectives  

Students   Teachers   L&T  Support  

Student  Support  

IT  Support   Executive  

Operational  

Tactical  

Strategic  

7  

Page 8: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

Aligning  Breadth  and  Depth  with  Reporting  Objectives  

Students   Teachers   L&T  Support  

Student  Support  

IT  Support   Executive  

Course  

Department  

Institution  

8  

Self  Ef_icacy  

 -­‐  Students-­‐At-­‐Risk    

 -­‐  Course  Evaluation  

 -­‐  Effective  Course  Design  

   -­‐  Increased  Use  of  Learning  Techs  

 -­‐  Scholarship    -­‐  Resourcing  (Personnel)  

Retention  

 -­‐  Resourcing  (Hardware)    -­‐  Resourcing  (Support)  

 -­‐  Retention    -­‐  Benchmarking    

-­‐  Trends    -­‐  Resourcing    -­‐  Auditing  

Page 9: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

Aligning  Breadth  and  Depth  with  Reporting  Objectives  

Students   Teachers   L&T  Support  

Student  Support  

IT  Support   Executive  

Operational   ✓  

Tactical   ✓   ✓  

Strategic   ✓  

9  

 -­‐  Students-­‐At-­‐Risk    

 -­‐  Course  Evaluation  

 -­‐  Effective  Course  Design  

   -­‐  Increased  Use  of  Learning  Techs  

 -­‐  Scholarship    -­‐  Resourcing  (Personnel)  

Retention  

 -­‐  Resourcing  (Hardware)    -­‐  Resourcing  (Support)  

 -­‐  Retention    -­‐  Benchmarking    

-­‐  Trends    -­‐  Resourcing    -­‐  Auditing  

Self  Ef_icacy  

Page 10: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

BeneNits  }  Improved  self  ef_icacy  }  Intrinsic  Motivation  

Reporting  Options  Providing  students  insight  into  their  activity  compared  to  their  peers  on  a  course  by  course  basis.  Supports  the  need  for  feedback  that  is  timely  and  frequent.  Student  reports  are  at  the  discretion  of  the  instructor.      

10  

Student  Reports  

Learn  Tools:  •  Grade  Centre  

Analytics  Tools:  •  Student-­‐At-­‐A-­‐Glance  Report  

Page 11: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

BeneNits  }  Ability  to  identify  item  and  course  activity  and  thus  student’s  at  risk  }  Ability  to  perform  interventions  }  Use  reports  as  an  evaluation  method  to  support  course  design  

Reporting  Options  

Widest  selection  of  reporting  options,  each  designed  for  a  different  purpose  and  should  align  with  institutional  objectives.  These  tools  support  operational,  day-­‐to-­‐day  needs.  

11  

Teacher  Reports  

Learn  Tools:  •  Retention  Centre  •  Course  Reports  •  Item  Tracking  

(Performance  Dashboard)  

Analytics  Tools:  •  Unit  At  A  Glance  •  Accesses  Scatter  plot  •  Activity  Matrix  •  Submission  Report  

Page 12: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

BeneNits  }  Informs  professional  development  plans  }  Identify  patterns  that  drive  usage  of  Learning  Technologies  }  Assess  compliance  with  teaching  requirements  }  Monitor  and  analyze  trends  to  enact  or  validate  curriculum  and  pedagogical  change  

Reporting  Options  These  users  are  more  tactical,  need  to  be  able  to  use  reports  at  an  institutional  level  and  importantly  segment  data  by  particular  org  groups  and  cohorts.  They  often  need  to  be  able  to  report  on  activities  to  executives  

12  

Learning  &  Teaching  Support  Reports  

Learn  Tools:  •  BIRT  Reporting  

Analytics  Tools:  •  Tool  Usage  Trends  •  Activity  Trends  •  Site  Design  Exceptions  

Page 13: ANZLTC14: Bb Training Workshop: Reporting - Analytics, Student Performance and Retention - Nicole Wall, Michael Garner & Chris Eske

BeneNits  }  Establish  and  track  KPIs  through  institutional  dashboards  to  measure  strategic  goals  }  Provide  immediate  access  to  pertinent  performance  information  }  Measure  student  learning  outcomes  against  course  grades  and  learning  standards  and  objectives  

Reporting  Options  

In  this  challenging  environment,  the  right  information  at  the  right  time  is  crucial  to  positively  impacting  student  engagement,  retention  and  performance  with  fewer  resources.    

13  

Executive  Reports  

Learn  Tools:  •  System  Reports  

Analytics  Tools:  •  Engagement  vs.  grades  correlation  •  Aggregate  learning  outcomes  •  Top  50  courses  •  Course  design  summary  &  trends  •  Usage,  trends  &  best  practices  by:  

instructor,  department,  subject,  term