anzltc14: bb analytics - chris eske

Data  Analy)cs:  Insight  for    Bright  Futures  

Chris Eske Analytics Specialist Blackboard International

Not  a  Des)na)on  but  a  Journey!  

Chris Eske Analytics Specialist Blackboard International

Agenda  •  The  Theory  •  The  Solu)on  •  The  Reality  •  Discussion  

Data  is  not  informa)on,  informa)on  is  not  knowledge,  knowledge  is  not  understanding,  understanding  is  not  wisdom.  

Clifford  Stoll      

Data  is  not  informa)on,  informa)on  is  not  knowledge,  knowledge  is  not  understanding,  understanding  is  not  wisdom.  

Clifford  Stoll      

6

Using Analytics As a Catalyst For Change

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

7

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

Dr  Freeman  Hrabowski  –  President  UMBC  

Four Dimensions of Educational Analytics

Student Learning •  How can I easily find students who are at-risk?

•  Who are the most innovative instructors?

•  How are students performing on learning outcomes over time?

•  Which instructional strategies & tools are being used in courses the most? The least? Which are most effective to enhance student engagement & success?

Student Learning Accountability

•  What strategies to improve the quality of course design and instruction result in better student performance and course evaluations?

•  How many logins, time on task, and other metrics have occurred over time?

•  What student activities are correlated to desired outcomes, grades and course completion?

“Given accurate and timely normed feedback, most

populations will self correct or improve with little or no direct

intervention”

Student  at  a  Glance    (student  compared  to  class  average)  

Does  When  MaRer?  

Does  When  MaRer?  

Aligning  Breadth  and  Depth  with  Repor)ng  Objec)ves  

Students   Teachers   L&T  Support  

Student  Support   IT  Support   Execu7ve  

Opera7onal   ✓  

Tac7cal   ✓   ✓  

Strategic   ✓  

17  

 -­‐  Students-­‐At-­‐Risk    

 -­‐  Course  Evalua)on  

 -­‐  Effec)ve  Course  Design  

   -­‐  Increased  Use  of  Learning  Techs  

 -­‐  Scholarship    -­‐  Resourcing  (Personnel)  

Reten)on  

 -­‐  Resourcing  (Hardware)    -­‐  Resourcing  (Support)  

 -­‐  Reten)on    -­‐  Benchmarking    

-­‐  Trends    -­‐  Resourcing    -­‐  Audi)ng  

Self  Efficacy  

Information Access

The Reporting Queue

Data Genius

SIS

Select  *  from  Source.PS_STDNT_CAR_TERM  stdnt_car_term      inner  join  Student.DimTerm  dim_term  on          

 stdnt_car_term.STRM  =  dim_term.SourceKey  and                                    dim_term.IncludeTermInLoad  =  1  le`  join  Source.PS_ACAD_PROG  acad_prog  on    

 stdnt_car_term.EMPLID  =  acad_prog.EMPLID  and                  stdnt_car_term.ACAD_CAREER  =  acad_prog.              stdnt_car_term.STDNT_CAR_NBR  =  acad_prog        and  acad_prog.EFFDT  <=  dim_ter                      

Analy7cs  Solu7on  Overview  

Student Management Finance Human

Resources Financial

Aid Advancement

 PeopleSo`  

 Datatel  

SunGard  Banner  

Blackboard  Learn  

Mappings from ERP

& Other Sources

Data Transformation

Data Model Relational & OLAP

Front-End Reporting

• Best Practices • Metrics • Business Rules • Derived Data

A  Comprehensive  Suite  of  Packaged  Analy:c  Applica:ons  

Learn

Your  Data  

Grade  &  Outcome  Results  

Course  AFributes  

Student  AFributes  

Final  Grades  

Student Information

System

Performance Analyses Best Practices Analyses

Trend Analyses

Instructor  AFributes  User  

Ac7vity  Data   Course  

Item  Data  

Metrics  

• Gradebook • Possible Score • Score • Weight • Grade Pct • Weighted • Element Count • Highest Score • Lowest Score • Improvement • Average Score • Attempts • Days To Grade

• Goals • TBD

• Course Design • Item Count • Files Attached • VTBE Objects • VTBE Characters • File Size • Folder Depth • Links • Folders

• Course Section • Subject • Department • College • Class Number • Term • Course Career/Level • Instruction Method

• Students • Birthdate • Gender • Ethnicity • Citizenship • Current Term • Primary Major • Career/Level • Academic Level • Current Academic Standing • Primary College

• Instructors • Gender • Ethnicity • Highest Education Level • Faculty Rank • Tenure Status • Primary Department

• User Activity • Sessions

• Logins • Session Minutes • Courses • Content Items • Tools • Modules • Clicks • Pages

• Course Activity • Courses Accessed • Course Access Minutes • Session Course Sequence • Content Items • Pages

• Content Activity • Content Items Accessed • Content Item Hits • Content Access Minutes • Session Sequence • Folder (or Content) Depth

• Submissions • TBD

Learn Metrics Key SIS

Elements

Integrated in Learn

Menu-Based Reports

Self-Service Data Exploration and

Dashboards

Three  Ways  to  Explore  Data  

Learn  Report  for  Students  

Learn  Reports  for  Instructors  

Instructors    (Lecturer)  Course  at  a  Glance  

Course  Avg.  

Advisor  –  Parameterized  Grade  Center  Excep)on  Report  

Dean  Dashboard  

Dean  Dashboard  (Change  delivery  method  using  Slicers)  

Direct  Costs  

Faculty  Salary  

Taxes,  Health  Insurance  &  Other  Benefits  

Instruc)on-­‐Related  Opera)ng  Expenses  

Revenues  

Student  Tui)on  

Other  Fees  

Outcomes  

Academic  Performance  

Reten)on  &  Gradua)on  Rates  

A4SIS:  Cost  of  Instruc7on  

 Instructional  Costs  by  Course  Department    

A4SIS:  Risk  Factor  Distribu7on  Report  

37

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

38

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

39

The Stumbling Block

Ask Good Questions

Unlock the Data

Dig Deeper

Drive Action

Measure Progress

Project Plan – Planning & Set up

1.   Environment  Setup    •  Server  Configura)on  

•  Remote  Server  Access  •  Checklist  document  

2.   Choose  BB  Learn  Source  Environment  •  UAT/Prod  etc  

3.   Learn  Integra7on    •  Install  Analy)cs  for  Learn  Building  Block      

•  Enable  the  Building  Block  on  the  system  

•  Select  the  execu)on  )me  for  the  background  Data  Integra)on  Task  (which  runs  once  a  day)  

•  Verify  connec)vity  between  Analy)cs  Server  and  Learn  Stats  schema  

“If  data  is  cool  &  analysis  is  powerful,    

“If  data  is  cool,  &  analysis  is  powerful,    

then  ac)on  driven  by  analysis  is  transforma)ve.”

Thank You

Chris  Eske  chris.eske@blackboard.com