desire2learn insights - achievement reporting (outcomes assessment)

Desire2Learn Insights™ Achievement Reporting

Today’s Presenter Michael Moore, MSCIS

Sr. Advisory Consultant - Analytics

Less Data, More Insights™

Reporting Tools

Forecasting, Risk Analysis

Optimized Performance

Advanced Data Visualization

Desire2Learn Analytics Portfolio

DEGREE COMPASS™

INSIGHTS™

REPORTING

TOOLS

Learning Analytics

Learning Analytics

• What is the goal? – Use data

rigorously & empirically

– to transform teaching & learning

Learner Data

Mark David Milliron at Educause 2011

• “Bring data to learning moment”

– Data in the hands of students, instructors & advisors

– Use data to make decisions at the moment of learning

• “Can you use information about me?”

– Institutions use data about students every day

• Analytics based decisions

– Make improvement decisions based on analytics data

Was CEO Bill & Melinda Gates

Foundation Now WGU Texas

Chancellor Mark David Milliron

Learning Analytics Process

Capture

Report

Predict Act

Refine

Campbell and Oblinger (2008)

Learning analytics seeks to combine

historical and current user data to predict

what services specific users may find

useful now. (Elias 2011)

Daytona State College

Institutional Outcomes

Reporting Project

Case Study

Project Goals

• College-wide Unified outcome tracking

• Continuous Improvement

• SACS Accreditation Re-affirmation

• Assessment of learning material effectiveness

• Save faculty time in data gathering and reporting

• Student Success & Retention

• ePortfolio – Evidence of student learning

Project Success Factors

• New President – Long-Term Vision

• Executive & Sr. Faculty Buy-In

– Programmatic faculty adoption

– President and Exec Vice-President Endorsement

• Planned Roll-Out

• Faculty Training

• Continued Improvement

On-Site D2L

Planning Visit

Oct 2011

Outcome Structure Used in

Pilot Programs

Spring 2012

1st Round reports for evaluation

in Pilot Programs

Fall 2012

Outcome Structure Deployed in Phased Approach

Fall 2012

SACS Final

Report

Complete

Mar 2013

SACS On-Site

Visit

Sep 2013

Training and

Rollout to Deans, Chairs

and Faculty

Reporting Project

Timeline

Foundations & Structure

Organization Unit Foundation (OUs)

• Create custom org units and relationships as needed

• Could be manually defined in the DOME

Organization

Terms Custom Org

Units Departments

Course Templates

Course Offerings

Sections Groups

• Create custom org units and relationships as needed

• Could be manually defined in the DOME

Organization Unit Foundation (OUs)

Outcome Structure

Learning Activities & Rubrics

Learning Objectives

Competencies

Competencies C0

C1

LO1

A1-R1 A2-R2

LO2

A3-R1

C2

LO3

A4 –R1

Outcome Structure

Learning Activities & Rubrics

Learning Objectives

Competencies

Competencies C0

C1

LO1

A1-R1 A2-R2

LO2

A3-R1

C2

LO3

A4 –R1

Program Learning Goal 1: Students will be able to express themselves clearly, succinctly and accurately in writing.

Program Learning Goal 1: Students will be able to express themselves clearly, succinctly and accurately in writing.

Student Learning Outcome 1.1: Students will compose a university-level essay analyzing a literary text

Learning Activity – Essay Dropbox: Compose a university-level essay analyzing a literary text. The essay will be evaluated using the college writing rubric.

Student Learning Outcome 1.1: Students will compose a university-level essay analyzing a literary text. Learning Activity – Essay Dropbox: Compose a university-level essay analyzing a literary text. The essay will be evaluated using the college writing rubric.

Outcome Achievement Requirements

Rubrics

• Rubrics help institutions and instructors understand student achievement of learning outcomes.

• The benefits of using rubrics in courses can be observed by both the instructor and student.

Dropbox Configuration

1

2

Quiz Configuration

1

3

2

Learning Environment Learning Analytics Within

The Learning Environment

Desire2Learn Analytics Essentials

Course & User Progress

Course Analytics (v10.1)

• Instructor can see overall course progress

• Native in the Learning Environment

• Student can view their own progress

Course Analytics - Options

Content Completion

Discussion Participation

Dropbox Performance

Grades Performance

Checklist Completion

Login History

Objectives Completion

Quiz Performance

Survey Completion

Student Analytics (v10.1)

Quiz Activity Results

Activity Results – Quiz Example

Activity Statistics – Quiz Example

Activity Statistics – Quiz Example

Rubric Statistics

Rubric Statistics

Rubric Statistics

Rubric Statistics

Achievement Results

Achievement Results

Instructor’s View

Achievement Results

Student’s View

Outcome Achievement Reports Learning Analytics From

Insights™ Data Warehouse

Quiz Item Analysis

Learning Outcome Alignment

Organization: Lake Valley University (4 learning outcome selections)

LVU IO 1 -

Communication

LVU IO 2 – Critical

Thinking LVU IO 3 – Cultural

Awareness

LVU IO 4 – Information

Literacy Engineering Technology

(11 selections)

Lake Valley University (lvu)

Curriculum Mapping Report Lake Valley University (lvu)

LVU IO 1 -

Communication

LVU IO 2 – Critical

Thinking

LVU IO 3 – Cultural

Awareness

LVU IO 4 –

Information Literacy Program: Elementary Education

(7 Course Template selections)

Organization: Lake Valley University (4 learning outcome

selections)

Individual Student Progress

Achievements by Course

Individual Achievements

Course Learn Outcome Evaluation

Program Learning Outcome Evaluation

Rubric Evaluation – Est. Spring Release

ePortfolio Evidence of Learning

Co-Curricular Learning Activities

Evidence of Learning

• Outcome Achievements

• Portfolio of Best Work

• Comments and reflections

• Assessments

LMS Certified Artifacts

• LMS Certified artifacts

– Grades

– Learning objectives

– Dropbox submissions

– Quiz attempts

Outcome Achievements

• Program defined template

• Student example of work by outcome

• Student reflection of learning

• Associate learning objectives

Co-Curricular Activities

Co-Curricular Activities

• Associate learning objectives

Questions?

Michael Moore Sr. Advisory Consultant - Analytics Direct 888.772.0325 x6604 Twitter: @MikeMooreD2L Michael.Moore@Desire2Learn.com

Thank You

Desire2Learn, Campus Life, CaptureCast, Desire2Learn Binder, myDesire2Learn, Insert Stuff, Insert Stuff Framework, Instructional Design Wizard, and the molecule logo are trademarks of Desire2Learn Incorporated. The Desire2Learn family of companies includes Desire2Learn Incorporated, D2L Ltd., Desire2Learn Australia Pty Ltd, Desire2Learn UK Ltd, Desire2Learn Singapore Pte. Ltd. and D2L Brasil Soluções de Tecnologia para Educação Ltda.

Let’s transform

teaching and learning,

together.