mccvlc webinar - online program review
DESCRIPTION
Slides used in conjunction with webinar for online program review at community colleges.TRANSCRIPT
![Page 1: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/1.jpg)
Evaluating Online Learning Programs
![Page 2: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/2.jpg)
Upcoming MCCVLC Webinars
• Apr. 12 – Effective Practices for • New Online Student Orientation• Student Support Services• Professional Development
• Apr. 19 – Accessibility for Online Learning
![Page 3: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/3.jpg)
Comparing Program Reviews to Accreditation
How does the accreditation process
inform our program reviews?
![Page 4: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/4.jpg)
Definitions• Distance Programs (as per HLC)• Distance-delivered programs are those
certificate or degree programs in which 50% or more of the required courses may be taken as distance-delivered courses.
• Source: HLC Substantive Change Application
![Page 5: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/5.jpg)
Definitions• Distance-delivered courses are those in
which all or the vast majority (typically 75% or more) of the instruction and interaction occurs via electronic communication, correspondence, or equivalent mechanisms, with the faculty and students physically separated from each other.
• Source: HLC Substantive Change Application
![Page 6: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/6.jpg)
Definitions• Correspondence Education:• 1) Education provided through one or more
courses by an institution under which the institution provides instructional materials, by mail or electronic transmission, including examinations on the materials, to students who are separated from the instructor.
• Source: HLC Substantive Change Application
![Page 7: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/7.jpg)
Definitions• Correspondence Education: (cont.)• (2) Interaction between the instructor and the
student is limited, is not regular and substantive, and is primarily initiated by the student.
• (3) Correspondence courses are typically self-paced.
• (4) Correspondence education is not distance education.
• Source: HLC Substantive Change Application
![Page 8: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/8.jpg)
Percentage Bracket
Percentage of Distance-Delivered Offerings(calculations are based on degree programs, not certificates)
3 Up to 100% of total degree programs
2 Up to 20% of total degree programs
1 Initiation of distance-delivered offerings up to 5% of total degree programs
0
No degree programs or more than four certificate programs (Commission policy does permit the institution to offer up to four certificate programs as well as a limited number of courses leading to degree programs through distance education or correspondence education without seeking prior approval.)
Seeking Approval from HLC
![Page 9: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/9.jpg)
Initiation with the HLCInitiation occurs and a review is required when the institution:
– plans to initiate its first distance education degree program
– has initiated four distance education certificates and plans to initiate a fifth
• NOTE: Add’l language about correspondence omitted
![Page 10: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/10.jpg)
Expansion of Distance EducationExpansion occurs and a review is required when the institution:
– plans to increase its current activity in distance education degree programs (or correspondence) to a higher Percentage Bracket.
![Page 11: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/11.jpg)
An HLC Review• Comprehensive reviews examine
– curriculum, – staffing, – support services, – access to appropriate laboratory and
library resources, – and all other facets of quality higher
education.
![Page 12: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/12.jpg)
Interregional Guidelines for the Evaluation of Distance Education
(Online Learning)
http://xlents.com/2012/02for links and info
![Page 13: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/13.jpg)
C-RAC (Council of Regional Accrediting Commissions)
The new guidelines have been endorsed by all regional accrediting
organizations in the U.S.
![Page 14: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/14.jpg)
9 Hallmarks of Quality1. Appropriate to mission and purposes2. Part of regular planning and evaluation3. Incorporated into governance/oversight4. Curricula are coherent, cohesive, &
comparable in academic rigor (to trad)5. Evaluates effectiveness of online
offerings, incl. outcomes achievement
![Page 15: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/15.jpg)
9 Hallmarks of Quality
6. Online faculty are appropriately qualified & effectively supported
7. Effective student and academic services for online students
8. Sufficient resources to support and expand online offerings
9. Assures integrity of online offerings
![Page 16: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/16.jpg)
On-CampusProgram Review
What is the purpose?
![Page 17: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/17.jpg)
On-CampusProgram Review
What is your established practice?
![Page 18: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/18.jpg)
Example: Glendale CC
![Page 19: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/19.jpg)
Glendale – Trend Analysis
![Page 20: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/20.jpg)
Glendale – Student Learning Outcomes
![Page 21: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/21.jpg)
Glendale – Parts 3, 4, 5• 3.0 Evaluation of Previous Goals• 4.0 Action Plan
– What is the goal? • Is it reflected in the Academic Master Plan?
– What are the SLOs• Core competencies (college-wide)• Program SLOs• Course SLOs
– How will it improve student learning?• 5.0 Resource Requests
![Page 22: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/22.jpg)
Comparing On-Campus to Online Program Reviews
In what ways should review of online programs be different?
![Page 23: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/23.jpg)
A Starting Point• Gather proof that your courses are distance
education courses and not correspondence courses. Gather evidence of:– Regular and substantive interaction between the
instructor and the student – and not primarily initiated by the student.
– Timeline expectations for online students to indicate that they are not self-paced. (Maybe!)
![Page 24: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/24.jpg)
Comparing Online Program Data• Possible benchmarks:
– Similar on-campus programs– Similar online programs– Trend analysis over time– Internally set goals or targets– State or National data (to the extent
possible)
![Page 25: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/25.jpg)
Possibilities to Consider• Course Design Quality• Online Teaching Evaluations (by admin)• Online Course Evaluations (by students)• Assessments of Learning Outcomes
– College-wide outcomes– Program outcomes
![Page 26: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/26.jpg)
3 Major Components of e-Quality
Learning LevelIs High
Teaching LevelIs High
Course DesignMeets Standards
Learning Assessment
Performance Eval Qua
lityM
atter
s®
![Page 27: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/27.jpg)
Designing for Interaction
Specific Review Standards PointsV.1 The course design provides learning activities to foster instructor-student, content-student, and if appropriate, student-student interaction. 3
V.2 The student requirements for course interaction are clearly articulated. 3
V.3 Clear standards are set for instructor response and availability (turn-around time for email, grades posted, etc.) 2
V. LEARNER INTERACTIONGeneral Review Standard: The effective design of instructor-learner interaction andmeaningful learner cooperation is essential to learner motivation, intellectual commitment, and personal development. (From LSC Course Design Rubric)
![Page 28: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/28.jpg)
More Possibilities to Consider• Student e-Services Audit (if program specific)
• Student Satisfaction Surveys• Course Completion Rate Analyses• Course Success Rate Analyses • Term-to-term Persistence Analyses• Graduation Rate Analyses• Transfer & Placement Rate Analyses
![Page 29: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/29.jpg)
Review of e-Services
![Page 30: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/30.jpg)
CENTSS
More coming on April 12
![Page 31: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/31.jpg)
Student Satisfaction
![Page 32: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/32.jpg)
Option 1 - PSOL
![Page 33: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/33.jpg)
Why PSOL?
![Page 34: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/34.jpg)
PSOL BasicsThere are 72 questions that comprise the PSOL. Average completion time is 15 minutes.
NOTE: questions are answered on a 7-point Likert scale, where 7 is high.
26 Priorities statements (can add 10)
7 Information sources about school/program
11 Factors to enroll in the program
3 Overall satisfaction questions
14 Demographics questions (can add 1)
![Page 35: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/35.jpg)
The Importance of Importance
![Page 36: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/36.jpg)
Data Comparisons
36
![Page 37: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/37.jpg)
A.A. Students are Very Satisfied
Reputation Offerings Library Quality4.6
4.8
5.0
5.2
5.4
5.6
5.8
6.0
6.2
LSC National A.A. Business Other
2006 Data
![Page 38: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/38.jpg)
5-year Trend Data
38
![Page 39: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/39.jpg)
Completion and Success
![Page 40: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/40.jpg)
Grades Earned
A B C D F FN W0%
5%
10%
15%
20%
25%
30% LSC Developmental Courses - 2009-2010
Online On-ground
![Page 41: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/41.jpg)
Passing Grades in These Courses
C or better D or better50%
55%
60%
65%
70%
60.4%
67.5%
62.3%
66.8%
Passing Grades in Developmental Courses
Online On-ground2009-2010
![Page 42: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/42.jpg)
Persistence
Graduation
Placement
Transfer
![Page 43: MCCVLC webinar - Online Program Review](https://reader036.vdocuments.site/reader036/viewer/2022062614/54634034b1af9f92238b5388/html5/thumbnails/43.jpg)
Q & A
Evaluating Online Learning Programs