Designed for Success: Issues and Strategies for

Managing the Development of Online Learning

Lawrence C. RaganDirector of ID&D, Penn StateWorld Campus

Peter WilliamsDirector of Distance Education, Rogers State University

Session Overview• Institutional Assessment (+ introductions)• Designing the ID&D Plan

– Roles & Competencies– Staffing Plan– ID Model– Systems for Success– Evaluation

• Case Studies• Problem/Solutions Exercise

Institutional Assessment

• Definition exercise

• Goals of mission/initiative

• Definition of purpose, audience and objectives

• Definition of technology base/system

• Reporting out

Defining Required Skills and Competencies

What do I need to know to make this work?

Online Course Development Roles I

• Project Manager

• Instructional Designer

• Content Expert/Author

• Instructor/Facilitator

• Programmer

• Support Staff

Online Course Development Roles II

• Copyright/Legal Issues Expert

• Evaluation Specialist

• Graphics Designer

• Multimedia Developer

• Media Publisher/Editor

• Trainer

General Competencies

• Collaboration/ Teamwork

• Basic Technology – Web related technologies

• Interpersonal Communication

• Knowledge of DL

• Writing Skills

• Questioning Skills

General Competencies (cont’d)

• Skills in Development of Collaborative Student Focused Learning Environment

• Adult Learning Theory

• Knowledge of Support Services

Project Manager

• Staff coordination & motivation

• Budgeting & cost estimation

• Deadline & time management

• Strategic planning

• Organizational management

Instructional Designer

• Instructional Design for Interactive Technologies

• Media Attributes Knowledge

• Web based instructional tools

Content Expert/Author

• Content Knowledge

• Writing

• Online teaching Strategies/Models

Instructor/Facilitator

• Content Knowledge

• Advising/Counseling

• Facilitation of Discussion

• Teaching Strategies/Models

• Writing

• Questioning

Programmer

• HTML, XML, Java, JavaScript, & related

• Human computer interface

• Operating systems

• Multimedia software

• Web page design

• File management

• Database

Support Staff

• Advising/ Counseling

• Knowledge of Support Services

• Instructional Materials Management

• Public Relations

• Writing

• Consulting

Copyright/Legal Issues Expert

• Knowledge of copyright law

• Knowledge of intellectual property law

• Knowledge of licensing

• Inventory skills

• Research skills

Evaluation Specialist

• Data Analysis

• Evaluation

• Questioning

• Knowledge of DL

• Needs Assessment

• Feedback

Graphic Designer

• Multimedia, Software

• Bitmap and Vector based graphics

• HTML & related programming

• Instructional Design for Interactive Technologies

• Media Attributes

• Editing

• Instructional Design

Multimedia Developer

• Multimedia, Software

• Bitmap and Vector based graphics

• Animation development

• Use of MM on networks

• Audio and video development

• Instructional multimedia

• HTML & related programming

Media Publisher/ Editor

• Editing

• Media Attributes Knowledge

• Multimedia

• Writing

• HTML Authoring

• Text Layout

• Development of Collaborative, Student Focused Learning Environment

Trainer

• Training Skills for Technology

• Modeling of Behavior/Skills

• General Education Theory

• Teaching Strategies

• Skill with Internet Tools for Instruction

• Knowledge of Course Content

• Advising Counseling Skills

Roles & Competencies

Graphics Designer M; Multimedia/software; bitmap & vector based graphics; HTML ID for

Interactive tech; Media attributes; Editing;

Instructional Design.

Project Manager Staff Coordination/motivation; Budgeting & cost estimation;

Deadline & time management; Strategic planning;

Organizational management.

Content Expert/Author

Content Knowledge;Teaching Strategies/Models; Web based

instructional tools.

Instructor/Facilitator

Content knowledge Advising/counseling;

Facilitation of discussion; Teaching strategies/models;

Writing; Questioning.

Support StaffInstructional materials

management; File/records management;

Advising/counseling; Public relations.

Evaluation Specialist

Data Analysis; Evaluation; Questioning; Knowledge of

Online ed; Needs assessment; Feedback; Instrument

development.

Multimedia Developer

Multimedia/software; Animation development; Bitmap & vector based graphics; HTML & related

programming; Use of MM on networks;Audio/Video dev.

Instructional MM

Media Publisher/ Editor

Editing; Media attributes; HTML programming;

Multimedia; Writing; Text layout.

Trainer Training skills for technology; Modeling of behavior/skills; General education theory;

teaching strategies; Internet tools for instruction;

knowledge of course content; advising/counseling skills.

General: Collaboration/teamwork; Basic technology; Interpersonal communication; Knowledge of Online instruction; Writing; Questioning; Development of Collaborative student focused learning environment; adult learning theory; knowledge of support services.

CR/Legal Issues Expert

Data Analysis; Evaluation; Questioning; Knowledge of Online ed; Needs assessment; Feedback;

Instrument development.

Programmer HTML, XML, Java, JavaScript &

other; Human computer interface; Operating systems; Multimedia software; Web page design; File

management; Database.

Instructional Designer

Instructional Design for Interactive Technologies; Media

Attributes; Web based instructional tools.

Models for Instructional Design & Development (ID&D)

for On-line Materials

ID&D Model Elements

• System Components*content delivery, communications, projects, evaluation/assessment

• Design & Development Services*instructional design, materials development, DE pedagogy, editing,technical programming

Five On-line “Systems” Models

• Build-It-Yourself

• Out-of-the-Box-Solution

• Outsource Development/Local Host

• Local Development/Outsource Host

• Outsource Everything

• “Your-On-Your-Own-Buddy!”

Build-It-Yourself

• Pro: Highly customizable, unique, tightly integrated with existing administrative systems

• Con: Very expensive, time consuming, continual “water/feeding,” dependent on staff

Out-of-the-Box-Solution

• Pro: Cost efficient, time efficient, new versions, more comprehensive, “maybe” more stable

• Cons: Limited customization, version control, feature creep, lack of control, potentially unstable within local environment

Outsource Development /Local Host

• Pros: External expertise, cost/time efficient, new versions, matched to local conditions

• Cons: Lack of control, cost, revision cycle, generic design

Local Development/Outsource Host

• Pros: Stable delivery, version control

• Cons: Hosting fee, lack of customization

Outsource Everything

• Pros: Cost efficient, version updates

• Cons: Costs, dependent upon external vendor for “core service”

Your-On-Your-Own-Buddy!

• Pros: Great variations in design, exciting new learning environments

• Cons: Great variations in design, misrepresentation of institution, quality control, students need to relearn operating environment, reinventing the wheel, potential bad “word of mouth,” may be highly cost in-efficient

ID&D Model Options

• Centralized ID&D Service Unit

• Faculty-developed Model

• Outsource ID&D Services

• “Your On Your Own Buddy!”

Centralized ID&D Service Unit

• Pros: Customizable, unique design, cost efficient, flexible, quality & consistent standards, standardized look and feel, manage revision cycle, pooled brainpower

• Cons: Staffing highest costs, high pressure, standardization vs innovations, maintenance, no content

Faculty-developed Model

• Pros: Cost efficient, diversity, shift of responsibility

• Cons: Lack of responsiveness/priority, lack of ID/IT skills, limits to capable faculty, diversity of design models

Outsource ID&D Services

• Pros: Cost & time efficient, pedagogically sound

• Cons: Lack of flexibility, lack of ability to customize, costs, revision cycle, lack of support

Evaluation and Assessment Strategies

Program Evaluation

• Student Performance

• Faculty Performance

• Student satisfaction

• Systems evaluation

Student Performance

• Grades (quizzes, exams, projects, papers, etc…)

• Retention

• Change in skills, attitudes, knowledge

• Interview

Faculty Performance

• Delivery of materials for development

• Student feedback

– Surveys

– Phone interviews

– Complaint tracking

• Interview faculty to promote reflective practice

• Formal “Course Evaluation Forms”

Student Satisfaction

• Mid or End of course survey

• Interviews (phone or focus groups)

• Re-enrollment

• Complaints

• Key Questions

– “Would you enroll in another online course?”

– “Would you recommend this course to a friend?”

Systems Performance

• Technology systems: Courseware, Technical support

– Surveys of students, faculty, development team

– Helpdesk log

• Faculty support: Training, Helpdesk

– Surveys, interviews, performance assessment

• Development processes

– Interviews, surveys, product/process analysis

Program Evaluation

• Externally reviewed (agency/company)

• Planned and imbedded (internal to program)

• Improvement focused (Continuous Quality Improvement)

• Dedicated resources

Case StudiesThe Case of the “High Tech MBA” Initiative

The Case of the “Workforce Impact” Initiative

The Case of the “Education4U” Initiative

The Case of the “Edu.com” Initiative

The Case of the “Global Reach” Initiative

The Case of the “Preparing for Tomorrow” Initiative

The Case of the “Release Valve” Initiative

www.worldcampus.psu.edu

www.rsuonline.edu

www.personal.psu.edu/lcr1www.rsuonline.edu