butler

Universal Design for Assessment (UDA)

Presented by

Anitra Butler, Associate Professor

Teacher Education

Prince George’s Community College

Universal Design for Learning (UDL)

Universal Design for Learning (UDL) is a framework for removing barriers by anticipating the needs of all learners. UDL strategies are frontloaded rather than retrofitted.

UD illustrated

Learning is not ONE thing

Learning… differs across tasks differs within tasks differs across individuals differs within individuals

UDL

Universal = Everybody Design = Multiple means of representation Learning = Not one thing UDL is less likely to marginalize learners UDL gets all learners into the “zone”… The

Zone of Proximal Development (ZPD)

Universal Design (UD)

“Universal Design is a conceptual extension of historical mandates calling for equal access to environments for people with disabilities”—American with Disabilities Act of 1990.

UD seeks to integrate high-access features into environments from the beginning.

The Environment

The structure and format of an environment influences the quality and quantity of user interactions.

UD is based on the premise that environmental features combine with personal characteristics to influence the success of user interactions.

Elements of the Environment

Directions for the users Layout of information or material Physical operation of the equipment (such as

calculators, computers, or scientific tools)

Student attributes

Learner attributes influence the scope of the environmental interactions– Cognitive abilities– Physiological and physical characteristics– Individual preferences

UD applied to learning

Universal design has been pushed beyond the physical classrooms and institutional environments and into cognitive learning spaces.

The ultimate intention of UD in education is to provide an equitable learning environment that is accessible by all learners to the greatest extent possible.

UD applied to learning

UD leads to the co-construction of the learning environment and the learning experience.

The learner and the instructor designs the course together using the course learning outcomes as a guide.

Demonstrating Knowledge Acquistion

Learners with deficiencies in access skills may be unable to demonstrate their knowledge and abilities in the tested domain.

These deficiencies include limited reading skills, limited linguistic skills, or cognitive deficiencies.


Learners with various access deficiencies may not be able to demonstrate their knowledge in traditional paper and pencil assessments.

UDA seeks to remove barriers that inhibit understanding or expression of domain-specific knowledge.


UDA calls for testing what is important, not what is easy.

Course learning outcomes

The outcomes of the course is used to measure learning acquisition.

Questions to consider…– What tools will assist the learner in acquiring the

content?– How can all learners have access to the content

(i.e., access text, access key points within a presentation, access course room materials, etc.)

Course learning outcomes

Questions to consider continued…– How can learners best demonstrate their

knowledge and abilities in the tested domain?– How can I make the assessment accessible?

This means no “gotchas” This means no “pop quizzes” or unannounced exams This means aligning presentations, lectures, and

assignments with the assessment

Web-based Tools (Wb-T)

Wb-T are used to design, author, deliver, and manage web-based learning.

Wb-T allow alternate ways to express and assess learning (e.g., blogs, podcast assessments, study guides, etc.)

Digital media supports a wide-range of learners.

Web-based Tools (Wb-T)

Wb-T offers flexible platforms– Digital media provides multiple ways to represent

something– Digital platforms allow learners to personalize

learning

Web-based tools (Wb-T)

Computer-based technology presents an efficient tool for customizing assessments to meet individual needs within a universally designed environment.

Computerized tests administer items to the learner through an interactive computer environment. – Item format can vary from static representation of

the problem to different multimedia presentations

Wb-T for Authoring (brief list)

Captivate Adobe Adobe Captivate software enables anyone to rapidly create powerful and engaging simulations, software demonstrations, and scenario-based training without programming knowledge or multimedia skills.

Dreamweaver Adobe Dreamweaver is an integrated development environment for ColdFusion, HTML, XHTML, ASP, Microsoft ASP.NET, JSP, and PHP websites. Dreamweaver supports today's web technologies and standards, including accessibility and web services.

Wb-T for Authoring (brief list)

Flash Adobe Flash is the fastest way to create Internet content and applications for rich user interfaces, online advertising, eLearning courses and enterprise application front-ends.

LearningAgents Learn.com LearningAgents enable organizations to personalize their training and corporate messages. Almost zero programming is required to have the LearningAgent walk and talk your users through courseware or web sites.

MOODLE moogle.org Moodle is a course management system (CMS) - a free, Open Source software package designed using sound pedagogical principles, to help educators create effective online learning communities.

Wb-T for Design

courseWriter 2.5 is a computer application for Windows 9x/NT compatible computers. It provides reinforcement of instructional design skills taught in all the DSA workshops and speeds up the process of producing training modules.

Designer's Edge Allen Communication Designer's Edge is a revolutionary set of integrated pre-authoring toolsets and wizards, built by instructional experts to accelerate the analysis, design, and evaluation of effective technology-based training.

Wb-T for Live Broadcast (brief list)

Acrobat Connect Adobe A complete web conferencing and training solution with no software downloads for participants. Instant availability and highly-customizable meeting, training, and presentation tool.

LearnLinc Allen Communication LearnLinc is a live virtual classroom environment that enables corporations to deliver live e-Learning courseware to employees or students via the Internet, corporate intranet, or wide area network.

Lotus Virtual Classroom IBM This powerful new virtual classroom solution enables customers to quickly and easily develop and deliver just-in-time training to their audiences - anywhere, anytime.

Web Crossing Web Crossing Web Crossing is a collaboration server platform offering discussion groups/bulletin boards, integrated newsgroups and mailing lists, full email services, calendar services, real-time chats, live events and full web application programming features.

In Kirkpatrick's four-level model, each successive evaluation level is built on information provided by the lower level.

ASSESSING TRAINING EFFECTIVENESS often entails using the four-level model developed by Donald Kirkpatrick (1994). According to this model, evaluation should always begin with level one, and then, as time and budget allows, should move sequentially through levels two, three, and four. Information from each prior level serves as a base for the next level's evaluation. Thus, each successive level represents a more precise measure of the effectiveness of the training program, but at the same time requires a more rigorous and time-consuming analysis.

Kirkpatrick's Four Levels of Evaluation

Kirkpatrick's Four Levels of Evaluation

Kirkpatrick’s Level 1

Level 1 Evaluation - ReactionsEvaluation at this level measures how participants in a training program react to it. It attempts to answer questions regarding the participants' perceptions – Do participants like the organization of the course thus far? Is the material relevant to their work or their interests? This type of evaluation is often called a “smilesheet.” According to Kirkpatrick, every program should at least be evaluated at this level to provide for the improvement of a training program. In addition, the participants' reactions have important consequences for learning. Although a positive reaction does not guarantee learning, a negative reaction almost certainly reduces its possibility.


Learners can indicate their preference for content/assessment scheduling, content/assessment setting, content/assessment presentation and the media of response for assessment purposes.

On the first level of Kirkpatrick’s evaluative process, it is fine to ask learners how they learn best.

Class Profile Matrix

Based on the responses received from the learner’s reactions to a level one assessment, a class profile matrix can be developed that will assist the creation of an accessible course room.


Level 2 Evaluation - Learning To assess the amount of learning that has occurred due to a training

program, level two evaluations often use tests conducted before training (pretest) and after training (post test).

Assessing at this level moves the evaluation beyond learner satisfaction and attempts to assess the extent students have advanced in skills, knowledge, or attitude. Measurement at this level is more difficult and laborious than level one. Methods range from formal to informal testing to team assessment and self-assessment. If possible, participants take the test or assessment before the training (pretest) and after training (post test) to determine the amount of learning that has occurred.

In sum…

Environmental demands + learner = a learning deficiency when the learner is not able to meet the course demands.

UDL provides the learners with strategies and accommodations that support access to the content.

Paper and pencil tests limit knowledge expression. Ask yourself, what other mediums can be utilized to

assess knowledge acquistion.

References:

Ketterlin-Geller, L. R. (2005). Knowing what all students know: Procedures for developing universal design for assessment. The Journal of Technology, Learning, and Assessment, 4, (2). Available from http://www.jtla.org

References:

Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluation training programs. San Francisco, CA: Berrett-Koehler Publisher, Inc.

Questions?