designing gamified flipped learning experiences

Zaid Ali Alsagoff

Source: http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf

…. Of U.S. employment is in the “high risk” category of being automated in the next decade or two.

Biggest Challenge Ahead?

The Second Machine Age: http://www.amazon.com/The-Second-Machine-Age-Technologies/dp/1480577472

Anything you can do, I can do BETTER, FASTER

& CHEAPER!

Disruptively rapid codification and

automation of routine and complex processes

by computers and robots.

Time Cover: http://content.time.com/time/covers/0,16641,20061218,00.html

Source (p. 4): http://www.slideshare.net/Management-Thinking/closing-the-skills-gap

Survival Skills for Careers, College & Citizenship

1. Critical Thinking & Problem-Solving

2. Collaboration Across Networks & Leading by Influence

3. Agility & Adaptability

4. Initiative & Entrepreneurialism

5. Effective Oral & Written Communication

6. Accessing & Analyzing Information

7. Curiosity & Imagination

Presentation Slides: http://www.slideshare.net/internationaled/the-global-achievement-gapVideo: http://www.youtube.com/watch?v=NS2PqTTxFFc

Dr. Tony Wagner

TopicTODAY’S MENU

LEARNING

LEARNING DESIGN

FLIPPING & GAMIFYING

SOCIAL MEDIA

LEARNING

Future Learning Methods?

Learn While Sleeping!

Massive Open Sleeping Courses!

Super Delta Brain Wave Learning!

Learning Uploads/Chips!

Future Learning Methods?

Learning Pills!

Learning Implants, Uploads & Super Learning Neurons!

Amazing Facts About the Human Brain (Infographic): http://www.best-infographics.com/amazing-facts-about-the-human-brain-infographic/

Adapted from: http://catalog.flatworldknowledge.com/bookhub/reader/18?e=price_1.0-ch04_s01 `

Memory Processing Model

FORGETTING

Attention

Encoding

Retrieval

REMEMBERINGINPUT

SensoryMemory

Short-TermMemory

Long-TermMemory

Research - Best Learning Techniques?

Image Source: http://bigthink.com/neurobonkers/assessing-the-evidence-for-the-one-thing-you-never-get-taught-in-school-how-to-learnFull Report: http://www.psychologicalscience.org/index.php/publications/journals/pspi/learning-techniques.html

From Worst to Best…

Image Source: https://mosaicprojects.wordpress.com/2014/09/18/the-psychology-of-effective-learning/Full Report: http://www.psychologicalscience.org/index.php/publications/journals/pspi/learning-techniques.html

"It's not that I'm so smart, it's just that I stay with problems longer."

- Albert EinsteinIn 1905, Albert Einstein published the theory of special relativity, and then spent another 10 years trying to include acceleration in the theory and published his theory of general relativity in 1915.

Diagram: http://pairadimes.davidtruss.com/learning-and-failure/

Diagram: http://headrush.typepad.com/creating_passionate_users/2006/03/how_to_be_an_ex.html

The Mindset to Mastery…

http://blog.zintro.com/2012/08/10/10000-hour-rule-malcolm-gladwells-10000-hours-of-practice-theory-from-outliers-visualized/

The 10,000 Hour Rule!

https://educationcogitation.com/tag/science/

THE SCIENCE OF SUCCESSFUL LEARNING

https://educationcogitation.com/tag/science/

MAKE IT STICK

2LEARNING

DESIGN

What ANNOYS About PowerPoint Presentations?

Results of the 2013 Annoying PowerPoint survey: http://www.thinkoutsidetheslide.com/free-resources/latest-annoying-powerpoint-survey-results/

The speaker read the slides to us 72.0%

Text so small I couldn’t read it 50.6%

Full sentences instead of bullet points 48.4%

Overly complex diagrams 30.8%

Poor color choice 25.8%

No clear purpose 22.1%

No flow of ideas 21.0%

Why Lecture?

Lively

Educative

Creative

Thought (provoking)

Understandable

Relevant

Enjoyable

http://zaidlearn.blogspot.com/2010/06/vanishing-art-of-lecturing-prof-k.html

MISSION?Inspire

Influence

Inform

Constructive Alignment (CA)

LearningActivities

ContentAssessment

Learning Outcomes

More about Constructive Alignment: http://www.ucdoer.ie/index.php/Using_Biggs'_Model_of_Constructive_Alignment_in_Curriculum_Design/Introduction

- John Biggs

Integration Activation

Application Demonstration

Problem

Instructional Design Models & MethodsDick and

Carey ModelGagné's Nine Events

of Instruction

Bloom's Learning Taxonomy

Merrill's First Principlesof Instruction

ADDIEKemp's Instructional

Design ModelKirkpatrick's 4 Levels

of Evaluation

http://www.instructionaldesigncentral.com/htm/IDC_instructionaldesignmodels.htm

Gain Attention

Inform Learning

Outcomes

Stimulate Recall of Prior

Learning

Present New Content

ProvideGuidance

ProvideLearningActivities

Assess Learning

Provide Feedback

Enhance Retention and

Transfer

This will

help you…

Last class we

learned how to…

Allow me to

demonstrate

Now you

try it…

Try it like

this…

Let’s test

your skills

Let’s do it “in

the field”

Gagne’s 9 Events of Instruction

Source (Gagne’s 9 Events of Instruction starting at slide 9): http://www.slideshare.net/FareezaM/designing-engaging-presentation

Video: http://youtu.be/dLl5AcN_G24

Gain Attention!

What are you THINKING about?

Example: Improve your English!

Question Story

FactDefinition

Analogy

Personal experience Demonstration

Vide Clip

At the end of this topic, you will be able to:

Clarify what students need to learn in the

form of Learning Outcomes (LO).

Write LO that form the basis of the

assessment.

Construct LO using measurable action verbs.

Present LO in at least 2 creative ways.

WHATEVER!

SMART Learning Outcomes!

Bloom’s taxonomy (action verbs): http://www.flickr.com/photos/vblibrary/4576825411/sizes/o/in/pool-27724923@N00/SMART Learning Outcomes: http://explearning.ucf.edu/registered-students/tips-for-success/writing-smart-learning-objectives/195/

Action

Creative Ways?

Visualize and then voice out your Learning Outcomes!

Action Verbs3

1 Write

2 Assessment-Based

4 Creative Ways

Video: http://www.youtube.com/watch?v=Kb5Z59Ag9ek

Creative Ways?

How to write Learning Outcomes (LO)?

How to make LO assessment-based?

How to use action verbs to construct measurable LO?

How to present LO in at least 2 creative ways?

Write learning outcomes in the form of questions!

Video: http://www.youtube.com/watch?v=Kb5Z59Ag9ek

Associating new information with prior knowledge can facilitate the learning

process.

SHARERELATED

EXPERIENCES!

BRAINSTORM IDEAS!

PRE-TEST!

PROBLEMSOLVING!ANTICIPATE

WHAT’S NEXT!

DISCUSS WHAT THEY KNOW!

Selective Perception - Chunk and organize content meaningfully.

It helps you present information in a way that makes it EASIER for your audience/learners to

UNDERSTAND and REMEMBER.

Chunk? CHOP

Semantic Encoding - Examples, case studies, stories, graphical representations, mnemonics, mind maps, acronyms, and analogies.

Mnemonics

SODA: http://apotential.wordpress.com/medical-mnemonics/Medical Mnemonics: http://www.medicalmnemonics.com/

Mnemonics are learning memory techniques that help learners recall larger pieces of information, especially in the form of lists like characteristics, steps, stages, parts, phases, etc.

Mind Maps

Mind Map Guidelines: http://en.wikipedia.org/wiki/Mind_map Mind Maps in Medicine: http://www.mindmaptutor.com/2011/04/mind-maps-in-medicine/

Mind maps help learners comprehend, see the big picture, create new ideas, and build connections.

iMindMap: http://thinkbuzan.com/ Mind Mapping Tools: http://mashable.com/2013/09/25/mind-mapping-tools/

Infuse Creativity & STORIFY Learning!

“BULLETS stick for exams,

STORIES stick for life.” – Zaid Ali Alsagoff!

http://sirkenrobinson.com/skr/watch

Book (Amazon): http://www.amazon.com/Talk-Like-TED-Public-Speaking-Secrets/dp/1250061539/

Learn From TED Talks…

…More on TED Talks!

Book (Amazon): http://www.amazon.com/How-Deliver-TED-Talk-Presentations/dp/1491581018

Project

Simulation

TripsArticulate

Reasoning

Speaker

Problem

Solving

LEARNING ACTIVITIES

Discussion

Debates

Panel of

Experts

Experiments

ReviewGroup

Play Interviews

Scaffolding

Drill &

Practice

Drawing/Art

/Sculpture

Breakers

Online Teaching Activity Index: http://www.ion.uillinois.edu/resources/otai/

Think-Pair-

One-Minute

Entrance/

Exit TicketsConcept

Mapping

ReportsQuiz Portfolios

http://langwitches.org/blog/2015/06/12/an-update-to-the-upgraded-kwl-for-the-21st-century/

Miller’s Pyramid: http://www.gp-training.net/training/educational_theory/adult_learning/miller.htm

Use a Variety of Methods to Assess More…

http://web.me.com/janherrington/AuthenticLearning/Home.html

Learning AnalyticsPeer-Assessment

E-PortfolioRubrics

AUTHENTIC Learning & Empower PERSONALIZED Learning!

Source: http://dailygenius.com/levels-of-learning-analytics/

Summarize/Conclude

Provide additional

resources

Links (URL) to:

– Online Discussion

– Assignment/Project

– Quizzes

– Simulation/Games

– Etc.

Gagne’s 9 Event of Instructions

Presentation Events of Instruction Learning Activities

Introduction 1. Gain attention • Present a dilemma, analogy, video

2. Inform learning outcomes• List clear learning outcomes

creatively

3. Stimulate recall prior knowledge

• Explain how prior knowledge relates to new topic

• Initiate discussion• Pre-tests

Content 4. Present new content • Explanation, example, simulation

5. Provide guidance • Guidelines, checklists, mnemonics, group discussion

Assessment 6. Provide learning activities7. Provide feedback 8. Assess learning

• Check your understanding• Self/Peer/Facilitator Assessment• Practical, e-Portfolio, quiz

Summary 9. Enhance retention and transfer

• Summarize/Conclude the topic• Provide additional resources

How can we use

Technology to

TRANSFORMLearning?

http://tpack.org/

- Matthew Koehler & Punya Mishra

A framework that identifies the knowledge teachers need

to teach effectively with

technology.

The SAMR Model (Background and Exemplars): http://www.hippasus.com/rrpweblog/archives/2012/08/23/SAMR_BackgroundExemplars.pdf

- Ruben Puentedura

Image source: http://polareducationblog.ca/wp-content/uploads/2012/11/SAMR_model1.png

- Prof. Rozhan M. Idrushttp://beyondtechnogogy.ning.com/

Technogogy

Technogogy is then defined as the convergence of technology, pedagogy and content (learner focused) in the transformative use of technology to foster learning.

4D Technogogy Model

http://www.slideshare.net/zaid/testlearning-framework

E N V I R O N M E N T

T R A N S F O R M AT I O N

Online F2F

Substitution Redefinition

- Zaid Ali Alsagoff

Training Support

TEST-Learning Framework

STUDENT

Motivation

Learning Styles

Technology Knowledge

TEACHER

ExpertiseTechnology

Motivation

x-Gogy

LEARNING

Modification

OERs MOOCs

*F2F: Face-to-Face *MOOCs: Massive Open Online Courses*OERs: Open Educational Resources *X-Gogy: Peda/Andra/etc./gogies

LEARNING OUTCOME(S)

ASSESSMENT

CONTENT / ACTIVITIES

3FLIPPING &

GAMIFYING

Blended

*F2F: Face-to-Face

Finding the

Right Blend…

Online F2F

Video: http://bit.ly/1jOCeCgClayton Christensen Institute (Source): http://www.christenseninstitute.org/blended-learning-definitions-and-models/

Flipping

Infographic: http://www.knewton.com/flipped-classroom/Introduction Video: http://youtu.be/26pxh_qMppE

Source: http://ctl.utexas.edu/teaching/flipping-a-class/what

Source: http://wallacecenter.rit.edu/tls/flipped-classroom-resourceshttp://www.coolinfographics.com/blog/2011/9/13/the-flipped-classroom-infographic.html

Jackie Gerstein

http://www.slideshare.net/jgerst1111/flipped-classroom-higher-education

http://www.educause.edu/research-and-publications/books/learning-spaces

Construct Flipped Learning Spaces That…

INSPIRE STUDENTS to Connect, Collaborate, Think and Learn!

Source: http://www.channelnewsasia.com/news/singapore/ntu-to-spend-s-75-million/2204774.html

The Hive (NTU) is a $75 Million Dollar learning hub that consist of 56 smart

classrooms with flexible clustered seating, multiple LCD screens and wireless

communication tools.

Source: https://www.youtube.com/watch?v=Ah-SmLEMgis

Individual Learning

Teacher Led

Group/Project Work

MATCHBOOK LEARNING’S BLENDED CLASSROOM

Empower Educators & Students with 3D Printers…

To create 3D models that illustrate complex concepts or illuminate novel ideas, designs, and even chemical and organic molecules.

“Imagine Medical Students rapid prototyping and building artificial body parts.”

Article: http://www.engadget.com/2012/10/19/reshaping-universities-through-3d-printing/

Why Imagine only, when you

can do it!

Blended & Flipped Learning in…

http://zaidlearn.blogspot.com/2014/11/blended-flipped-learning-case-studies.html

Flipped Learning at

Chapter 15 (page 255): http://www.slideshare.net/ProfDrAmin/blended-flipped-learning-case-studies-in-malaysian-higher-education-institutions

Gamifying

If You Can Have

_______,

WHY NOT?

Gamify Learning Experiences!

http://zaidlearn.blogspot.com/2012/09/from-flipped-to-gamified-classroom.html

Gamification?

“The process of using game thinking and game mechanics to solve problems and engage users.”

- Gabe Zichermann

Source (Slide 11): http://www.slideshare.net/gzicherm/gamification-designing-for-engagement

Game Mechanics?

Constructs of rules and feedback loops intended to produce enjoyable gameplay.

Building blocks that can be applied and combined to gamify any non-game context.

http://gamification.org/wiki/Game_Mechanics

Chopped out from this Infographic: http://www.knewton.com/gamification-education/

Building Blocks

Badges: Rewarded a badge for completing a task/level.

Chopped out from this Infographic: http://www.knewton.com/gamification-education/

Building Blocks (2)

EXAMPLES?

Uses Existing Games to Amplify Learning!

https://sites.google.com/site/teamdrillhead/

http://youtu.be/OSJ5LwAXxLk

Mr. Pai

Mr. Pai features scalable, game

based curriculum using Flower Power of Mangahigh.com,

Timez Attack, Tutpup.com,

Nintendo DS, Brain Age 2, Raz-Kids, etc.

BozemanScience: http://www.bozemanscience.com/

Uses Moodle & Google Docs!

Paul Andersen

His Method: http://youtu.be/XGE6osTXym8

Uses elements of game design to improve his AP Biology class. The entire

class revolves around Moodle. Students complete levels to acquire experience

points and move up the leader board.

http://edudemic.com/2012/06/gamification-in-the-classroom-how-and-why-one-teacher-did-it/

Kate Fanelli

MathLand (20 Levels):1. Lesson2. Practice 3. Mastery Test (can redo)

Gamification? Points (for completing tests) Levels Avatar Board

http://wosc.edu/index.php?page=achievements#19

Acquire Badges for Completing Tasks!

Western Oklahoma State College

MISSION Explore the connectedness of the global

community through the lens of the economic, social, and environmental crises and the imminent threat of war.

Extricate each country from dangerous circumstances and achieve global prosperity with the least amount of military intervention.

LEARN Collaborate and communicate with each other

as one work to resolve the Game's conflicts.

Compromise while accommodating different perspectives and interests.

Discover that we share a deep and abiding interest in taking care of each other.

The World Peace Game

Homepage: http://www.worldpeacegame.org/ Trailer: https://www.youtube.com/watch?v=LqJnk-jYWRM John Hunter

Hands-on Political Simulation

Methodhttp://www.slideshare.net/zaid/gamify-classroom-learning-with-the-c2s2c-method

GAMIFY IT!http://zaidlearn.blogspot.com/2012/09/from-flipped-to-gamified-classroom.html

Use C2S2C Method to…

1 Challenge

2 Compete

3 Show

COURSE

Learning Outcome

LEARNINGACTIVITY

4 Score

5 Celebrate!

Gamification can be applied to sequential or non-sequential learning tasks/activities.

o Level 3o Points (100)o Advancedo Badge (3)o Map (100%)

o Ao 100%o Destinctiono Rubrico Peer-Assess

o Level 2o Points (80)o Noviceo Badge (2)o Map (80%)

o Bo 80%o Credito Rubrico Peer-Assess

Examples:o Level 1o Points (40)o Beginnero Badge (1)o Map (40%)

Examples:o Co 40%o Passo Rubric o Peer-Assess

1. CHALLENGE

TASK/ACTIVITY

2. A-B

3. A-B-C

4. A-B-C-D

5. A-B-C-D-E

6. A-B-C-D-E-F

7. A-B-C-D-E-F-G

8. A-B-C-D-E-F-G-H

9. A-B-C-D-E-F-G-H-I

10.A-B-C-D-E-F-G-H-I-J

11.A-B-C-D-E-F-G-H-I-J-K

GAMIFICATIONGRADING

Example?

http://zaidlearn.blogspot.com/2013/03/the-oer-workshop-at-oum.html

Gameplay: 3 Hours to do this…

Group Activity

2. COMPETE

Individual or Group

3. SHOW

PRESENT YOUR MASTERPIECE! FEEDBACK + Q&A

4. SCORE

http://gamification.org/wiki/Game_Mechanics

Levels

Points

Polling

Badges

Rubric

Scored by Self, Peer, Teacher and/or Computer Assessment. Select Your Game Mechanics Flavor!

Survey

Bonuses

Countdown

Rewards

StatusAvatars

5. CELEBRATE

“It’s NOT really about winning, but using game

mechanics to engage and inspire real

effort.”

- Zaid Alsagoff

OER Workshop at USM (27 – 28 June, 2012)

Gamifying to engage USM ACADEMICS to develop OER!

*OER: Open Educational Resources

2nd OER Workshop at USM (27 – 28 August, 2012)

Gamified Classroom Learning Works!

“Don’t gamify everything, but at least consider gamifying the ‘BORING’ stuff!”

– Zaid AlsagoffImage source: http://suuriamuutoksia.blogspot.com/2012/02/you-wanna-be-loser-like-me.html

http://www.slideshare.net/zaid/gamify-classroom-learning-with-the-c2s2c-method

Build Engaging Blended Courses…

Free & Commercial Options!

Tools to Spice Up Your Content?

Design 1 – 10 Minute Learning Nuggets!

Use Augmented Reality & Wearable Technologies…

32 Augmented Reality Apps for Education: http://www.teachthought.com/uncategorized/32-augmented-reality-apps-for-the-classroom-from-edshelf/

…To Transform Learning & Teaching Experiences!

Infographic: http://www.theconnectivist.com/2013/05/infographic-the-internet-of-being/Google Glass in Education: http://visual.ly/google-glass-education

Use Interactive Web Tools to Engage & …

Student Response Systems (SRS) that empower teachers to engage their students via smartphones, laptops, and tablets.

Gamify Learning!

TodaysMeet

https://todaysmeet.com/

Poll Everywhere

http://www.polleverywhere.com/

Plickers

https://plickers.com/

Plickers is a powerfully simple tool that lets teachers collect real-time formative assessment dataWITHOUT THE NEED FOR STUDENT DEVICES.

Padlet

https://padlet.com/

It works like an online sheet of paper where people can put any content (e.g. images, videos, documents, text) anywhere on the page, together with anyone, from any device (No login required).

Socrative

http://www.socrative.com/

Nearpod

https://nearpod.com/

An innovative and interactive classroom tool to create, engage and assess. An all-in-one solution for the use of devices in education!

Quizlet

https://quizlet.com/

SketchParty TV

http://sketchparty.tv/

The fun drawing-and-guessing party game for Apple TV!

Formative

https://goformative.com/

Kahoot

https://getkahoot.com/

http://quizizz.com/

FUN! EASY-TO-USE GREAT DATA

Guide: http://learninginhand.com/blog/quizizz

https://www.quizalize.com/

http://learninginhand.com/blog/quizizz

SOCIAL MEDIA

We Need To Rethink How WE…

COLLABORATE

Interact & Collaborate Online Using…

IMU Webinar Series (example): http://imuelearning.blogspot.com/p/imu-learning-webinar-series-2012.html

Various Social Media & Web 2.0 Tools!

http://twitter.com/

Use Twitter to Connect & Interact with

A free Web 2.0 social networking service that allows users to send and receive short messages (140 characters or less) known as TWEETS.

Easy way to discover the LATEST KNOWLEDGEyou care about.

Educators & Researchers around the world…

+310 Million Users

Twitter Basics

Article: http://tiny.cc/lp0b0

Connect all the course/research/knowledge domain related tweets from people into LEARNING STREAMS...

Follow/Create Twitter #Hashtags!

REMEMBERCreate a Unique, Short & Simple

#HASHTAG!

http://zaidlearn.blogspot.com/2011/02/use-twitter-hashtags-to-amplify-your.html

Examples:#MedEd – Medical Education#edchat - Education##edutech - Educational Technology#web20chat - Web 2.0#DistEd – Distance education and e-learning#innochat – Innovation in education#Lrnchat – Learning issues for educators#ellchat – English Language Learners

Use Facebook Groups or Pages to

Closed Groups

Courses

Projects

Alumni

Groups Pages

Open Communities

Promotion & Branding

Products

Celebrities

Self-Promotion

Connect, Network and Collaborate with others…

+1.65 Billion Users

CHALLENGES?

Technical Challenges

Tools overload

Firewall blocking

Accessibility

Usability

Ease-of-use

Sharing Challenges

Information overload

Content ownership

Confidentiality

Quality

Authority

Work-life balance

What about Plagiarism & Authenticity?

http://zaidlearn.blogspot.com/2013/01/was-dna-of-21st-century-educator.html

Was The 'DNA of a 21st Century Educator' Plagiarised in China?

How to PROTECTmy intellectual

Image: http://tinyurl.com/8y3p8nm

Arabic & English Versions: http://www.youtube.com/watch?v=P1j0OA9N4hs&feature=share&list=PL376F87A2B2F79BE8

Creative Commons (CC)

CC Comparison Table: http://scottfisk.com/wp-content/uploads/2009/06/creative-commons-license-types-pros-cons1.gif

Most Free

Least Free

CC License Selection Tool

http://creativecommons.org/choose/

Use this to select your CC!

Reuse/Remix OER & Repurpose MOOCs...

http://list.ly/list/O97-mooc-development-platforms

For Course Content!

*OER: Open Educational Resources

*MOOCs: Massive Open Online Courses

More Learning Tools?

http://list.ly/list/I5U-top-100-plus-learning-tools-on-planet-earth

Top 190+ LEARNING TOOLS on Planet Earth!

Android

Web 2.0

Bloom’s Digital Taxonomies!

http://www.slideshare.net/zaid/creative-visualizations-of-blooms-taxonomies

Google

Best Quick Reference Guides to Tools?

Social Media & Web 2.0 Reference Guides: http://zaidlearn.blogspot.com/2012/07/best-quick-reference-guides-to-web-20.html

6Simplified

Gamified Flipped Learning Experiences?

Engaging Flow

Gamify!

LearningActivities

ContentAssessment

Learning Outcomes

Flipping

F2F Online

https://www.facebook.com/groups/LearningInnovationCircle/

http://zaidlearn.blogspot.com/

Have a

ZaidLearn!

Finally, You Might Want To…

https://my.linkedin.com/in/zaidlearn

zaid.alsagoff@gmail.com

http://zaidlearn.blogspot.com/

http://twitter.com/zaidlearn

http://www.slideshare.net/zaid

Zaid Ali AlsagoffLearning Innovation Specialist

AQL Learning Innovation Consultancy

designing gamified flipped learning experiences

Education

flipped classroom experiences: student preferences and ......

flipped classroom – flipped textbook

gwc14: victor manrique - "how successful gamified...

the future of 4 innovative learning practices: gamified...

gamechat - gamified instant messaging

dos años de experiences con flipped learning

distance and online learners engaging learning experiences...

enhancing engagement, enjoyment and learning...

gamified time management course

flipped learning & flipped cpd

designing 21st century flipped learning experiences

gamified boards

reactions to gamified training

gamified release planningvf_for share

supporting flipped and gamified learning with augmented

4.8 gamified lesson plans -...

gamified proposal alphadraft

magnetik® global...

tourney – gamified university

€¦ · web viewhow adhd children’s views and...