Benefits of Participating in a Mobile App Evaluation Project

Alicia Lillich Kansas Outreach and Technology

Coordinator A.R. Dykes Library

University of Kansas Medical Center

John Bramble Utah Outreach and Research

Enterprise Coordinator University of Utah Eccles Health

Sciences Library

Purpose

MCR provided funds for librarians to purchase apps. Participants evaluated and shared their experience

with the community. Indicators: participants benefit and improve

confidence

Participant Requirements

MCR Full Network member Professional librarian* Experiment and report on 4 appropriate apps Submit reports by deadlines

Rules for App Selection

Apps must be appropriate for their setting – Purposely kept broad

Must cost money – Or free apps that offered in-app purchases

Year 1 Distributed $650 = 13 x $50

– 10 iTunes – 3 Google Play

Year 2 Year 2: $950 = 19 x $50

– 15 iTunes – 4 Google Play

Cost and Cards Distributed

Evaluation Tool

Reporting Summaries of each review highlighted in the

Plains to Peak Post (MCR newsletter) 2016 MCR Questionnaire:

23/28 readers said reports

increased awareness of mobile apps

Year One 13 Library Type

Hospital 6

Academic 7

Card Type

iTunes 10

Google Play 3

State

Colorado 3

Kansas 3

Missouri 2

Nebraska 3

Utah 1

Wyoming 1

Participants Year Two 19 Library Type

Hospital 5

Academic 14

Card Type

iTunes 15

Google Play 4

State

Colorado 3

Kansas 2

Missouri 7

Nebraska 4

Utah 2

Wyoming 1

Apps Evaluated Excellent 1Password AnkiMobile BioStat Decision Tool CalenMob Pro for Google Calendar Clear Clinical Pattern Recognition: Knee Pain Concussion Assessment & Response: Sport

Version Dexteria - Fine Motor Skills Development Duet Display Explain Everything Family Medicine Study Guide Family Practice Notebook FRAX:WHO Fracture Risk Assessment Tool GoodReader IFTTT iMoodJournal Infectious Disease Compendium: A

Persiflager's Guide iThoughts Kidometer Kidometer KidsDoc Medrills: Pediatric considerations Micromedex Drug Reference Essentials MindNode Muscle Trigger Points by Real Bodywork NCLEX-RN Alt-format Patient Education Bundle Patient Education Bundle-Spine patient education bundle; Heart Patient Education Bundle: Heart, Ortho and

Spine PDF Expert 5 Pocket Anatomy Pocket Heart, version 2.3 Prognosis: Your Diagnosis Research Methods for Library and

Information Science Professionals - Book by Martin Frické

Spine Pro III SplashID Stop Breathe & Think The Mindfulness App Transesophageal Echocardiography (TEE):

Colour Doppler Visible Body Atlas

Very Good ABCs of Medical Management of Stones ArchieMD 3D Health Essentials Buddhify Byword CBT Keeper Diagnosaurus DDX Differential diagnosis pocket. Also referred to

as DDX Pocket Drawboard PDF Encyclopedia of Alternative Medicine English<>Spanish Medical Evernote Feed Baby Flashcards Deluxe GoScholar ICU Rounds iGeriatrics igeriatrics Infectious Disease Compendium: A

Persiflager's Guide Interfaith Care for the Ill JKZ Series2 and JKZ Series3 (Mindfulness

Apps by Jon Kabat-Zinn) Journal Club for Android Lab Values Pro Lab Values Pro 3 in 1 Medical Reference LastPass Password Mgr Premium MD on Call

MedCalc - The Professional Medical Calculator Medical Microbiology Pronunciations Medical Spanish: Healthcare Phrasebook with

Audio Mediquations Mediquations Medical Calculator Memeo Connect Reader for ipad MRSA eGuideline My Wonderful Days: Daily Journal/Diary NCLEX-RN Exam Prep 2015 Noteshelf Nurse Tabs Complete OnExam Pediatric Quiz Game Physical Exam Essentials Pill Monitor – Medication Reminders and Logs Prioritize Me Prizmo Scanning & OCR app Psych On Demand PubMed on Tap RH Medical Labs SoundNote The Mindfulness App Todo Fairly/Mildly Good AHIMA Pocket Glossary Animated Pocket Dictionary of Allergy Dara Torres Health & Fitness Fooducate GoodReader Instant Anatomy Flash Cards Journal Club for Android LabGear 3.0 Large Print Message Composer Lippincott's NCLEX-RN Marvin Medical Abbreviations Medical Doctor: Reference Tool

Medical Microbiology Medical Term Pronunciation Medical Terms Abbreviation MobileDDx mySymptoms NCLEX-RN Practice Test & Questions Osteopathic Medicine pocketcards By Börm

Bruckmeier Publishing LLC Outliner Pain Therapy palmEM Pediatric Blue Book Polaris Office5 PSA (Psychological Symptoms Analyzer) RN Cheat Sheet Shelby's Quest Shelved SportsMed TalkBoard Ultimeyes Not Good Everyday First Aid Instant Blood Pressure Nursing History T'ai Chi for Life

Year 1 Total Spent: $305 Average Cost: $6.63 Highest App Cost: $24 Lowest App Cost: Free Leftover Funds: $345

Year 2 Total Spent: $625 Average Cost: $8.22 Highest App Cost: $45 Lowest App Cost: Free Leftover Funds: $325

App Costs

Apps mainly focused on health/medicine or productivity

0

10

20

30

40

50

60

Health/Medicine Productivity

Year 1 Year 2

App Types

App Ranking

0

5

10

15

20

25

30

Excellent Very Good Fairly/Mildly Good Not Good

Year1 Year2

Self-Evaluation

[VALUE]

22%

31%

5%

5% 58%

47%

54%

26%

26%

15%

Y2: My involvement in this project benefited or enhanced my professional development.

Y2: I now feel more confident in my ability to

evaluate mobile apps.

Y1: Participating in this project benefited my program.

Strongly Agree Agree Neither Disagree

No Response Positively Very Positively

Rate of Participation

73% 74%

21% 26%

6%

Year 1 Year 2

No Report

Late

On Time

Evaluations were down-graded for: – Blank Responses – Using “Information Not

Available” response Range A (0 deductions) to

G (6 deductions)

Quality of Evaluations

0

5

10

15

20

25

30

35

A B C D E F G

Quality Grading of Evaluations

Lessons Learned - Positives

Fun Diverse apps were selected Mostly happy with the evaluations

Participant Comments

“You have made this a fun year!” “This enabled me to critically evaluate apps that I

otherwise would not have downloaded. I am also reading all the other reviews and will be adding a section to our mobile apps LibGuide.”

Lessons Learned - Challenges

Lower cost app selection Managing participants

– Meeting deadlines – Quality of evaluations

Evaluation form problems – Too comprehensive

Participant Comments

“I found the evaluation form for this project hard to fill out”

“Sometimes it was difficult to decide which app to

test drive. Lots of information on free apps, but how do you find apps with a fee that are appropriate?”

Recommendations

Limit funds Revise evaluation form

– Shorten – Require responses

More guidance in app selection

Questions?