AI Peer LearningUser Manual

Table of ContentsIntroduction to AI Peer Learning 3 ...............................................................

Goal of the system 3 .......................................................................................Audience 3 ..................................................................................................Where to find the system 3 ..............................................................................Browser compatibility 3 ...................................................................................Document version 3 ........................................................................................

Logging in 4 ...........................................................................................

Overview 5 ...........................................................................................Application Interface 5 ....................................................................................

Features and Roles 6 ...............................................................................

Prospective Case List 7 ............................................................................

Enter Tough Case to List 9 .........................................................................

Track Progress 10....................................................................................

2Analytical Informatics Inc. – Copyright 2017

Introduction to AI Peer LearningGoal of the systemThe AI Peer Learning application is a quality assurance tool that reviews prior radiology studies for discrepancies. This peer learning system includes the option to report cases to be reviewed hours from initial reporting, allowing you to catch errors earlier and change the course of patient care. You will also find advanced features, including the ability to designate tough cases and customize case reviews for physician specialties.

Audience This manual is intended for the front-line user of the Peer Learning application.

Where to find the systemThe system is entirely web-based and located as a launch-able link from the AI portal page.

Browser compatibilityThe system relies on HTML5, CSS3, and other web standards. Each web browser may implement part or all of these standards. To ensure you have the best experience please use one of the following browsers versions. The system currently supports the Chrome (>=42.x), Safari (>=8.x), Firefox (>=37.x) and Internet Explorer (>=9). The system has also been tested and validated for use on tablet computers.

Document versionThis document is version 20180105 and covers software versions of AI Peer Learning up to Version v2.1.7.

3Analytical Informatics Inc. – Copyright 2017

Logging inThe system displays protected health information and requires a user to login to the system via the main portal page, typically with their enterprise login ID. The system does not directly manage user names and passwords but delegates to the hospital central enterprise directory system. All page views are logged in the auditing system based on the authorized user ID.

�

4Analytical Informatics Inc. – Copyright 2017

Overview Application InterfaceThe interface is comprised of three panels:1) Left panel navigation panel includes features based on your role and

organization’s preferences 2) Middle panel with report notes and a button to load images within clinical

viewer3) Right panel with applicable review and reporting actions

5Analytical Informatics Inc. – Copyright 2017

Left: Navigation Middle: Exam Right: Review Actions

View case details and load images to the clinical viewer

Complete review

Features and Roles Feature Description Resident/

Fellow Attending Director

View Prospective Case List

An automated list of case ready to review based upon specialty review quota

✓ Might need to

review on behalf of attending

✓ ✓

Add Peer Learning Case

Manual method to select cases for review from PACS ✓ ✓ ✓

Identify Discrepant Case

Reporting mechanism for discrepancies identified while reviewing prior cases in PACS

✓ ✓ ✓

Case for Your Review & Conference

List of cases that have been identified discrepancy and tough cases assigned to you to review

✓ ✓ ✓

Adjudication

An adjudicator is assigned by specialty or sub-specialty to make the final decision on a discrepant case. If you are assigned as an adjudicator, cases needing adjudication will appear within Cases for Your Review

✓

✓ Could be assigned

adjudication for sub-specialty

✓

Enter Tough Case to List

Ability to request a second opinion on a tough case ✓ ✓ ✓

Track Progress

Summary of self-reported cases and peer learning cases Options to adjust case quotas for each physician

✓ ✓ ✓

View for all physicians

Options to adjust case quotas for each physician   ✓

6Analytical Informatics Inc. – Copyright 2017

Prospective Case List The Prospective Case List creates a list of exams reported in the previous 24 hours (expanding to longer as necessary) to be completed for review, sized by a review quota set by the department. The prospective case list uses radiologist specialties or procedure specialties to drive the mapping of cases that each radiologist should be reviewing.

The number of cases in the list is dependent upon the number of cases read the previous week by the radiologist in the same specialty. For instance, if a radiologist read 1000 cases the previous week, and the review quota required by the department for peer learning is 3%, 30 cases would be displayed in the list. The Prospective Case List is both random and anonymous.

In order to reach your review quota, complete the prospective cases listed in the middle panel. Your weekly review percentage is presented above the case list. You have the ability to raise the quota and if done, new cases will then be added to your list to reflect the new quota.

Steps: 1) Select “View Prospective Case List” in navigation panel and choose a case to review. The selected case will open in your organization’s clinical image viewer.

2) In the right-hand panel, choose if you agree with the report, think a finding wasn’t detected, or interpretation was incorrect.

3) Select if you think the review result is clinically significant.

4) Select adjudicator depending on the appropriate specialty

5)  Add in any comments & submit the review

7Analytical Informatics Inc. – Copyright 2017

5.

1.

2.

3.

4.

Cases for Your Review & Conference ReviewCases will show up in the “Cases for your review” section for the following reasons:

• Someone has disagreed with one of your reviews • A tough case with a requested second opinion has been assigned to

you • An adjudication has been assigned to you

Cases will show up in “Cases for Conference” if a tough case with a requested conference has been assigned to you.

The number of cases for your review will be indicated on the navigation panel.

Steps: 1) Click the “Cases for Your Review” or “Cases for Conference”

2) Cases for review will be listed in the middle portion of the screen.

3) Respond if you agree or disagree with the review. For conference reviews, choose if you concur, found a detection miss or interpretation miss. Add any appropriate comments.

4) Press “Respond” or “Submit Review” button.

8Analytical Informatics Inc. – Copyright 2017

Discrepant Case

Adjudication Case

1.

2.

3.

4.

Enter Tough Case to ListWhen you encounter a difficult exam and would like to designate it for a second opinion or conference review, enter the exam as a tough case. Administrators may optionally disable this feature.

Steps:1) Click on the “Enter Tough Case to List” navigation button. Search for the case by entering the MRN or accession number. This functionality can also be accessed from PACS or dictation system.

2) Mark the case, using a drop-down menu, to be reviewed for a 2nd opinion or for conference during a conference.

If 2nd opinion is selected, select who you would like to review the case. The case will then appear under the “Cases for Your Review” section for the specified reviewer.

If “Tough Case- Conference” is selected, then the case will then appear under “Cases for Conference” for all reviewers.

3) Add notes to describe the details or challenges of the tough case

4) Select adjudicator depending on the appropriate specialty

5) Click “Add Tough Case”

9Analytical Informatics Inc. – Copyright 2017

4.

5.

1.

2.

3.

Track ProgressTo analyze your progress, click on the “Track Progress” tab in the left-hand panel and choose the time period you would like to view.

Once you’ve customized your view, a chart will appear on the right-hand side and each view is summarized by a table with the following components:

1) Current Outstanding Cases: includes the number of outstanding cases that still need to be reviewed by that radiologist.

2) Participation: includes number of cases read and reviews completed, participation percentage, and number of missed reviews completed

3)Evaluation: includes the number of your cases that have been reviewed by others, the number of detection and interpretation misses found, the number of clinically significant detection and interpretation misses

Under the Tracking progress tab you can also track reviews submitted, reviews of yourself, discrepant reviews submitted and reviews of yours that had clinically significant errors by clicking your own name.

Section heads (employees mapped with supervisor, attending, and radiologist clinical roles) will be able to view all physician results and will be able to adjust quotas for each physician. (See the admin manual for details on these settings)

10Analytical Informatics Inc. – Copyright 2017

Reporting Measures Description

Cases ReadTotal number of cases that have

been read by that radiologist over the specified timeframe

Reviews Completed Total number of reviews

completed by the radiologist over the specified timeframe

Participation % Total cases reviewed/total cases read= Participation %

Misses Reported Number of reviews submitted with discrepant scoring

My Cases Reviewed Number of my cases that have been reviewed by others

Concur Cases Number of concur reviews for my cases reported by others

Detection Misses Number of detection misses for my cases reported by others

Interpretation Misses Number of clinically significant misses for my cases reported by

others

Clinically Significant Misses Number of clinically significant misses for my cases reported by

others

Clinically Significant Detection Misses %Number of clinically significant detection misses reported by

others / total cases read

Clinically Significant Interpretation Misses %

Number of clinically significant interpretation misses reported by

others / total cases read

11Analytical Informatics Inc. – Copyright 2017

For more information visit us at:

Analytical Informatics, Inc.8 Market Place, Suite 401Baltimore, MD 21202Web: www.analytical.infoTwitter: @analyticalinfoDocumentation: https://docs.analytical.info

12Analytical Informatics Inc. – Copyright 2017