Knowledge Acquisition

سورنا ناصر مقدسی

Table of Contents

Difficulties with Knowledge Acquisition

Roles of Elicitation Team Members

Knowledge Elicitation Tasks

Overview

Types of Knowledge

Sources of Knowledge

Time Requirements for Knowledge Acquisition

Case Study Method

Interview Method

Comparison of Elicitation Methods Knowledge

Analysis

Overview

Overview Objective Knowledge Elicitation

Interview Case Study

Answers

QuestionsDomainExpert

Knowledge

EngineerResults

Knowledge

ExpertSystem

Types Of Knowledge

Types of Knowledge

Procedural Knowledge RulesStrategiesAgendaProcedures

Declarative Knowledge ConceptsObjectsFacts

Meta-Knowledge Knowledge about the other types of knowledge and how to use them

Heuristic Knowledge Rules of Thumb

Structural Knowledge Rule SetsConcept Relationships

Sources of Knowledge

Sources of Knowledge

Expert End-User Multiple Experts Literature

Reports Books Regulations Guidelines

Knowledge Elicitation Tasks

Knowledge Elicitation Tasks Collect

Task of acquiring knowledge from the expert Interpret

Review/Identify key pieces of knowledge Analyze

Gain insight into forming theories on the organization of the knowledge and problem-solving strategies

Design Form new understanding of the problem that can aid further

investigation

Time Requirements For Knowledge Acquisition

Time Requirements For Knowledge Acquisition

Hours

ConductingInterpretingAnalyzingDesigning

Difficulties With Knowledge Acquisition

Difficulties With Knowledge Acquisition

Psychological View of Elicitation Problems Unaware of Knowledge Used Unable to Verbalize the Knowledge Provides Irrelevant Knowledge Provides Incomplete Knowledge Provides Incorrect Knowledge Provides Inconsistent Knowledge

Roles of The Elicitation Team Members

Roles of The Elicitation Team Members

End-User Provide Overview Define Interface Requirements Define Explanation Requirements Help Define In-Place Operational Requirements Aid System Development

Expert Provide Knowledge Aid Interpretation Aid Testing

Knowledge Engineer Collect Knowledge Interpret and Analyze Knowledge Design New Session Manage Project

Interviewing Method- Managing the Interview- Unstructured Interview- Structured Interview- Problems With Interviewing

Managing The Interview

The First Team Meeting Remove Fear Remove Skepticism Establish Reasonable Goals Promote Openness To Change Provide Understanding of Expected Effort Convey Importance of Involvement

Guidelines for the First Team Meeting(Preparing The Interview)

Prepare Agenda Scheduling Materials List Tape Recording Video Recording

Managing The Interview(Cont’d) Beginning the Interview

Set Initial Tone Review Agenda

Conducting the Interview Following the Agenda Types of Questions

Direct Indirect

Good Question Design Avoid Multiple Part Questions Avoid Leading Questions Avoid Negative Questions Avoid Universal Questions Avoid the Use of Foreign Terms Avoid Subjective Terms

Managing The Interview(Cont’d)

Question Sequence Funnel Sequence

Active Listening Interruptions

Pros: Clarifying an unknown issue, Requesting more details Cons: disrupt the expert’s train of thought, loss of information Interrupting the expert during a declarative discussion Interrupting the expert during a procedural discussion

Ending the Interview Review the key findings Review any outstanding questions that were raised during the

interview Discuss the unattended agenda items Discuss the future direction of the discussion Extend appreciation to the team members for their time and

information

Unstructured Interview

Overview and Example Ask a general question and see where it goes! The Satellite ES Example

Guidelines Pose an initial prompt or indirect question Interrupt the session with probe questions to explore

significant issues

Be cautious with interruptions Gain an understanding of the important concepts and plan

future interviews

Advantages and Disadvantages Provides a general understanding of the problem Helps identify important concepts and objects Provides insight into general problem solving methods Allows for spontaneity in the interview

Advantages and Disadvantages(Cont’d)

Information collected may be overwhelming, fragmented or shallow

Provides very little factual information Provides few details on concepts or objects Provides few details on procedural information

Structured Interview

Overview and Example Use it when you need specific information The Farm Example

Guidelines choose a specific topic Identify new concepts from the discussion Continue this process until enough details are obtained then

return to one of the new concepts mentioned earlier and ask for further discussion

Gain an understanding of the important concepts and their relationships, rules and strategies from the transcripts

Advantages and Disadvantages Maintains a focus on a given issue provides detailed information on the issue Provides insight into declarative knowledge used Study of one concept can lead to the definition of other

unknown related concepts

Advantages and Disadvantages(Cont’d)

Provides structural relationship of concepts

Concepts unrelated to the interview’s focus may not be found You must be secure in your understanding of the important

issues to direct the interview Provides only weak insight into procedural knowledge such as

rules or problem solving strategies

Problems with Interviewing Recalling Procedural Knowledge Ineffective Long-Term Memory Verbalizing Manual Tasks Verbalizing Compiled Knowledge Lacks Context

Case Study- Retrospective Case Study Method- Observational Case Study Method

Retrospective Case Study Method

Directions to Expert Forming the Protocol

The Ventilation System Example Guidelines for a Retrospective Case Study

Choose a Typical Case Ask the expert to explain how he solved the problem Record the expert’s discussion Highlight important issues Be careful of interruptions

Advantages and Disadvantages

Observational Case Study Method

Directions to Expert Concurrent Protocol Thinking Aloud

Example Guidelines for a Retrospective Case Study Advantages and Disadvantages

Observational Study of the Familiar Case Example Guidelines Advantages and Disadvantages

Observational Study of the Unfamiliar Case Example Guidelines Advantages and Disadvantages

Comparison of Elicitation Methods

- Knowledge Analysis

Capability of Elicitation Technique for Obtaining Knowledge

Interviewing Case Study

Retrospective Observational

Knowledge Type

Unstructured

Structured

Familiar Unfamiliar Familiar Unfamiliar

Facts Poor Good Fair Average Good Excellent

Concepts Excellent Excellent Average Average Good Good

Objects Good Excellent Average Average Good Good

Rules Fair Average Average Average Good Excellent

Strategies Average Average Good Good Excellent Excellent

Heuristics Fair Average Excellent Good Good Poor

Structures Fair Excellent Average Average Average Average

Capability of Elicitation Technique for Obtaining Knowledge

Interviewing Case Study

Retrospective Observational

Problem Type

Unstructured

Structured

Familiar Unfamiliar Familiar Unfamiliar

Unaware of Knowledge

Poor Fair Average Average Good Excellent

Unable to Verbalize

Knowledge

Fair Fair Average Average Average Good

Irrelevant Knowledge

Poor Average Average Average Average Good

Incomplete Knowledge

Average Average Poor Average Average Excellent

Incorrect Knowledge

Average Average Poor Average Average Excellent

Inconsistent Knowledge

Average Average Poor Fair Fair Excellent

Knowledge Analysis

Producing the Transcript Interpreting the Transcript Analyzing the Transcript Recording the Knowledge Relating the Knowledge Reviewing the Knowledge Structuring the Knowledge Graphically

Cognitive Maps Inference Networks Flowcharts Decision Trees

Cognitive Maps

Employees

Managers

Bob

Engineers

JaneMary

Age

Salary

Unknown

10K – 100K

Job

Salary

Bonus

Salary

Age

Age

Age

Salary

Salar

y

Sal

ary

Job

Job

Job

Yes, No Research, Design

30K – 60K50K – 80K

45

65K

Yes24

32KDesign

27

40K Research

Inference Networks

Weather Prediction is Rain

Barometric Pressure Falling

Wind Conditions Indicates Rain

Wind Gusty

Wind Speed > 5

Knots

Wind Direction From East

Temperature Moderate

60 < Temp < 80

Rule 7

Rule 8Rule 10

Rule 9 OR

AND

FlowchartsBlood

Disease Diagnosis

Obtain Initial Data

Can Form Hypothesis

Consult Specialist

Ask Questions Related to Hypothesis

Hypothesis Right

Run Tests to Confirm

Hypothesis

Prescribe Remedy

Tests Confirm Hypoth

esis

N

Y

N

YN

Y

Decision Tree

Terminals

Battery Voltage

ChargerDistributer

Not Loose Loose

Tighten Terminals

>12 <12

OKBADBADOKReplace BatteryReplace charger

Replace DistributerCheck Starter

سوال؟