data collection and quality assurance · •data collection is the process of gathering and...

50
Data Collection and Quality Assurance Dr Thida MBBS; M.MedSc (PH); PhD (Epidemiology) Director (Socio-Medical Research) Department of Medical Research (POLB) 1 Training Workshop on Research Management and Research Information at DMR

Upload: others

Post on 02-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Data Collection and Quality Assurance

Dr Thida

MBBS; M.MedSc (PH); PhD (Epidemiology) Director (Socio-Medical Research)

Department of Medical Research (POLB)

1 Training Workshop on Research Management and Research Information at DMR

Page 2: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Observation or measurement characteristic

of a person, object or phenomenon (or)

Raw materials for statistics

What is data?

2 Training Workshop on Research Management and Research Information at DMR

Page 3: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

3

Variable Data

• Age

(in completed years)

• 20 Yrs, 32 Yrs, etc

• Education level • Primary, Middle, High, etc

• Sex • Male, Female

Variable Vs. Data

Training Workshop on Research Management and Research Information at DMR

Page 4: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Primary data

Secondary data

Tertiary data

Sources of data

4 Training Workshop on Research Management and Research Information at DMR

Page 5: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

• The primary data are those which are

collected afresh and for the first time, and

thus happen to be original in character

• Examples: Experiments, Survey

Primary data

5 Training Workshop on Research Management and Research Information at DMR

Page 6: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Secondary data

• An existing data to investigate research

questions other than those for which the data

were originally gathered (routinely available

information)

• Examples: Vital registration, Hospital statistics

6 Training Workshop on Research Management and Research Information at DMR

Page 7: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Before using secondary data, must see that

they possess following characteristics:

1. Reliability of data

2. Suitability of data

3. Adequacy of data

7 Training Workshop on Research Management and Research Information at DMR

Page 8: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

• Combination and reanalysis of previously

reported data, all relating to the same

research question, from multiple sources

• e.g- 9 Randomized Controlled Trials of

diuretic treatment for pre-eclampsia

Tertiary data

8 Training Workshop on Research Management and Research Information at DMR

Page 9: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

• Data collection is the process of gathering and

measuring information on variables of interest, in

an established systematic fashion that enables

one to answer stated research questions, test

hypotheses, and evaluate outcomes.

What is data collection

9 Training Workshop on Research Management and Research Information at DMR

Page 10: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

When do we begin ?

The task of data collection begins after

• a research problem has been defined

• research design/ plan chalked out

10 Training Workshop on Research Management and Research Information at DMR

Page 11: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Types of data collection methods

Quantitative data collection methods

(in numbers) ကနးဂဏနးမားျဖင အခကအလက

ေကာကယျခငး

Qualitative data collection methods

(in words) စကားစမားျဖင အခကအလက ေကာကယျခငး

11 Training Workshop on Research Management and Research Information at DMR

Page 12: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Quantitative Data Collection

12 Training Workshop on Research Management and Research Information at DMR

Page 13: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Quantitative Data Collection Methods

Using available information (secondary data)

Interviewing

Administering questionnaire

Clinical measurements: BP, Wt, Ht

Investigations: ECG, USG, X’Ray, Blood CP,

etc

13 Training Workshop on Research Management and Research Information at DMR

Page 14: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Using available information

Census data

Unpublished reports

Hospital records

Information routinely collected by others

14 Training Workshop on Research Management and Research Information at DMR

Page 15: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Interviewing (ေတြ႕ဆေမးျမနးျခငး)

15

A technique that involves oral questioning of

respondents (questionnaire)

ေမးခြနးလႊာက အသးျပ၍ ႏႈတျဖငေမးျမနးေသာ နညးလမး

Face to face interview Telephone interview

Training Workshop on Research Management and Research Information at DMR

Page 16: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Administering written questionnaire

Also called self-administered questionnaire

Questions are presented that are to be

answered by the respondents in written form

Not suitable for respondents with low

education level and children

16 Training Workshop on Research Management and Research Information at DMR

Page 17: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Administering written questionnaire

Gather the respondents & give instruction

Mailing

Online

17 Training Workshop on Research Management and Research Information at DMR

Page 18: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Based on question

Closed questions

Open-ended questions

Semi-opened questions

Types of questions

18 Training Workshop on Research Management and Research Information at DMR

Based on response

Single response

Multiple response

Page 19: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Closed questions

A list of possible answers/options (pre-coded)

Commonly used for background variables

Should be exhaustive & mutually exclusive

19 Training Workshop on Research Management and Research Information at DMR

Page 20: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Example of closed questions

What is your marital status?

1. Single

2.Living together

3.Married

4.Separated

5.Divorced

6. Widowed

20 Training Workshop on Research Management and Research Information at DMR

Page 21: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Visual Analog Scale (VAS)

Closed-ended questions using lines or other

drawings

Rate characteristics on a continuous scale

e.g- VAS for rating the severity of pain

None Unbearable

21 Training Workshop on Research Management and Research Information at DMR

Page 22: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

How do you think about your health in

general for today?

22

ယေန႔ သင ကနးမာေရး အေျခအေနကဘယလထငပါသလ။

Training Workshop on Research Management and Research Information at DMR

Page 23: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Example of Likert-scale questions

23

Stro

ngl

y

agre

e

Agr

ee

Un

cert

ain

Dis

agre

e

Stro

ngl

y

dis

agre

e

Contraceptive use can improve the

mother’s health.

Contraceptive use is against the human

nature.

Use in attitude questions for a particular issue

Training Workshop on Research Management and Research Information at DMR

Page 24: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Open-ended questions

Free to answer with fewer limits imposed by

the researcher

Useful for exploring new areas

What are possible effects of climate change

on the health of human being?

_______________________________________

_______________________________________

24 Training Workshop on Research Management and Research Information at DMR

Page 25: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Semi-opened questions

What is your occupation?

(1) Dependent

(2) Manual labourer

(3) Government employee

(4) Private employee

(5) Owned business

(6) Others (please specify) _____________

25 Training Workshop on Research Management and Research Information at DMR

Page 26: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Step 1: Think for the objectives and variables

Step 2: Decide on the main sections

Step 3: Write out the questions

Step 4: Sequencing the questions

Step 5: Compose a draft

Step 6: Take out any questions that are not

essential

Step 7: Check the skip patterns

Step 8: Validation; Pretesting

Steps in designing a questionnaire

26 Training Workshop on Research Management and Research Information at DMR

Page 27: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

• Use simple language

• Avoid conjunctive items

• Avoid questions that have ambiguous

words or phrases

• Avoid leading questions

• Start with the easy questions

• Ask all respondents each question in

exactly the same way

27

Points to consider

Training Workshop on Research Management and Research Information at DMR

Page 28: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

• Do not overload your interview schedule

• straight forward directions for the

respondents so that they may not feel

any difficulty in answering the questions.

28 Training Workshop on Research Management and Research Information at DMR

Page 29: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

29

• Informed consent

• Section 1: Background characteristics

• Section 2: Knowledge questions

• Section 3: Attitude questions

• Section 4: Practice questions

Example of KAP questionnaire

Training Workshop on Research Management and Research Information at DMR

Page 30: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

30

• Knowledge questions

Record both prompted & unprompted

responses

Arrange for skip patterns

• Attitude questions

Construct as the statements

• Practice questions

Check to include time in asking behavior

Arrange skip patterns

Points to consider in developing KAP

questionnaire

Training Workshop on Research Management and Research Information at DMR

Page 31: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Qualitative Data Collection

31 Training Workshop on Research Management and Research Information at DMR

Page 32: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

32

Qualitative Data Collection

Identification and exploration of INSIGHT in

human behavior in the nature (motivations,

opinions, attitudes) express in words

‘Why’, ‘What’ & ‘How’ are important questions

Training Workshop on Research Management and Research Information at DMR

Page 33: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Qualitative Data Collection Techniques

Focus group discussion (FGD)

In-depth interview (IDI)

Key informant interview (KII)

Observation

33 Training Workshop on Research Management and Research Information at DMR

Page 34: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Focus group discussion (FGD)

• A group discussion of 6-12 persons

• Gathers people from similar background

• Discussion guided by a facilitator

• Group members discuss freely & spontaneously

on a certain topic

ဝငးဖြ႕ေဆြးေႏြးျခငး

34 Training Workshop on Research Management and Research Information at DMR

Page 35: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

1

2

3

4 5

6

7

8

9

Facilitator

Participant

F

P

NT

Sitting Plan

FGD Guide

Cassette Recorder

Person

Source: Powerpoint presentation of Dr. Than Tun Sein

35 Training Workshop on Research Management and Research Information at DMR

Page 36: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

In-depth Interview (IDI)

• FGDs are not appropriate for asking sensitive

issues

• An interview is made about the issues relating

to the interviewee by using IDI guide

• Explore a person’s perspectives, ideas,

opinions, experiences, etc

• Sensitive issues may be included

တဥးခငး အေသးစတ ေမးျမနးျခငး

36 Training Workshop on Research Management and Research Information at DMR

Page 37: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Key Informant Interview (KII)

•Getting information from the key informants, use

KII guide

• Key informant a person who can provide

detailed information about a process/situation

based on special expertise or knowledge

• An interview is made not about the informant,

but about the process or a situation

ႏ႔ႏ႔စပစပသရသမားအား ေမးျမနးျခငး

37 Training Workshop on Research Management and Research Information at DMR

Page 38: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Developing FGD, IDI & KII Guides

• Introduction introduce yourself & explain

objectives of the study

• Ask some background characteristics

• Decide major themes based on the study

objectives

• Develop open-ended questions under each

theme

• “What”, “How”, “Why” are important questions

to follow depending on the response

38 Training Workshop on Research Management and Research Information at DMR

Page 39: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Observation

Participant observation

The observer takes part in the situation he or she

observes

Non-participant observation

The observer watches the situation, openly or

concealed, but does not participate

A technique which involves systematically selecting,

watching and recording behavior and characteristics

of living beings, objects or phenomena

39 Training Workshop on Research Management and Research Information at DMR

Page 40: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Review your study objective

What type of information do you require

Independent and dependent variables

Characteristics of the study population

(age, literacy)

Accessibility to sample (time, infrastructure)

Which type of data collection technique will be

used to gather the information you need

Factors to be considered in choice of method

40 Training Workshop on Research Management and Research Information at DMR

Page 41: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

41

Bias: A distortion in the collected data so

that it does not represent reality

Quality assurance in data collection

Training Workshop on Research Management and Research Information at DMR

Page 42: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Possible sources of Bias

Defective instruments (သးစြသည ကရယာခြတယြငးမႈ)

• Questionnaires (ေမးခြနးလႊာခြတယြငးျခငး) e.g- Vaguely phrased questions

• Measurements (တငးတာမႈခြတယြငးျခငး)

- Un-standardized equipments (စႏႈနးမညထားျခငး) e.g- weighing scale, BP cuff

- Laboratory mishaps (ဓါတခြခနးမ မားယြငးျခငး) e.g- mislabeled specimens

42 Training Workshop on Research Management and Research Information at DMR

Page 43: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Possible sources of bias (cont.)

Observer bias (ေလလာသ၏ခြတယြငးမႈ)

• Unclear guideline for conducting interview

• Unclear instruction on how to measure

Effect of interview

Information bias (သတငးမားယြငးျခငး)

• Memory/ recall bias

e.g- Has your child had diarrhea over the

past 12 months?

43 Training Workshop on Research Management and Research Information at DMR

Page 44: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Control of Bias

Standardization of all instruments

Training of all interviewers

Pre-testing questionnaire

44 Training Workshop on Research Management and Research Information at DMR

Page 45: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

View different methods of data collection

Prevalence of hypertension may be obtained

by

Measuring blood pressure

(clinical measurement)

Asking a person if he/she has hypertension

(interview)

Record study

(document review)

45 Training Workshop on Research Management and Research Information at DMR

Page 46: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

Combine number of methods

(qualitative & quantitative)

Collect data from different study population

(e.g. patients, community member, health

staff and health manger)

Give more comprehensive understanding

Triangulation

46 Training Workshop on Research Management and Research Information at DMR

Page 47: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

47

Data collection (Materials and methods)

Preparatory phase

Development of data collection tools

(questionnaire/proforma/ guideline (or)

preparation of necessary materials)

Training of interviewers or data collectors

Pre-testing or standardization of data

collection tools

How to write in your proposal?

Training Workshop on Research Management and Research Information at DMR

Page 48: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

48

Data collection (Materials and methods)

Data collection phase

Mention data collection technique

(interview, observation, investigation)

Describe the details of data collection

procedures step by step

Who will perform what procedure?

Where will you do that procedure?

How to write in your proposal? (cont.)

Training Workshop on Research Management and Research Information at DMR

Page 49: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

References

49

• Power point presentation of Dr Le Le Win, Lecture Notes, First training

workshop on research capacity strengthening for basic health

professionals, 2020, DMR

• Power point presentation of Dr Myo Myo Mon, Lecture Notes, Research methodology workshop, 2013, DMR

Training Workshop on Research Management and Research Information at DMR

Page 50: Data Collection and Quality Assurance · •Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that

50

Questions, comments and suggestions would be greatly appreciated!

Training Workshop on Research Management and Research Information at DMR