asking the right questions - making the most of research - stats that matter workshop

12
1 Elizabeth Drakulich Christian Aid Asking the right questions

Upload: charitycomms

Post on 19-Aug-2015

849 views

Category:

Data & Analytics


2 download

TRANSCRIPT

Page 1: Asking the right questions - making the most of research - Stats that matter workshop

1

Elizabeth Drakulich Christian Aid

Asking the right questions

Page 2: Asking the right questions - making the most of research - Stats that matter workshop

What is research

Collecting data in order to answer a question

2

Written feedback

Online survey

Focus group

Telephoneinterview

Product review

Results

Activity logs

Directobservations

Market research

In-person interviews

Evaluations

Pre-testing

Page 3: Asking the right questions - making the most of research - Stats that matter workshop

Quick overview

1. Incorporate in your plans

2. What do you want to know?

3. Identify the best method

4. Undertake your research

5. Analyse results

6. Implement findings

3

Page 4: Asking the right questions - making the most of research - Stats that matter workshop

Methodology

Quantitative- Statistics

- Can ask how many

- Actions

- Surveys

4

Qualitative- More in-depth

- Can ask why

- Motivations

- Discussions / provide

open feedback

Page 5: Asking the right questions - making the most of research - Stats that matter workshop

Focus groups and interviews

Focus groups-Facilitated discussion with a group of people-Pros: Learning about feelings and motivations; testing concepts and exploring how they resonate, discussions, richer results-Cons: Not representative, time intensive, costly

Interviews-Semi / un-structured one-on-one discussions-Pros: Learning about feelings and motivations, testing concepts, can be candid discussion, richer results, can be done remotely-Cons: Not always representative, time intensive, costly

5

Page 6: Asking the right questions - making the most of research - Stats that matter workshop

Surveys

6

Questionnaire that people fill

out.

Page 7: Asking the right questions - making the most of research - Stats that matter workshop

SurveysMethods-In-person-Telephone-Paper – handed out, post-Online – specific website, social media

Pros – can create a representative sample, good for creating a baseline/tracking behaviours and attitudes, anonymity, rolling surveys, can be less expensive, easier to analyse

Cons – need larger number of participants, more prone to bias from self-selection, cannot immediately explore answers in more detail, people may not complete a survey the way you want, may exclude people with more/less interest in technology

7

Page 8: Asking the right questions - making the most of research - Stats that matter workshop

Other types of research

- Diary or activity logs- Responses or actions- Direct observations- Literature reviews / pulling together

previous studies

8

Page 9: Asking the right questions - making the most of research - Stats that matter workshop

Top tips - picking participants

- Typical of intended audience?- Core vs test samples- Demographic information- Think about numbers- Be clear about anonymity- Think about how you recruit

9

Page 10: Asking the right questions - making the most of research - Stats that matter workshop

Top tips - writing questions

- Length of survey- Length of answers- Language appropriate for audience- Readability and layout- Avoid leading questions- Avoid double answers- Rankings – even vs odd- Spontaneous vs prompted- Test your survey

10

Page 11: Asking the right questions - making the most of research - Stats that matter workshop

Analysis and implemetation

- Record your methodology- Put into context- Statistical analysis

- Narrative results / representative quotes“Where there is poverty and injustice, Christian Aid should seek to help end

this. It doesn’t matter if the country is low income, or middle income, if poverty exists then it needs to be tackled.’”

11

Page 12: Asking the right questions - making the most of research - Stats that matter workshop

12

Any questions?