Re-conceptualization of Piloting Research in Applied Linguistics

Montarat Rungruangthum PhD. candidate in Applied Linguistics

King Mongkut’s University of Technology Thonburi

Doing Research in Applied Linguistics Conference21-22 Apr. 2011

Cyber deception by Thai internet usersBackground of Cyber Deception

This experimental research aims to investigate language used by truth-tellers and deceivers in Thai online chat.

Problematic Research Design Factors e.g., chat program, ethics, and task design may influence the whole research design.

Research Design

Chat Program

Ethics

Tasks

Conceptualization of Piloting ResearchApplied Linguistics

“Dress Rehearsal” of full data collection procedures

(Dörnyei, 2007, p. 75)

To perfect the study, making sure every factor of the study meets expectations

Dress Rehearsal Piloting

A trial run of research instruments

Identifying research problems and practicality

Conceptualization of Piloting ResearchNursing

A small-scale study, as a “preparation” for doing the actual study

(Polit, Beck, & Hungler, 2001)

Decision-informing piloting at the early stage

Decision-Informing Piloting

Planning

A B C

Pilot A Pilot B Pilot C

Making Decisions

Implementation

Giving information of the study when making decisions on research design.

Full-scale piloting

Key Decisions to Make in Research Design

I. Chat Program II. Ethics (Asking Someone to Tell Lies) III. Task Design

Example I: Chat Program

What chat program should be used in my actual study?

MSN MessengerYahoo Messenger Others (QQ, ICQ)

1. Ask 100 subjects to complete questionnaire which chat

program they frequently use.

Decision-informing piloting

2. Talk to subjects (4-5 persons) to gather information on chat program.

What chat program do you frequently use?

Is the chat program compatible with Thai?

Example II: Ethics (Asking Subjects to Tell Lies)

What are their attitudes on being asked to tell lies?

Ethics concernConsent form

Decision-informing piloting

1. Interview subjects gathering information on their attitudes towards being asked to tell lies and their chat experiences

Do you tell lies in online chat?, if yes, why?

How do you feel when being asked to tell lies in online chat?

2. Ask subjects to review the consent form

Do you have any suggestions for the consent form?

Example 3: Task Design

How should the instructions be given? Do these instructions influence the data?

Pretend to be someone else in online communication

Provide untruthful information in online communication

Convince your chat partner that you are someone else in online communication

Decision-Informing Piloting

1. Try out different instructions and find out how these could result in the data collection.

Telling fantasy story Telling lie based on personal

background

2. Ask subjects to read the instructions and report what the experiment is about

Getting feedback on the research design

Decision-Informing Piloting: Lessons Learned from the Field of Nursing

What can Applied Linguistics learn from the field of Nursing about pilot studies?

Strengths Developing a research planAssessing the feasibility and problems of the full-scale studyProviding important data and guideline for the studyBeing aware of variables affected in the study.Training a researcher in as many elements of the research process as possible.

Weaknesses Time consuming Successful pilot studies cannot

guarantee the success in the main study.

Q & A

THANK YOU